About The Company
Capital One is a leading financial services organization dedicated to transforming banking through innovative technology and responsible AI integration. With a focus on creating personalized, real-time customer experiences, Capital One has established itself as an industry pioneer in leveraging machine learning and artificial intelligence to improve financial services. The company’s investment in advanced technology infrastructure and a team of world-class talent enables it to develop scalable, high-performance AI systems that enhance customer engagement and operational efficiency. Capital One’s commitment to responsible AI deployment ensures that its solutions are not only innovative but also ethical and compliant with industry standards. As a forward-thinking organization, Capital One continually seeks to reimagine banking, making it more accessible, efficient, and human-centric for millions of customers worldwide.
About The Role
The Lead AI Engineer specializing in Vision Model Customization and Vision-Language Models (VLM) at Capital One will play a pivotal role in advancing the company’s AI capabilities. This position involves designing, developing, and deploying cutting-edge AI solutions that leverage large language models, vision models, and their integration to enhance banking products and customer experiences. The successful candidate will collaborate closely with cross-functional teams, including research scientists, engineers, product managers, and technical program managers, to create innovative AI-powered features that transform how customers interact with Capital One’s services. Responsibilities include managing foundation model training, large language model inference, similarity search, and implementing robust guardrails and governance frameworks to ensure responsible AI deployment. The role offers an exciting opportunity to influence the long-term AI strategy of the organization, contribute to state-of-the-art research, and solve complex problems at scale.
Qualifications
The ideal candidate will possess a strong technical background with a passion for building scalable AI systems. A minimum of a Bachelor’s degree in Computer Science, AI, Electrical Engineering, or related fields, along with at least 4 years of experience in developing AI and ML algorithms, is required. A Master’s degree with a minimum of 2 years of relevant experience will also be considered. Proficiency in programming languages such as Python, Java, Scala, or Go is essential. Candidates with extensive experience deploying AI solutions on cloud platforms like AWS, Google Cloud, or Azure, and familiarity with open-source AI tools such as Huggingface, PyTorch, Nemo Guardrails, and VectorDBs are preferred. Strong understanding of AI optimization techniques, hardware utilization, and inference software is highly desirable. Additionally, candidates should demonstrate a solid foundation in engineering and mathematics, along with the ability to stay current with the latest AI research and apply novel techniques in production environments.
Responsibilities
- Partner with multidisciplinary teams to deliver innovative AI products that improve customer interactions and operational workflows at Capital One.
- Design, develop, test, and support AI software components, including foundation models, large language models, similarity search, and observability tools.
- Leverage a broad stack of open-source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, and PyTorch to build scalable solutions.
- Invent and implement state-of-the-art optimization techniques for large language models to enhance performance, scalability, cost-efficiency, and latency.
- Contribute to the technical vision and roadmap for foundational AI systems at Capital One, ensuring alignment with business goals and industry standards.
- Evaluate and implement governance, compliance, and safety guardrails to ensure responsible AI deployment.
- Engage in continuous learning and research to incorporate emerging AI techniques into production systems, maintaining Capital One’s leadership in AI innovation.
Benefits
Capital One offers a comprehensive benefits package designed to support the well-being of its employees. This includes competitive health, dental, and vision insurance plans, wellness programs, and financial benefits such as retirement plans and stock options. Employees have access to generous paid time off, flexible work arrangements, and professional development opportunities to foster career growth. The company promotes an inclusive and collaborative work environment that values diversity and innovation. Additionally, employees are encouraged to participate in community service initiatives and wellness activities, contributing to a healthy work-life balance. Capital One’s benefits are tailored to support your overall well-being, ensuring you have the resources needed to thrive both professionally and personally.
Equal Opportunity
Capital One is an equal opportunity employer committed to fostering a diverse and inclusive workplace. We do not discriminate against any individual on the basis of race, color, religion, sex, national origin, age, disability, veteran status, sexual orientation, gender identity, or any other protected characteristic. Our hiring practices are designed to promote fairness and equal opportunity for all qualified applicants. We also support a drug-free workplace and comply with applicable laws regarding criminal background inquiries. Capital One values the unique perspectives and experiences of its employees and is dedicated to creating an environment where everyone can succeed and contribute to our shared mission of reimagining banking through responsible AI innovation.