Senior Manager, AI Engineering (People Leader) (Gen AI Platform Services)

Discover Financial
San Jose, San Francisco, Cambridge, New York
Workplace: OnsiteFull timeUSD 229,900 - 286,200 annuallyFunction: Data Science & Machine LearningExperience: 4+ yearsEducation: bachelorsSkills: ["Mentoring","Coaching","Leadership","Communication","Judgment"]

Lead AI engineering across Capital One’s Intelligent Foundations and Experiences team, partnering with engineers, research scientists, program managers, and product managers to deliver AI-powered products. Oversee end-to-end development of AI software components—from foundation model training and LLM inference to similarity search, guardrails, evaluation, governance, and observability. Drive build-vs-buy decisions across open source and SaaS technologies and introduce LLM optimization techniques to improve scalability, cost, latency, and throughput while mentoring and growing your team.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Discover Financial
Discover Financial
1 week ago

Senior Manager, AI Engineering (People Leader) (Gen AI Platform Services)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 2 hours agoStatus: Live

Job Summary

Lead AI engineering across Capital One’s Intelligent Foundations and Experiences team, partnering with engineers, research scientists, program managers, and product managers to deliver AI-powered products. Oversee end-to-end development of AI software components—from foundation model training and LLM inference to similarity search, guardrails, evaluation, governance, and observability. Drive build-vs-buy decisions across open source and SaaS technologies and introduce LLM optimization techniques to improve scalability, cost, latency, and throughput while mentoring and growing your team.
Location: San Jose, San Francisco, Cambridge, New York
Workplace: Onsite
Employment Type: Full time
Job Function: Data Science & Machine Learning
Seniority: Sr. Manager level

Key Responsibilities

  • •Partner cross-functionally to deliver AI-powered products that change how associates work and how customers interact with Capital One.
  • •Oversee the end-to-end design, development, testing, deployment, and support of AI software components including foundation model training, LLM inference, similarity search, guardrails, evaluation, experimentation, governance, and observability.
  • •Make high-judgment build-vs-buy decisions across open source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, and PyTorch.
  • •Invent and introduce state-of-the-art LLM optimization techniques to improve scalability, cost, latency, and throughput of production AI systems.
  • •Attract and retain talent; nurture team growth through mentoring, coaching, and leading by example.

Pay and Benefits

Salary: USD 229,900 - 286,200 annually

Key Requirements

  • •Bachelor’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus 6+ years developing AI/ML algorithms or technologies, or a Master’s degree plus 4+ years.
  • •1+ year of people leadership experience.
  • •Experience managing and leading an engineering team (preferred).
  • •Deploying scalable and responsible AI solutions on cloud platforms (e.g., AWS, Google Cloud, Azure) (preferred).
  • •Develop AI/ML algorithms using Python, C++, C#, Java, or Golang (e.g., LLM inference, similarity search, vector databases, guardrails, memory) (preferred).
Experience:4+ yearsAIMLLLMCloudResponsible AILLM optimization
Education:Bachelor's in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields
Skills:MentoringCoachingLeadershipCommunicationJudgment
Tech Stack:AWS UltraclustersHuggingfaceVectorDBsNemo GuardrailsPyTorchOpen SourceAWSGoogle CloudAzurePythonC++C#JavaGolang

Eligibility

Work Authorization:Sponsorship available.

Company Brief

Discover Financial
Provides consumer banking products, credit cards, personal loans, and payment services through the Discover brand. It operates a major U.S. financial network and serves individuals and merchants with lending and digital payment solutions.
Industry: Retail Banking
Company Size: Enterprise (1,001+ employees)
Revenue: USD 10M to 25M
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Riverwoods, United States
Founded: 1985
WebsiteLinkedIn