Lead AI Engineer (AI Foundations, LLM Core and Agentic AI)

Discover Financial
Cambridge, New York, San Francisco, San Jose
Workplace: OnsiteFull timeUSD 197,300 - 245,600 annuallyFunction: Data Science & Machine LearningExperience: 4+ yearsEducation: bachelorsSkills: ["Cross-functional collaboration","Problem-solving","Quality-focused","Technical judgment","Communication"]

Build and deploy AI foundation components for responsible, scalable banking use cases within the Intelligent Foundations and Experiences team. Partner with engineers, research scientists, TPMs, and PMs to deliver LLM inference, similarity search, guardrails, evaluation, experimentation, governance, and observability. Work with AWS Ultraclusters, Hugging Face, VectorDBs, Nemo Guardrails, and PyTorch, invent LLM optimization techniques to improve cost, latency, and throughput, and shape the long-term roadmap.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Discover Financial
Discover Financial
1 month ago

Lead AI Engineer (AI Foundations, LLM Core and Agentic AI)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 6 hours agoStatus: Live

Job Summary

Build and deploy AI foundation components for responsible, scalable banking use cases within the Intelligent Foundations and Experiences team. Partner with engineers, research scientists, TPMs, and PMs to deliver LLM inference, similarity search, guardrails, evaluation, experimentation, governance, and observability. Work with AWS Ultraclusters, Hugging Face, VectorDBs, Nemo Guardrails, and PyTorch, invent LLM optimization techniques to improve cost, latency, and throughput, and shape the long-term roadmap.
Location: Cambridge, New York, San Francisco, San Jose
Workplace: Onsite
Employment Type: Full time
Job Function: Data Science & Machine Learning
Seniority: Sr. Manager level

Key Responsibilities

  • •Partner with a cross-functional team of engineers, research scientists, technical program managers, and product managers to deliver AI-powered products.
  • •Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, similarity search, guardrails, evaluation, experimentation, governance, and observability.
  • •Leverage open source and SaaS AI technologies such as AWS Ultraclusters, Hugging Face, VectorDBs, Nemo Guardrails, and PyTorch.
  • •Invent and introduce state-of-the-art LLM optimization techniques to improve scalability, cost, latency, and throughput.
  • •Contribute to the technical vision and long-term roadmap of foundational AI systems at Capital One.

Pay and Benefits

Salary: USD 197,300 - 245,600 annually

Key Requirements

  • •Bachelor’s degree in Computer Science/AI/Electrical Engineering/Computer Engineering (or related) plus at least 4 years developing AI/ML algorithms or technologies, or a Master’s plus at least 2 years.
  • •At least 4 years of programming experience with Python, Go, Scala, or Java.
  • •At least 6 years deploying scalable and responsible AI solutions on cloud platforms such as AWS, Google Cloud, Azure, or equivalent private cloud.
  • •Experience designing, developing, delivering, and supporting AI services.
  • •Experience applying state-of-the-art techniques to optimize training and inference for latency, throughput, and cost.
Experience:4+ yearsAI/MLLLMCloudOpen source
Education:Bachelor's in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields
Skills:Cross-functional collaborationProblem-solvingQuality-focusedTechnical judgmentCommunication
Tech Stack:AWS UltraclustersHuggingfaceVectorDBsNemo GuardrailsPyTorchFoundation model trainingLarge language model inferenceSimilarity searchGuardrailsModel evaluationExperimentationGovernanceObservabilityPythonGoScalaJavaC++C#Golang

Eligibility

Work Authorization:Sponsorship available.

Company Brief

Discover Financial
Provides consumer banking products, credit cards, personal loans, and payment services through the Discover brand. It operates a major U.S. financial network and serves individuals and merchants with lending and digital payment solutions.
Industry: Retail Banking
Company Size: Enterprise (1,001+ employees)
Revenue: USD 10M to 25M
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Riverwoods, United States
Founded: 1985
WebsiteLinkedIn