Senior Lead AI Engineer (AI Foundations, LLM Core and Agentic AI)

Discover Financial
Cambridge, New York, San Francisco, San Jose
Full timeUSD 229,900 - 286,200 annuallyFunction: Data Science & Machine LearningExperience: 6+ yearsEducation: bachelorsSkills: ["Communication","Presentation","Problem-solving","Leadership","Mentorship"]

Build responsible, reliable AI systems that power foundation-model capabilities across Capital One’s Intelligent Foundations and Experiences team. You’ll design, develop, test, deploy, and support LLM inference and training components, similarity search, guardrails, evaluation, experimentation, governance, and observability. Leverage AWS and open-source/saaS AI technologies (e.g., Huggingface, VectorDBs, Nemo Guardrails, PyTorch) and invent optimization techniques to improve scalability, cost, latency, and throughput.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Discover Financial
Discover Financial
1 month ago

Senior Lead AI Engineer (AI Foundations, LLM Core and Agentic AI)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 6 hours agoStatus: Live

Job Summary

Build responsible, reliable AI systems that power foundation-model capabilities across Capital One’s Intelligent Foundations and Experiences team. You’ll design, develop, test, deploy, and support LLM inference and training components, similarity search, guardrails, evaluation, experimentation, governance, and observability. Leverage AWS and open-source/saaS AI technologies (e.g., Huggingface, VectorDBs, Nemo Guardrails, PyTorch) and invent optimization techniques to improve scalability, cost, latency, and throughput.
Location: Cambridge, New York, San Francisco, San Jose
Employment Type: Full time
Job Function: Data Science & Machine Learning
Seniority: Mid level

Key Responsibilities

  • •Partner with cross-functional engineering, research, technical program, and product teams to deliver AI-powered products.
  • •Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
  • •Leverage open-source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, and PyTorch.
  • •Invent state-of-the-art LLM optimization techniques to improve performance (scalability, cost, latency, throughput) for large-scale production AI systems.
  • •Contribute to the technical vision and long-term roadmap for foundational AI systems.

Pay and Benefits

Salary: USD 229,900 - 286,200 annually

Key Requirements

  • •Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a related field plus 6+ years developing AI and ML algorithms or technologies, or a Master's plus 4+ years.
  • •6+ years programming with Python, Go, Scala, or Java.
  • •Experience developing, integrating, and delivering complex AI systems in production.
  • •Strong foundation in engineering and mathematics, with ability to identify optimization opportunities across hardware, software, and AI.
  • •Experience deploying scalable and responsible AI solutions on cloud platforms (e.g., AWS, Google Cloud, Azure or equivalent).
Experience:6+ yearsAIMachine learningLLMCloudProduction AI
Education:Bachelor's
Skills:CommunicationPresentationProblem-solvingLeadershipMentorship
Tech Stack:PythonGoScalaJavaC++C#GolangAWSGoogle CloudAzureHuggingfaceVectorDBsNemo GuardrailsPyTorchLLM inferenceSimilarity searchGuardrailsObservabilityExperimentationGovernance

Eligibility

Work Authorization:Sponsorship available.

Company Brief

Discover Financial
Provides consumer banking products, credit cards, personal loans, and payment services through the Discover brand. It operates a major U.S. financial network and serves individuals and merchants with lending and digital payment solutions.
Industry: Retail Banking
Company Size: Enterprise (1,001+ employees)
Revenue: USD 10M to 25M
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Riverwoods, United States
Founded: 1985
WebsiteLinkedIn