Lead AI Engineer (AI Foundations, LLM Core and Agentic AI)

Discover Financial
Cambridge, New York, San Jose
Workplace: OnsiteFull timeUSD 215,200 - 245,600 annuallyFunction: Data Science & Machine LearningExperience: 4+ yearsEducation: bachelorsSkills: ["Communication","Problem-solving","Adaptability","Technical curiosity","Ownership"]

Build and deliver AI-powered products with a focus on foundational model training and LLM inference, similarity search, guardrails, evaluation, experimentation, governance, and observability. Collaborate with engineers, research scientists, technical program managers, and product managers to design, develop, deploy, and support AI software components. Use and extend open source and SaaS AI technologies (e.g., AWS Ultraclusters, Hugging Face, vector databases, Nemo Guardrails, PyTorch) while inventing LLM optimization techniques to improve scalability, cost, latency, and throughput.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Discover Financial
Discover Financial
1 month ago

Lead AI Engineer (AI Foundations, LLM Core and Agentic AI)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 6 hours agoStatus: Live

Job Summary

Build and deliver AI-powered products with a focus on foundational model training and LLM inference, similarity search, guardrails, evaluation, experimentation, governance, and observability. Collaborate with engineers, research scientists, technical program managers, and product managers to design, develop, deploy, and support AI software components. Use and extend open source and SaaS AI technologies (e.g., AWS Ultraclusters, Hugging Face, vector databases, Nemo Guardrails, PyTorch) while inventing LLM optimization techniques to improve scalability, cost, latency, and throughput.
Location: Cambridge, New York, San Jose
Workplace: Onsite
Employment Type: Full time
Job Function: Data Science & Machine Learning
Seniority: Mid level

Key Responsibilities

  • •Partner with cross-functional teams to deliver AI-powered products that change how associates work and how customers interact with Capital One.
  • •Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
  • •Leverage and integrate open source and SaaS AI technologies such as AWS Ultraclusters, Hugging Face, VectorDBs, Nemo Guardrails, and PyTorch.
  • •Invent and introduce state-of-the-art LLM optimization techniques to improve scalability, cost, latency, and throughput for production AI systems.
  • •Contribute to the technical vision and long-term roadmap for foundational AI systems.

Pay and Benefits

Salary: USD 215,200 - 245,600 annually

Key Requirements

  • •Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 4 years of experience developing AI/ML algorithms or technologies, or a Master's with at least 2 years.
  • •At least 4 years of experience programming with Python, Go, Scala, or Java.
  • •Passion for staying abreast of the latest research and applying novel techniques to production systems.
  • •Strong engineering and mathematics foundation, with ability to identify and exploit optimization opportunities across hardware, software, and AI.
  • •Ability to adapt to ambiguous problems, ask questions, and communicate findings clearly.
Experience:4+ yearsLLM
Education:Bachelor's in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields
Skills:CommunicationProblem-solvingAdaptabilityTechnical curiosityOwnership
Tech Stack:AIMLLLM inferenceSimilarity searchVector databasesAWS UltraclustersHuggingfaceVectorDBsNemo GuardrailsPyTorchPythonGoScalaJavaC++C#GolangAWSGoogle CloudAzure

Eligibility

Work Authorization:Sponsorship available.

Company Brief

Discover Financial
Provides consumer banking products, credit cards, personal loans, and payment services through the Discover brand. It operates a major U.S. financial network and serves individuals and merchants with lending and digital payment solutions.
Industry: Retail Banking
Company Size: Enterprise (1,001+ employees)
Revenue: USD 10M to 25M
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Riverwoods, United States
Founded: 1985
WebsiteLinkedIn