Senior Lead AI Engineer (FM Hosting, LLM Inference)

Discover Financial
Cambridge, New York, San Jose
Full timeUSD 229,900 - 286,200 annuallyFunction: Data Science & Machine LearningExperience: 6+ yearsEducation: bachelorsSkills: ["Communication","Presentation","Mentoring"]

Build and deliver AI-powered products within the Intelligent Foundations and Experiences (IFX) team, designing, developing, and deploying LLM inference and foundation-model components. Partner across engineering, research, program management, and product to create reliable, scalable AI systems with guardrails, evaluation, experimentation, governance, and observability. Use open-source and SaaS AI infrastructure (including AWS Ultraclusters and Hugging Face) to optimize latency, throughput, cost, and hardware utilization in production.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Discover Financial
Discover Financial
1 month ago

Senior Lead AI Engineer (FM Hosting, LLM Inference)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 6 hours agoStatus: Live

Job Summary

Build and deliver AI-powered products within the Intelligent Foundations and Experiences (IFX) team, designing, developing, and deploying LLM inference and foundation-model components. Partner across engineering, research, program management, and product to create reliable, scalable AI systems with guardrails, evaluation, experimentation, governance, and observability. Use open-source and SaaS AI infrastructure (including AWS Ultraclusters and Hugging Face) to optimize latency, throughput, cost, and hardware utilization in production.
Location: Cambridge, New York, San Jose
Employment Type: Full time
Job Function: Data Science & Machine Learning
Seniority: Mid level

Key Responsibilities

  • •Partner cross-functionally to deliver AI-powered products that change how associates work and how customers interact with Capital One.
  • •Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
  • •Leverage open-source and SaaS AI technologies (e.g., AWS Ultraclusters, Hugging Face, VectorDBs, Nemo Guardrails, PyTorch) to build production AI systems.
  • •Invent and apply state-of-the-art LLM optimization techniques to improve scalability, cost, latency, and throughput in production.
  • •Contribute to the technical vision and long-term roadmap for foundational AI systems.

Pay and Benefits

Salary: USD 229,900 - 286,200 annually

Key Requirements

  • •Bachelor’s degree in Computer Science/AI/Engineering (or related) plus 6+ years developing AI/ML algorithms or technologies, or a Master’s degree plus 4+ years.
  • •6+ years programming with Python, Go, Scala, or Java.
  • •7+ years deploying scalable and responsible AI solutions on cloud platforms (e.g., AWS, Google Cloud, Azure).
  • •Experience designing, developing, integrating, delivering, and supporting complex AI systems.
  • •Experience developing AI/ML (e.g., LLM inference, similarity search, VectorDBs, guardrails, memory) using Python, C++, C#, Java, or Golang.
Experience:6+ yearsAIMachine learningCloudLLM inference
Education:Bachelor's
Skills:CommunicationPresentationMentoring
Tech Stack:AWSGoogle CloudAzureAWS UltraclustersHuggingfaceVectorDBsNemo GuardrailsPyTorchPythonGoScalaJavaC++C#GolangLarge language model inferenceSimilarity searchGuardrailsModel evaluationExperimentation

Eligibility

Work Authorization:Sponsorship available.

Company Brief

Discover Financial
Provides consumer banking products, credit cards, personal loans, and payment services through the Discover brand. It operates a major U.S. financial network and serves individuals and merchants with lending and digital payment solutions.
Industry: Retail Banking
Company Size: Enterprise (1,001+ employees)
Revenue: USD 10M to 25M
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Riverwoods, United States
Founded: 1985
WebsiteLinkedIn