Senior Lead AI Engineer (LLM Gateway, FM Hosting)

Discover Financial
San Jose, Cambridge, New York
Workplace: OnsiteFull timeUSD 250,800 - 286,200 annuallyFunction: Data Science & Machine LearningExperience: 4+ yearsEducation: bachelorsSkills: ["Communication","Presentation","Mentorship","Problem-solving"]

Build and deliver AI-powered systems for the Intelligent Foundations and Experiences team, partnering with engineers, research scientists, technical program managers, and product managers. Design, develop, test, deploy, and support LLM software components including foundation model training, inference, similarity search, guardrails, evaluation, experimentation, governance, and observability. Leverage Open Source and SaaS AI technologies on cloud infrastructure and drive LLM optimization to improve scalability, cost, latency, and throughput.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Discover Financial
Discover Financial
19 hours ago

Senior Lead AI Engineer (LLM Gateway, FM Hosting)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 5 hours agoStatus: Live

Job Summary

Build and deliver AI-powered systems for the Intelligent Foundations and Experiences team, partnering with engineers, research scientists, technical program managers, and product managers. Design, develop, test, deploy, and support LLM software components including foundation model training, inference, similarity search, guardrails, evaluation, experimentation, governance, and observability. Leverage Open Source and SaaS AI technologies on cloud infrastructure and drive LLM optimization to improve scalability, cost, latency, and throughput.
Location: San Jose, Cambridge, New York
Workplace: Onsite
Employment Type: Full time
Job Function: Data Science & Machine Learning
Seniority: Mid level

Key Responsibilities

  • •Partner with cross-functional teams to deliver AI-powered products that change how associates work and how customers interact with Capital One.
  • •Design, develop, test, deploy, and support AI software components such as foundation model training, LLM inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
  • •Leverage Open Source and SaaS AI technologies including AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, and PyTorch.
  • •Invent state-of-the-art LLM optimization techniques to improve scalability, cost, latency, and throughput of production AI systems.
  • •Contribute to the technical vision and long-term roadmap for foundational AI systems.

Pay and Benefits

Salary: USD 250,800 - 286,200 annually

Key Requirements

  • •Bachelor’s degree in Computer Science/AI or related fields plus at least 6 years of experience developing AI/ML algorithms or technologies, or a Master’s degree plus at least 4 years.
  • •At least 6 years of programming experience with Python, Go, Scala, or Java.
  • •Experience designing, developing, integrating, delivering, and supporting complex AI systems in production.
  • •Ability to work on LLM inference and similarity search/vector database, guardrails, and related AI system components using relevant programming languages.
  • •Strong foundation in engineering and mathematics, with ability to understand and apply AI research techniques to production systems.
Experience:4+ yearsAI/MLLLMProduction systemsCloud platforms
Education:Bachelor's in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields
Skills:CommunicationPresentationMentorshipProblem-solving
Tech Stack:PythonGoScalaJavaC++C#GolangAWSGoogle CloudAzureAWS UltraclustersHuggingfaceVectorDBsNemo GuardrailsPyTorch

Eligibility

Work Authorization:Sponsorship available.

Company Brief

Discover Financial
Provides consumer banking products, credit cards, personal loans, and payment services through the Discover brand. It operates a major U.S. financial network and serves individuals and merchants with lending and digital payment solutions.
Industry: Retail Banking
Company Size: Enterprise (1,001+ employees)
Revenue: USD 10M to 25M
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Riverwoods, United States
Founded: 1985
WebsiteLinkedIn