Senior Lead AI Engineer (FM Hosting)

Discover Financial
New York, San Francisco, San Jose
Workplace: OnsiteFull timeUSD 229,900 - 286,200 annuallyFunction: Data Science & Machine LearningExperience: 4+ yearsEducation: bachelorsSkills: ["Communication","Mentoring","Leadership","Problem-solving","Technical thinking"]

Build and deploy production AI software for foundation-model hosting and LLM-powered experiences within the Intelligent Foundations and Experiences (IFX) team. Partner with engineers, research scientists, technical program managers, and product managers to design, train, evaluate, and operate components such as large language model inference, similarity search, guardrails, experimentation, governance, and observability. Leverage AI infrastructure on cloud platforms using tools like AWS Ultraclusters, Hugging Face, VectorDBs, Nemo Guardrails, and PyTorch.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Discover Financial
Discover Financial
1 month ago

Senior Lead AI Engineer (FM Hosting)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 6 hours agoStatus: Live

Job Summary

Build and deploy production AI software for foundation-model hosting and LLM-powered experiences within the Intelligent Foundations and Experiences (IFX) team. Partner with engineers, research scientists, technical program managers, and product managers to design, train, evaluate, and operate components such as large language model inference, similarity search, guardrails, experimentation, governance, and observability. Leverage AI infrastructure on cloud platforms using tools like AWS Ultraclusters, Hugging Face, VectorDBs, Nemo Guardrails, and PyTorch.
Location: New York, San Francisco, San Jose
Workplace: Onsite
Employment Type: Full time
Job Function: Data Science & Machine Learning
Seniority: Mid level

Key Responsibilities

  • •Partner with cross-functional teams to deliver AI-powered products that change how associates work and how customers interact with Capital One.
  • •Design, develop, test, deploy, and support AI software components including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
  • •Leverage open source and SaaS AI technologies such as AWS Ultraclusters, Hugging Face, VectorDBs, Nemo Guardrails, and PyTorch.
  • •Invent and introduce state-of-the-art LLM optimization techniques to improve scalability, cost, latency, and throughput of production AI systems.
  • •Contribute to the technical vision and long-term roadmap for foundational AI systems at Capital One.

Pay and Benefits

Salary: USD 229,900 - 286,200 annually

Key Requirements

  • •Bachelor’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus 6+ years developing AI/ML algorithms or technologies, or a Master’s plus 4+ years developing AI/ML algorithms or technologies.
  • •6+ years of programming with Python, Go, Scala, or Java.
  • •7+ years of experience deploying scalable and responsible AI solutions on cloud platforms (e.g., AWS, Google Cloud, Azure).
  • •Experience designing, developing, integrating, delivering, and supporting complex AI systems.
  • •Experience developing AI/ML algorithms such as LLM inference, similarity search, and VectorDBs, including guardrails and memory, using Python, C++, C#, Java, or Golang.
Experience:4+ yearsBankingMachine learningAI
Education:Bachelor's
Skills:CommunicationMentoringLeadershipProblem-solvingTechnical thinking
Tech Stack:AWS UltraclustersHuggingfaceVectorDBsNemo GuardrailsPyTorchPythonGoScalaJavaC++C#GolangLLM inferenceSimilarity searchGuardrailsModel evaluationExperimentationGovernanceObservability

Eligibility

Work Authorization:Sponsorship available.

Company Brief

Discover Financial
Provides consumer banking products, credit cards, personal loans, and payment services through the Discover brand. It operates a major U.S. financial network and serves individuals and merchants with lending and digital payment solutions.
Industry: Retail Banking
Company Size: Enterprise (1,001+ employees)
Revenue: USD 10M to 25M
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Riverwoods, United States
Founded: 1985
WebsiteLinkedIn