Sr. Lead AI Engineer (Gen AI Platform Services)

Discover Financial
Cambridge, New York, San Jose
Full timeUSD 250,800 - 286,200 annuallyFunction: Data Science & Machine LearningExperience: 4+ yearsEducation: bachelorsSkills: ["Communication","Presentation","Mentoring","Cross-functional collaboration","Problem-solving"]

Build and run responsible, scalable GenAI platform components that power foundation model training, LLM inference, similarity search, guardrails, evaluation, experimentation, governance, and observability. Partner with engineers, research scientists, TPMs, and product managers to deliver AI-powered products and long-term roadmap capabilities. Apply LLM optimization techniques to improve scalability, cost, latency, and throughput using an ecosystem of open-source and SaaS AI tools on cloud infrastructure.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Discover Financial
Discover Financial
1 month ago

Sr. Lead AI Engineer (Gen AI Platform Services)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 6 hours agoStatus: Live

Job Summary

Build and run responsible, scalable GenAI platform components that power foundation model training, LLM inference, similarity search, guardrails, evaluation, experimentation, governance, and observability. Partner with engineers, research scientists, TPMs, and product managers to deliver AI-powered products and long-term roadmap capabilities. Apply LLM optimization techniques to improve scalability, cost, latency, and throughput using an ecosystem of open-source and SaaS AI tools on cloud infrastructure.
Location: Cambridge, New York, San Jose
Employment Type: Full time
Job Function: Data Science & Machine Learning
Seniority: Sr. Manager level

Key Responsibilities

  • •Partner with cross-functional teams to deliver AI-powered products that improve how associates work and how customers interact.
  • •Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
  • •Use open-source and SaaS AI technologies (e.g., AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails) to build platform capabilities.
  • •Invent and apply state-of-the-art LLM optimization techniques to improve scalability, cost, latency, and throughput in production systems.
  • •Contribute to the technical vision and long-term roadmap for foundational AI systems at Capital One.

Pay and Benefits

Salary: USD 250,800 - 286,200 annually

Key Requirements

  • •Bachelor’s degree (Computer Science/AI/Electrical or Computer Engineering or related) plus 6+ years developing AI/ML algorithms or technologies, or a Master’s plus 4+ years.
  • •6+ years programming with Python, Go, Scala, or Java.
  • •Experience deploying scalable, responsible AI solutions on cloud platforms (e.g., AWS, Google Cloud, Azure).
  • •Experience designing, developing, integrating, delivering, and supporting complex AI systems.
  • •Ability to lead and mentor an engineering team and influence cross-functional stakeholders.
Experience:4+ yearsMachine learningAILLMCloud
Education:Bachelor's in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields
Skills:CommunicationPresentationMentoringCross-functional collaborationProblem-solving
Tech Stack:AWS UltraclustersHuggingfaceVectorDBsNemo GuardrailsPyTorchPythonGoScalaJavaC++C#Golang

Eligibility

Work Authorization:Sponsorship available.

Company Brief

Discover Financial
Provides consumer banking products, credit cards, personal loans, and payment services through the Discover brand. It operates a major U.S. financial network and serves individuals and merchants with lending and digital payment solutions.
Industry: Retail Banking
Company Size: Enterprise (1,001+ employees)
Revenue: USD 10M to 25M
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Riverwoods, United States
Founded: 1985
WebsiteLinkedIn