Senior Lead AI Engineer (AI Foundations, LLM Core and Agentic AI)

Discover Financial
Cambridge, New York, San Francisco, San Jose
Workplace: OnsiteFull timeFunction: Data Science & Machine LearningExperience: 6+ yearsEducation: bachelorsSkills: ["Communication","Technical leadership","Mentorship","Problem-solving","Research-minded"]

Build and deliver foundation-model and LLM infrastructure powering responsible, scalable AI experiences for a major banking organization. You’ll design, train, evaluate, and deploy AI software components (including inference, similarity search, guardrails, and observability), collaborate with research scientists and product teams, and optimize LLM performance across cost, latency, and throughput using modern cloud and open-source AI technologies.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Discover Financial
Discover Financial
1 month ago

Senior Lead AI Engineer (AI Foundations, LLM Core and Agentic AI)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 6 hours agoStatus: Live

Job Summary

Build and deliver foundation-model and LLM infrastructure powering responsible, scalable AI experiences for a major banking organization. You’ll design, train, evaluate, and deploy AI software components (including inference, similarity search, guardrails, and observability), collaborate with research scientists and product teams, and optimize LLM performance across cost, latency, and throughput using modern cloud and open-source AI technologies.
Location: Cambridge, New York, San Francisco, San Jose
Workplace: Onsite
Employment Type: Full time
Job Function: Data Science & Machine Learning
Seniority: Mid level

Key Responsibilities

  • •Partner with cross-functional teams to deliver AI-powered products and improve how associates and customers interact with the company.
  • •Design, develop, test, deploy, and support AI components including foundation model training, LLM inference, similarity search, guardrails, evaluation, experimentation, governance, and observability.
  • •Leverage open-source and SaaS AI technologies (e.g., AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch) to build and run AI systems.
  • •Develop and introduce state-of-the-art LLM optimization techniques to improve scalability, cost, latency, and throughput in production systems.
  • •Contribute to the technical vision and long-term roadmap for foundational AI systems.

Key Requirements

  • •Bachelor’s degree (or Master’s degree) in Computer Science/AI/Electrical or Computer Engineering plus 6+ (or 4+) years developing AI and ML algorithms or technologies.
  • •6+ years programming with Python, Go, Scala, or Java.
  • •7 years deploying scalable and responsible AI solutions on cloud platforms such as AWS, Google Cloud, Azure, or equivalent private cloud.
  • •Ability to design, develop, integrate, deliver, and support complex AI systems.
  • •Experience developing AI/ML or LLM-related capabilities (e.g., LLM inference, similarity search, vector databases, guardrails, memory) using Python, C++, C#, Java, or Golang.
Experience:6+ yearsFintechMachine learningLLMsCloudOpen source
Education:Bachelor's
Skills:CommunicationTechnical leadershipMentorshipProblem-solvingResearch-minded
Tech Stack:AWSGoogle CloudAzureHuggingfaceVectorDBsNemo GuardrailsPyTorchPythonGoScalaJavaC++C#Golang

Eligibility

Work Authorization:Sponsorship available.

Company Brief

Discover Financial
Provides consumer banking products, credit cards, personal loans, and payment services through the Discover brand. It operates a major U.S. financial network and serves individuals and merchants with lending and digital payment solutions.
Industry: Retail Banking
Company Size: Enterprise (1,001+ employees)
Revenue: USD 10M to 25M
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Riverwoods, United States
Founded: 1985
WebsiteLinkedIn