Senior Lead AI Engineer (AI Foundations, LLM Core and Agentic AI)

Discover Financial
Cambridge, New York, San Jose
Workplace: OnsiteFull timeUSD 229,900 - 286,200 annuallyFunction: Data Science & Machine LearningExperience: 4+ yearsEducation: bachelorsSkills: ["Collaborating cross-functionally","Strong engineering and technical depth","Staying abreast of research","Asking deep questions","Communicating complex concepts"]

Build and support AI foundation systems that power large language model inference, similarity search, guardrails, evaluation, experimentation, governance, and observability. Partner with engineers, research scientists, TPMs, and product managers to deliver AI-powered experiences for associates and customers. Leverage open-source and SaaS tooling across scalable cloud infrastructure, while inventing new LLM optimization techniques to improve scalability, cost, latency, and throughput, and shape the long-term roadmap.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Discover Financial
Discover Financial
1 month ago

Senior Lead AI Engineer (AI Foundations, LLM Core and Agentic AI)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 6 hours agoStatus: Live

Job Summary

Build and support AI foundation systems that power large language model inference, similarity search, guardrails, evaluation, experimentation, governance, and observability. Partner with engineers, research scientists, TPMs, and product managers to deliver AI-powered experiences for associates and customers. Leverage open-source and SaaS tooling across scalable cloud infrastructure, while inventing new LLM optimization techniques to improve scalability, cost, latency, and throughput, and shape the long-term roadmap.
Location: Cambridge, New York, San Jose
Workplace: Onsite
Employment Type: Full time
Job Function: Data Science & Machine Learning
Seniority: Mid level

Key Responsibilities

  • •Partner with a cross-functional team to deliver AI-powered products for associates and customers.
  • •Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, similarity search, guardrails, evaluation, experimentation, governance, and observability.
  • •Use open-source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, and PyTorch.
  • •Invent state-of-the-art LLM optimization techniques to improve performance (scalability, cost, latency, throughput) for production AI systems.
  • •Contribute to the technical vision and long-term roadmap of foundational AI systems.

Pay and Benefits

Salary: USD 229,900 - 286,200 annually

Key Requirements

  • •Bachelor’s degree (or Master’s) in Computer Science/AI/Electrical Engineering/Computer Engineering (or related) plus at least 6 years (or 4 years with a Master’s) developing AI/ML algorithms or technologies.
  • •At least 6 years programming with Python, Go, Scala, or Java.
  • •Design, develop, test, deploy, and support AI software components including foundation model training and LLM inference.
  • •Leverage a broad stack of open-source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, and PyTorch.
  • •Introduce state-of-the-art LLM optimization techniques to improve scalability, cost, latency, and throughput of large-scale production AI systems.
Experience:4+ yearsAIMachine learningLLMsCloud
Education:Bachelor's
Skills:Collaborating cross-functionallyStrong engineering and technical depthStaying abreast of researchAsking deep questionsCommunicating complex concepts
Tech Stack:AWS UltraclustersHuggingfaceVectorDBsNemo GuardrailsPyTorchPythonGoScalaJavaC++C#GolangLLM inferenceSimilarity searchGuardrailsObservabilityModel evaluationExperimentationGovernance

Eligibility

Work Authorization:Authorization required. Sponsorship not provided.

Company Brief

Discover Financial
Provides consumer banking products, credit cards, personal loans, and payment services through the Discover brand. It operates a major U.S. financial network and serves individuals and merchants with lending and digital payment solutions.
Industry: Retail Banking
Company Size: Enterprise (1,001+ employees)
Revenue: USD 10M to 25M
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Riverwoods, United States
Founded: 1985
WebsiteLinkedIn