Lead AI Engineer (AI Foundations, LLM Core and Agentic AI)

Discover Financial
New York, San Francisco, Cambridge, Virginia, San Jose
Full timeUSD 215,200 - 245,600 annuallyFunction: Data Science & Machine LearningExperience: 4+ yearsEducation: bachelorsSkills: ["Clarity","Problem-solving","Communication","Adaptability","Resilience"]

Build and deploy responsible AI software components for foundation model training, LLM inference, similarity search, guardrails, evaluation, experimentation, governance, and observability. Partner with engineers, research scientists, TPMs, and product managers to deliver AI-powered products that improve associate workflows and customer experiences. Optimize LLM training and inference for scalability, cost, latency, and throughput while advancing the long-term roadmap for foundational AI systems.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Discover Financial
Discover Financial
1 month ago

Lead AI Engineer (AI Foundations, LLM Core and Agentic AI)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 2 hours agoStatus: Live

Job Summary

Build and deploy responsible AI software components for foundation model training, LLM inference, similarity search, guardrails, evaluation, experimentation, governance, and observability. Partner with engineers, research scientists, TPMs, and product managers to deliver AI-powered products that improve associate workflows and customer experiences. Optimize LLM training and inference for scalability, cost, latency, and throughput while advancing the long-term roadmap for foundational AI systems.
Location: New York, San Francisco, Cambridge, Virginia, San Jose
Employment Type: Full time
Job Function: Data Science & Machine Learning
Seniority: Mid level

Key Responsibilities

  • •Partner with cross-functional teams to deliver AI-powered products that change how associates work and how customers interact.
  • •Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, similarity search, guardrails, evaluation, experimentation, governance, and observability.
  • •Use Open Source and SaaS AI technologies (e.g., AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch) to build and operate solutions.
  • •Invent and introduce LLM optimization techniques to improve scalability, cost, latency, and throughput for production AI systems.
  • •Contribute to the technical vision and long-term roadmap for foundational AI systems.

Pay and Benefits

Salary: USD 215,200 - 245,600 annually

Key Requirements

  • •Bachelor's degree in Computer Science/AI/Electrical or Computer Engineering (or related) plus 4+ years developing AI/ML algorithms or technologies, or a Master's plus 2+ years developing AI/ML algorithms or technologies.
  • •4+ years programming with Python, Go, Scala, or Java.
  • •Experience deploying scalable and responsible AI solutions on cloud platforms (e.g., AWS, Google Cloud, Azure).
  • •Experience designing, developing, delivering, and supporting AI services.
  • •Experience developing and applying state-of-the-art techniques for optimizing training and inference to improve hardware utilization, latency, throughput, and cost.
Experience:4+ yearsAI/ML algorithmsCloud platformsLLM inferenceScalable AI
Education:Bachelor's in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields
Skills:ClarityProblem-solvingCommunicationAdaptabilityResilience
Tech Stack:AWS UltraclustersHuggingfaceVectorDBsNemo GuardrailsPyTorchPythonGoScalaJavaC++C#GolangLarge language model inferenceSimilarity searchGuardrailsModel evaluationExperimentationGovernanceObservability

Eligibility

Work Authorization:Authorization required. Sponsorship not provided.

Company Brief

Discover Financial
Provides consumer banking products, credit cards, personal loans, and payment services through the Discover brand. It operates a major U.S. financial network and serves individuals and merchants with lending and digital payment solutions.
Industry: Retail Banking
Company Size: Enterprise (1,001+ employees)
Revenue: USD 10M to 25M
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Riverwoods, United States
Founded: 1985
WebsiteLinkedIn