Lead AI Engineer (Gen AI Platform Services: Agentic AI, Agent Guardrails, Agent Evaluation, Agent Memory)

Discover Financial
San Francisco, Cambridge, New York, San Jose
Full timeUSD 215,200 - 245,600 annuallyFunction: Data Science & Machine LearningExperience: 4+ yearsEducation: bachelorsSkills: ["Communication","Problem-solving","Collaboration","Innovation","Adaptability"]

Build and deliver responsible, production-grade AI platform services for agentic AI, including model training, LLM inference, similarity search, guardrails, evaluation, experimentation, governance, and observability. Partner with engineers, research scientists, technical program managers, and product managers to ship AI-powered capabilities at scale. Use tools and frameworks such as AWS Ultraclusters, Hugging Face, VectorDBs, Nemo Guardrails, and PyTorch, and drive LLM optimization for cost, latency, scalability, and throughput.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Discover Financial
Discover Financial
3 days ago

Lead AI Engineer (Gen AI Platform Services: Agentic AI, Agent Guardrails, Agent Evaluation, Agent Memory)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 6 hours agoStatus: Live

Job Summary

Build and deliver responsible, production-grade AI platform services for agentic AI, including model training, LLM inference, similarity search, guardrails, evaluation, experimentation, governance, and observability. Partner with engineers, research scientists, technical program managers, and product managers to ship AI-powered capabilities at scale. Use tools and frameworks such as AWS Ultraclusters, Hugging Face, VectorDBs, Nemo Guardrails, and PyTorch, and drive LLM optimization for cost, latency, scalability, and throughput.
Location: San Francisco, Cambridge, New York, San Jose
Employment Type: Full time
Job Function: Data Science & Machine Learning
Seniority: Mid level

Key Responsibilities

  • •Partner with cross-functional teams to deliver AI-powered products that change how associates work and how customers interact.
  • •Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, similarity search, guardrails, evaluation, experimentation, governance, and observability.
  • •Leverage Open Source and SaaS AI technologies such as AWS Ultraclusters, Hugging Face, VectorDBs, Nemo Guardrails, and PyTorch.
  • •Invent and apply state-of-the-art LLM optimization techniques to improve scalability, cost, latency, and throughput of production AI systems.
  • •Contribute to the technical vision and long-term roadmap for foundational AI systems at Capital One.

Pay and Benefits

Salary: USD 215,200 - 245,600 annually

Key Requirements

  • •Bachelor's degree in Computer Science/AI/Electrical Engineering/Computer Engineering (or related) plus at least 4 years developing AI/ML algorithms or technologies, or a Master's plus at least 2 years developing AI/ML algorithms or technologies.
  • •At least 4 years of experience programming with Python, Go, Scala, or Java.
  • •Experience deploying scalable and responsible AI solutions on cloud platforms (e.g., AWS, Google Cloud, Azure or equivalent private cloud).
  • •Experience designing, developing, delivering, and supporting AI services.
  • •Experience developing AI/ML algorithms and technologies such as LLM inference, similarity search and VectorDBs, guardrails, and memory using Python, C++, C#, Java, or Golang.
Experience:4+ yearsFinancial servicesArtificial intelligenceMachine learningCloud computingLLMOpen source
Education:Bachelor's in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields
Skills:CommunicationProblem-solvingCollaborationInnovationAdaptability
Tech Stack:AWS UltraclustersHuggingfaceVectorDBsNemo GuardrailsPyTorchOpen SourceSaaSPythonGoScalaJavaC++C#GolangAWSGoogle CloudAzure

Eligibility

Work Authorization:Sponsorship available.

Company Brief

Discover Financial
Provides consumer banking products, credit cards, personal loans, and payment services through the Discover brand. It operates a major U.S. financial network and serves individuals and merchants with lending and digital payment solutions.
Industry: Retail Banking
Company Size: Enterprise (1,001+ employees)
Revenue: USD 10M to 25M
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Riverwoods, United States
Founded: 1985
WebsiteLinkedIn