AI Engineer 5 (AI Foundations, LLM Core and Agentic AI)

Discover Financial
Cambridge, New York, San Jose
Full timeUSD 229,900 - 262,400 annuallyFunction: Data Science & Machine LearningExperience: 4+ yearsEducation: bachelorsSkills: ["Collaboration","Communication","Mentorship","Problem-solving","Technical leadership"]

Build and deploy foundational AI capabilities for responsible, scalable banking use cases. You’ll design and optimize LLM inference and agentic/multi-agent workflows, similarity search, guardrails, evaluation, governance, and observability. Collaborate with engineers, research scientists, TPs, and product managers to integrate LLMs with vector search and domain models, improve performance (latency/cost/throughput), and lead technical reviews and governance across production AI systems.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Discover Financial
Discover Financial
4 hours ago

AI Engineer 5 (AI Foundations, LLM Core and Agentic AI)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 4 hours agoStatus: Live
Reposted: similar role first listed 3 days ago

Job Summary

Build and deploy foundational AI capabilities for responsible, scalable banking use cases. You’ll design and optimize LLM inference and agentic/multi-agent workflows, similarity search, guardrails, evaluation, governance, and observability. Collaborate with engineers, research scientists, TPs, and product managers to integrate LLMs with vector search and domain models, improve performance (latency/cost/throughput), and lead technical reviews and governance across production AI systems.
Location: Cambridge, New York, San Jose
Employment Type: Full time
Job Function: Data Science & Machine Learning
Seniority: Mid level

Key Responsibilities

  • •Partner cross-functionally to deliver AI-powered products that improve how associates work and how customers interact with Capital One.
  • •Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, agents/multi-agent workflows, similarity search, guardrails, evaluation, experimentation, governance, and observability.
  • •Use open source and SaaS AI technologies (e.g., AWS Ultraclusters, Huggingface, VectorDBs, PyTorch) to build production AI systems.
  • •Optimize foundation model performance (scalability, cost, latency, throughput) and build multi-model orchestration pipelines integrating LLMs, vector search, and domain-specific models.
  • •Lead cost-performance governance reviews and technical design councils/boards; mentor Principal and Manager-level AI engineers.

Pay and Benefits

Salary: USD 229,900 - 262,400 annually

Key Requirements

  • •Bachelor’s degree in Computer Science/AI/Electrical/Computer Engineering or related fields with at least 6 years developing AI/ML algorithms/technologies, or a Master’s degree with at least 4 years.
  • •At least 6 years programming with Python, Go, Scala, CUDA, or Java.
  • •Experience leading development of AI systems with tradeoffs around cost, latency, throughput, and accuracy.
  • •Experience deploying scalable, responsible AI solutions on cloud platforms such as AWS, Google Cloud, or Azure.
  • •Experience designing, developing, delivering, and supporting complex AI systems (e.g., LLM inference, similarity search, vector databases, guardrails, memory).
Experience:4+ years
Education:Bachelor's
Skills:CollaborationCommunicationMentorshipProblem-solvingTechnical leadership
Tech Stack:AWSAWS UltraclustersHuggingfaceVectorDBsPyTorchPythonGoScalaCUDAJavaC++C#GolangGoogle CloudAzure

Eligibility

Work Authorization:Sponsorship available.

Company Brief

Discover Financial
Provides consumer banking products, credit cards, personal loans, and payment services through the Discover brand. It operates a major U.S. financial network and serves individuals and merchants with lending and digital payment solutions.
Industry: Retail Banking
Company Size: Enterprise (1,001+ employees)
Revenue: USD 10M to 25M
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Riverwoods, United States
Founded: 1985
WebsiteLinkedIn