AI Engineer 5 ((AI Foundations, LLM Core and Agentic AI)

Discover Financial
New York, San Francisco, Virginia, Cambridge, San Jose
Workplace: OnsiteFull timeUSD 250,800 - 286,200 annuallyFunction: Data Science & Machine LearningExperience: 6+ yearsEducation: bachelorsSkills: ["Communication","Mentorship","Presentation","Problem-solving","Governance"]

Build responsible, reliable AI systems at the center of Capital One’s Intelligent Foundations and Experiences team. You’ll design, develop, test, deploy, and support AI components spanning foundation model training, LLM inference, agentic workflows, vector search, guardrails, evaluation, and observability. Partner across engineers, research scientists, TPMs, and product managers, and optimize foundation model performance across scalability, cost, latency, and throughput using cloud AI technologies and governance practices.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Discover Financial
Discover Financial
5 hours ago

AI Engineer 5 ((AI Foundations, LLM Core and Agentic AI)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 5 hours agoStatus: Live

Job Summary

Build responsible, reliable AI systems at the center of Capital One’s Intelligent Foundations and Experiences team. You’ll design, develop, test, deploy, and support AI components spanning foundation model training, LLM inference, agentic workflows, vector search, guardrails, evaluation, and observability. Partner across engineers, research scientists, TPMs, and product managers, and optimize foundation model performance across scalability, cost, latency, and throughput using cloud AI technologies and governance practices.
Location: New York, San Francisco, Virginia, Cambridge, San Jose
Workplace: Onsite
Employment Type: Full time
Job Function: Data Science & Machine Learning
Seniority: Mid level

Key Responsibilities

  • •Partner with cross-functional teams to deliver AI-powered products that change how associates work and how customers interact.
  • •Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, agentic workflows, vector search, guardrails, evaluation, experimentation, governance, and observability.
  • •Leverage open source and SaaS AI technologies (e.g., AWS Ultraclusters, Huggingface, VectorDBs, PyTorch) to build production AI systems.
  • •Invent foundation model optimization techniques and implement multi-model orchestration pipelines integrating LLMs, vector search, and domain-specific models.
  • •Establish and lead cost-performance governance reviews (GPU utilization, throughput, inference cost efficiency) and mentor AI engineers.
  • •Lead team design councils or design review boards to ensure technical consistency and compliance with AI engineering standards.

Pay and Benefits

Salary: USD 250,800 - 286,200 annually

Key Requirements

  • •Bachelor’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 6 years of AI/ML algorithm or technology development, or a Master’s degree plus at least 4 years.
  • •At least 6 years of experience programming with Python, Go, Scala, CUDA, or Java.
  • •Experience leading development of AI systems with tradeoff decisions around cost, latency, throughput, and accuracy.
  • •7 years of experience deploying scalable and responsible AI solutions on cloud platforms (e.g., AWS, Google Cloud, Azure).
  • •Experience developing AI and ML systems such as LLM inference, similarity search, and vector databases using Python, C++, C#, Java, CUDA, or Golang.
Experience:6+ yearsAIMachine learningLLMCloud
Education:Bachelor's
Skills:CommunicationMentorshipPresentationProblem-solvingGovernance
Tech Stack:AIMachine learningLLMLarge language model inferenceAgentsMulti-agent workflowsSimilarity searchVector searchGuardrailsModel evaluationExperimentationGovernanceObservabilityAWS UltraclustersHuggingfaceVectorDBsPyTorchPythonGoScala

Eligibility

Work Authorization:Sponsorship available.

Company Brief

Discover Financial
Provides consumer banking products, credit cards, personal loans, and payment services through the Discover brand. It operates a major U.S. financial network and serves individuals and merchants with lending and digital payment solutions.
Industry: Retail Banking
Company Size: Enterprise (1,001+ employees)
Revenue: USD 10M to 25M
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Riverwoods, United States
Founded: 1985
WebsiteLinkedIn