AI Engineer 5 (FM Hosting, LLM Inference)

Discover Financial
Virginia, Cambridge, San Jose, New York
Workplace: OnsiteFull timeUSD 229,900 - 286,200 annuallyFunction: Data Science & Machine LearningExperience: 6+ yearsEducation: bachelorsSkills: ["Communication","Presentation","Problem-solving","Mentoring","Adaptability"]

Build and deploy AI software components for foundation model training and large language model inference, including agents, multi-agent workflows, similarity search, guardrails, and model evaluation. Partner with engineers, research scientists, and product leaders to deliver AI-powered products and scalable, high-performance infrastructure. Optimize foundation model performance (scalability, cost, latency, throughput), design multi-model orchestration pipelines, and lead cost-performance governance and technical design reviews.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Discover Financial
Discover Financial
1 day ago

AI Engineer 5 (FM Hosting, LLM Inference)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 7 hours agoStatus: Live

Job Summary

Build and deploy AI software components for foundation model training and large language model inference, including agents, multi-agent workflows, similarity search, guardrails, and model evaluation. Partner with engineers, research scientists, and product leaders to deliver AI-powered products and scalable, high-performance infrastructure. Optimize foundation model performance (scalability, cost, latency, throughput), design multi-model orchestration pipelines, and lead cost-performance governance and technical design reviews.
Location: Virginia, Cambridge, San Jose, New York
Workplace: Onsite
Employment Type: Full time
Job Function: Data Science & Machine Learning
Seniority: Mid level

Key Responsibilities

  • •Partner with cross-functional teams to deliver AI-powered products affecting how associates and customers interact with Capital One.
  • •Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, agents/multi-agent workflows, similarity search, guardrails, evaluation, experimentation, governance, and observability.
  • •Invent and apply foundation model optimization techniques to improve performance (scalability, cost, latency, throughput) for production AI systems.
  • •Design, implement, and optimize multi-model orchestration pipelines integrating LLMs, vector search, and domain-specific models.
  • •Establish and lead cost-performance governance reviews and lead technical design councils to ensure AI engineering standards; mentor principal and manager-level AI engineers.

Pay and Benefits

Salary: USD 229,900 - 286,200 annually

Key Requirements

  • •Bachelor’s degree (Computer Science, AI, Electrical Engineering, Computer Engineering, or related) plus at least 6 years developing AI/ML algorithms or technologies, or a Master’s degree plus at least 4 years.
  • •At least 6 years of experience programming with Python, Go, Scala, CUDA, or Java.
  • •Experience leading development of AI systems with tradeoffs across cost, latency, throughput, and accuracy.
  • •Experience deploying scalable and responsible AI solutions on cloud platforms (e.g., AWS, Google Cloud, Azure) for 7 years.
  • •Experience developing and applying state-of-the-art techniques to optimize training and inference software for hardware utilization, latency, throughput, and cost.
Experience:6+ yearsAI/MLLLM inferenceCloudAgentic AIResponsible AI
Education:Bachelor's in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields
Skills:CommunicationPresentationProblem-solvingMentoringAdaptability
Tech Stack:PythonGoScalaCUDAJavaC++C#GolangAWSGoogle CloudAzureAWS UltraclustersHuggingfaceVectorDBsPyTorchLLM inferenceVector searchGuardrailsModel evaluationObservability

Eligibility

Work Authorization:Sponsorship available.

Company Brief

Discover Financial
Provides consumer banking products, credit cards, personal loans, and payment services through the Discover brand. It operates a major U.S. financial network and serves individuals and merchants with lending and digital payment solutions.
Industry: Retail Banking
Company Size: Enterprise (1,001+ employees)
Revenue: USD 10M to 25M
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Riverwoods, United States
Founded: 1985
WebsiteLinkedIn