AI Engineer 5 (FM Hosting, LLM Inference)

Discover Financial
San Jose, Virginia, Cambridge, New York
Workplace: OnsiteFull timeUSD 250,800 - 286,200 annuallyFunction: Data Science & Machine LearningExperience: 6+ yearsEducation: bachelorsSkills: ["Communication","Problem-solving","Mentoring","Adaptability"]

Build and deploy AI software components for foundation model training and large language model inference, including agents, similarity search, guardrails, evaluation, experimentation, governance, and observability. Partner across engineering, research, program management, and product to deliver AI-powered products. Optimize foundation models and orchestration pipelines for cost/performance, establish governance on GPU utilization and inference efficiency, and mentor senior AI engineers while shaping the long-term roadmap for foundational AI systems.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Discover Financial
Discover Financial
3 days ago

AI Engineer 5 (FM Hosting, LLM Inference)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 5 hours agoStatus: Live

Job Summary

Build and deploy AI software components for foundation model training and large language model inference, including agents, similarity search, guardrails, evaluation, experimentation, governance, and observability. Partner across engineering, research, program management, and product to deliver AI-powered products. Optimize foundation models and orchestration pipelines for cost/performance, establish governance on GPU utilization and inference efficiency, and mentor senior AI engineers while shaping the long-term roadmap for foundational AI systems.
Location: San Jose, Virginia, Cambridge, New York
Workplace: Onsite
Employment Type: Full time
Job Function: Data Science & Machine Learning
Seniority: Mid level

Key Responsibilities

  • •Partner with a cross-functional team to deliver AI-powered products that improve how associates work and how customers interact with Capital One.
  • •Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, agents and multi-agent workflows, similarity search, guardrails, evaluation, experimentation, governance, and observability.
  • •Invent and apply foundation model optimization techniques to improve scalability, cost, latency, and throughput for production AI systems.
  • •Design, implement, and optimize multi-model orchestration pipelines integrating LLMs, vector search, and domain-specific models into unified systems.
  • •Establish and lead cost-performance governance reviews and lead technical design councils; mentor Principal and Manager-level AI engineers.

Pay and Benefits

Salary: USD 250,800 - 286,200 annually

Key Requirements

  • •Bachelor’s degree (or higher) in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields with 6+ years developing AI/ML algorithms or technologies, or a Master’s degree with 4+ years.
  • •At least 6 years of experience programming with Python, Go, Scala, CUDA, or Java.
  • •Experience leading development of AI systems with tradeoffs across cost, latency, throughput, and accuracy.
  • •Experience deploying scalable, responsible AI solutions on cloud platforms such as AWS, Google Cloud, Azure, or equivalent private cloud.
  • •Experience designing and integrating complex AI systems, including LLM inference and similarity search/vector databases, into production pipelines.
Experience:6+ yearsAI and machine learningLLM inferenceCloud platformsProduction AI systems
Education:Bachelor's in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields
Skills:CommunicationProblem-solvingMentoringAdaptability
Tech Stack:AWS UltraclustersHuggingfaceVectorDBsPyTorchPythonGoScalaCUDAJavaC++C#GolangLLM inferenceSimilarity searchGuardrailsRetrieval-augmented generationMulti-model orchestrationAgentsMulti-agent workflows

Eligibility

Work Authorization:Sponsorship available.

Company Brief

Discover Financial
Provides consumer banking products, credit cards, personal loans, and payment services through the Discover brand. It operates a major U.S. financial network and serves individuals and merchants with lending and digital payment solutions.
Industry: Retail Banking
Company Size: Enterprise (1,001+ employees)
Revenue: USD 10M to 25M
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Riverwoods, United States
Founded: 1985
WebsiteLinkedIn