AI Engineer 4 (AI Foundations, LLM Core and Agentic AI)

Discover Financial
San Jose, Cambridge, Virginia, New York
Workplace: OnsiteFull timeUSD 197,300 - 245,600 annuallyFunction: Data Science & Machine LearningExperience: 4+ yearsEducation: bachelorsSkills: ["Cross-functional collaboration","Technical leadership","Problem-solving","Mentoring","Architectural thinking"]

Build and deploy responsible, scalable AI systems for banking—spanning foundation model training, LLM inference, agentic and multi-agent workflows, similarity search, guardrails, evaluation, governance, and observability. Partner with engineers and research scientists to invent optimization techniques for production performance and cost (latency, throughput, scalability). Own end-to-end architecture, define AI reliability SLOs, and collaborate with infrastructure teams to optimize GPU/TPU inference pipelines.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Discover Financial
Discover Financial
3 days ago

AI Engineer 4 (AI Foundations, LLM Core and Agentic AI)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 5 hours agoStatus: Live

Job Summary

Build and deploy responsible, scalable AI systems for banking—spanning foundation model training, LLM inference, agentic and multi-agent workflows, similarity search, guardrails, evaluation, governance, and observability. Partner with engineers and research scientists to invent optimization techniques for production performance and cost (latency, throughput, scalability). Own end-to-end architecture, define AI reliability SLOs, and collaborate with infrastructure teams to optimize GPU/TPU inference pipelines.
Location: San Jose, Cambridge, Virginia, New York
Workplace: Onsite
Employment Type: Full time
Job Function: Data Science & Machine Learning
Seniority: Mid level

Key Responsibilities

  • •Partner with cross-functional teams (engineers, research scientists, technical program managers, and product managers) to deliver AI-powered products.
  • •Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, agentic and multi-agent workflows, similarity search, guardrails, evaluation, experimentation, governance, and observability.
  • •Invent and introduce state-of-the-art foundation model optimization techniques to improve production scalability, cost, latency, and throughput.
  • •Own end-to-end architecture for complex AI systems, ensuring maintainability, observability, and ethical alignment.
  • •Define AI reliability service-level objectives (SLOs) and collaborate with infrastructure engineering to optimize GPU/TPU utilization and accelerate inference pipelines.

Pay and Benefits

Salary: USD 197,300 - 245,600 annually

Key Requirements

  • •Bachelor’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 4 years developing AI/ML algorithms or technologies, or a Master’s degree plus at least 2 years developing AI/ML algorithms or technologies.
  • •At least 4 years of experience programming with Python, Go, Scala, CUDA, or Java.
  • •Experience developing and deploying AI and ML algorithms or technologies, including LLM inference, similarity search, vector databases, guardrails, and memory (using Python, C++, C#, Java, CUDA, or Golang).
  • •Experience designing, developing, delivering, and supporting AI services.
  • •Experience leading development of AI systems with tradeoff decisions around cost, latency, throughput, and accuracy (preferred).
Experience:4+ years
Education:Bachelor's in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields
Skills:Cross-functional collaborationTechnical leadershipProblem-solvingMentoringArchitectural thinking
Tech Stack:AWS UltraclustersHuggingfaceVectorDBsPyTorchOpen SourceSaaS AI technologiesPythonGoScalaCUDAJavaC++C#GolangGPU utilizationTPU utilizationFoundation model trainingLarge language model inferenceAgentsMulti-agent workflows

Eligibility

Work Authorization:Sponsorship available.

Company Brief

Discover Financial
Provides consumer banking products, credit cards, personal loans, and payment services through the Discover brand. It operates a major U.S. financial network and serves individuals and merchants with lending and digital payment solutions.
Industry: Retail Banking
Company Size: Enterprise (1,001+ employees)
Revenue: USD 10M to 25M
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Riverwoods, United States
Founded: 1985
WebsiteLinkedIn