AI Engineer 4 (AI Foundations, LLM Core and Agentic AI)

Discover Financial
New York, San Francisco, Virginia, Cambridge, San Jose
Workplace: OnsiteFull timeUSD 215,200 - 245,600 annuallyFunction: Data Science & Machine LearningExperience: 4+ yearsEducation: bachelorsSkills: ["Collaboration","Technical leadership","Mentoring","Problem-solving","Communication"]

Build responsible, production-grade AI systems for banking at scale, partnering with engineers, research scientists, and product teams. Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, agent and multi-agent workflows, similarity search, guardrails, evaluation, and observability. Optimize training and inference for cost, latency, throughput, and hardware efficiency, and define SLOs and governance for reliable, ethical AI.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Discover Financial
Discover Financial
4 hours ago

AI Engineer 4 (AI Foundations, LLM Core and Agentic AI)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 4 hours agoStatus: Live

Job Summary

Build responsible, production-grade AI systems for banking at scale, partnering with engineers, research scientists, and product teams. Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, agent and multi-agent workflows, similarity search, guardrails, evaluation, and observability. Optimize training and inference for cost, latency, throughput, and hardware efficiency, and define SLOs and governance for reliable, ethical AI.
Location: New York, San Francisco, Virginia, Cambridge, San Jose
Workplace: Onsite
Employment Type: Full time
Job Function: Data Science & Machine Learning
Seniority: Mid level

Key Responsibilities

  • •Partner with cross-functional teams to deliver AI-powered products that improve how associates work and how customers interact.
  • •Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, agents and multi-agent workflows, similarity search, guardrails, evaluation, experimentation, governance, and observability.
  • •Invent and apply optimization techniques to improve performance (scalability, cost, latency, throughput) for production AI systems.
  • •Own end-to-end architecture for complex AI systems, ensuring maintainability, observability, and ethical alignment.
  • •Define AI reliability service-level objectives (SLOs) and collaborate with infrastructure engineering to optimize GPU/TPU utilization and inference pipelines.

Pay and Benefits

Salary: USD 215,200 - 245,600 annually

Key Requirements

  • •Bachelor’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 4 years of experience developing AI/ML algorithms or technologies, or a Master’s degree plus at least 2 years.
  • •At least 4 years of experience programming with Python, Go, Scala, CUDA, or Java.
  • •Experience leading development AI systems with tradeoff decisions around cost, latency, throughput, and accuracy.
  • •6+ years deploying scalable, responsible AI solutions on cloud platforms (e.g., AWS, Google Cloud, Azure, or equivalent private cloud).
  • •Experience designing, developing, delivering, and supporting AI services and algorithms (e.g., LLM inference, similarity search, vector DBs, guardrails, memory).
Experience:4+ yearsAIMachine learningLLMCloudResponsible AIAgentic AI
Education:Bachelor's in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields
Skills:CollaborationTechnical leadershipMentoringProblem-solvingCommunication
Tech Stack:AWS UltraclustersHuggingfaceVectorDBsPyTorchOpen SourcePythonGoScalaCUDAJavaC++C#GolangAWSGoogle CloudAzureGPUTPUFoundation modelLLM inference

Eligibility

Work Authorization:Sponsorship available.

Company Brief

Discover Financial
Provides consumer banking products, credit cards, personal loans, and payment services through the Discover brand. It operates a major U.S. financial network and serves individuals and merchants with lending and digital payment solutions.
Industry: Retail Banking
Company Size: Enterprise (1,001+ employees)
Revenue: USD 10M to 25M
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Riverwoods, United States
Founded: 1985
WebsiteLinkedIn