AI Engineer 5 (AI Foundations, LLM Core and Agentic AI)

Discover Financial
Cambridge, New York, San Jose
Workplace: OnsiteFull timeUSD 229,900 - 286,200 annuallyFunction: Data Science & Machine LearningExperience: 6+ yearsEducation: bachelorsSkills: ["Communication","Mentorship","Collaboration","Problem-solving","Technical judgment"]

Build and deploy foundational AI systems on responsible, scalable infrastructure. Partner across engineering, research, technical program management, and product teams to deliver LLM inference, agent and multi-agent workflows, similarity search, guardrails, evaluation, governance, experimentation, and observability. Use tools such as AWS Ultraclusters, Hugging Face, vector databases, and PyTorch, and optimize training and inference for cost, latency, throughput, and performance.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Discover Financial
Discover Financial
14 hours ago

AI Engineer 5 (AI Foundations, LLM Core and Agentic AI)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 14 hours agoStatus: Live

Job Summary

Build and deploy foundational AI systems on responsible, scalable infrastructure. Partner across engineering, research, technical program management, and product teams to deliver LLM inference, agent and multi-agent workflows, similarity search, guardrails, evaluation, governance, experimentation, and observability. Use tools such as AWS Ultraclusters, Hugging Face, vector databases, and PyTorch, and optimize training and inference for cost, latency, throughput, and performance.
Location: Cambridge, New York, San Jose
Workplace: Onsite
Employment Type: Full time
Job Function: Data Science & Machine Learning
Seniority: Mid level

Key Responsibilities

  • •Partner with cross-functional teams to deliver AI-powered products that change how associates work and how customers interact.
  • •Design, develop, test, deploy, and support AI software components, including foundation model training, LLM inference, agents/multi-agent workflows, similarity search, guardrails, evaluation, experimentation, governance, and observability.
  • •Optimize foundation model training and inference for scalability, cost, latency, and throughput in large-scale production systems.
  • •Build and optimize multi-model orchestration pipelines integrating LLMs, vector search, and domain-specific models into unified systems.
  • •Establish cost-performance governance and lead technical design councils; mentor Principal and Manager-level AI engineers.

Pay and Benefits

Salary: USD 229,900 - 286,200 annually

Key Requirements

  • •Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 6 years developing AI/ML algorithms or technologies, or a Master's degree plus at least 4 years.
  • •At least 6 years of experience programming with Python, Go, Scala, CUDA, or Java.
  • •Experience designing, developing, testing, deploying, and supporting AI software components including foundation model training, LLM inference, agents/multi-agent workflows, similarity search, guardrails, evaluation, experimentation, governance, and observability.
  • •Leverage a broad stack of open source and SaaS AI technologies for building foundation AI systems in production.
  • •Demonstrated technical depth across engineering and mathematics to identify and execute AI optimization opportunities in real systems.
Experience:6+ yearsAIMachine learningLLMsCloudAgentic AI
Education:Bachelor's in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields
Skills:CommunicationMentorshipCollaborationProblem-solvingTechnical judgment
Tech Stack:PythonGoScalaCUDAJavaC++C#GolangAWS UltraclustersHuggingfaceVectorDBsPyTorchAWSGoogle CloudAzureLLM inferenceSimilarity searchGuardrailsModel evaluationExperimentation

Eligibility

Work Authorization:Sponsorship available.

Company Brief

Discover Financial
Provides consumer banking products, credit cards, personal loans, and payment services through the Discover brand. It operates a major U.S. financial network and serves individuals and merchants with lending and digital payment solutions.
Industry: Retail Banking
Company Size: Enterprise (1,001+ employees)
Revenue: USD 10M to 25M
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Riverwoods, United States
Founded: 1985
WebsiteLinkedIn