Senior AI Engineer (AI Foundations)

Discover Financial
Cambridge, San Jose, New York
Full timeUSD 161,800 - 201,400 annuallyFunction: Data Science & Machine LearningExperience: 3+ yearsEducation: bachelorsSkills: ["Collaboration","Adaptability","Problem-solving","Scientific communication","Innovation"]

Build and deploy foundation-model and LLM-powered components within the Intelligent Foundations and Experiences team. You’ll design, develop, test, and support AI systems spanning training, inference, similarity search, guardrails, evaluation, experimentation, governance, and observability. Partnering with engineers, research scientists, technical program managers, and product managers, you’ll improve scalability, cost, latency, and throughput while shaping the long-term roadmap for foundational AI at scale.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Discover Financial
Discover Financial
23 minutes ago

Senior AI Engineer (AI Foundations)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 23 minutes agoStatus: Live
Reposted: similar role first listed 2 days ago

Job Summary

Build and deploy foundation-model and LLM-powered components within the Intelligent Foundations and Experiences team. You’ll design, develop, test, and support AI systems spanning training, inference, similarity search, guardrails, evaluation, experimentation, governance, and observability. Partnering with engineers, research scientists, technical program managers, and product managers, you’ll improve scalability, cost, latency, and throughput while shaping the long-term roadmap for foundational AI at scale.
Location: Cambridge, San Jose, New York
Employment Type: Full time
Job Function: Data Science & Machine Learning
Seniority: Mid level

Key Responsibilities

  • •Partner with cross-functional teams to deliver AI-powered products that change how associates work and how customers interact with the company.
  • •Design, develop, test, deploy, and support AI software components across training, LLM inference, similarity search, guardrails, evaluation, experimentation, governance, and observability.
  • •Use Open Source and SaaS AI technologies (including AWS Ultraclusters, Huggingface, VectorDBs, and Nemo Guardrails) to build and run AI capabilities.
  • •Invent and introduce state-of-the-art LLM optimization techniques to improve scalability, cost, latency, and throughput in production systems.
  • •Contribute to the technical vision and long-term roadmap for foundational AI systems.

Pay and Benefits

Salary: USD 161,800 - 201,400 annually

Key Requirements

  • •Bachelor’s degree in Computer Science/AI/Electrical or related fields plus 3+ years developing AI/ML algorithms/technologies, or a Master’s degree plus 1+ year developing AI/ML algorithms/technologies.
  • •3+ years programming with Python, Go, Scala, or Java.
  • •Experience designing, developing, deploying, and supporting AI services and systems (e.g., LLM inference, similarity search, vector databases, guardrails, memory).
  • •Demonstrated ability to stay current with AI research and apply novel techniques responsibly in production.
  • •Experience optimizing training and inference for improved hardware utilization, latency, throughput, and cost (preferred).
Experience:3+ yearsAIMachine learningLLMsCloudResponsible AI
Education:Bachelor's
Skills:CollaborationAdaptabilityProblem-solvingScientific communicationInnovation
Tech Stack:PythonGoScalaJavaAWSGoogle CloudAzureHuggingfacePyTorchVectorDBsNemo GuardrailsLLM inferenceSimilarity searchFoundation model trainingLarge language modelsGuardrailsModel evaluationExperimentationGovernanceObservability

Eligibility

Work Authorization:Sponsorship available.

Company Brief

Discover Financial
Provides consumer banking products, credit cards, personal loans, and payment services through the Discover brand. It operates a major U.S. financial network and serves individuals and merchants with lending and digital payment solutions.
Industry: Retail Banking
Company Size: Enterprise (1,001+ employees)
Revenue: USD 10M to 25M
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Riverwoods, United States
Founded: 1985
WebsiteLinkedIn