Lead AI Engineer (FM Hosting, LLM Inference)

Discover Financial
Cambridge, New York, San Jose
Workplace: OnsiteFull timeUSD 215,200 - 245,600 annuallyFunction: Data Science & Machine LearningExperience: 4+ yearsEducation: bachelorsSkills: ["Technical problem-solving","Communication","Adaptability","Ownership","Research-oriented mindset"]

Build and deliver AI-powered product capabilities for the Intelligent Foundations and Experiences team, partnering with engineers, research scientists, and product leaders. Design, develop, test, deploy, and support foundation model training and large language model inference, including similarity search, guardrails, evaluation, experimentation, governance, and observability. Optimize LLM performance for scalable production by improving latency, throughput, and cost using open-source and SaaS AI technologies on cloud platforms.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Discover Financial
Discover Financial
1 month ago

Lead AI Engineer (FM Hosting, LLM Inference)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 6 hours agoStatus: Live
Reposted: similar role first listed 1 month ago

Job Summary

Build and deliver AI-powered product capabilities for the Intelligent Foundations and Experiences team, partnering with engineers, research scientists, and product leaders. Design, develop, test, deploy, and support foundation model training and large language model inference, including similarity search, guardrails, evaluation, experimentation, governance, and observability. Optimize LLM performance for scalable production by improving latency, throughput, and cost using open-source and SaaS AI technologies on cloud platforms.
Location: Cambridge, New York, San Jose
Workplace: Onsite
Employment Type: Full time
Job Function: Data Science & Machine Learning
Seniority: Mid level

Key Responsibilities

  • •Partner cross-functionally with engineers, research scientists, technical program managers, and product managers to deliver AI-powered products.
  • •Design, develop, test, deploy, and support AI software components for foundation model training and LLM inference, including similarity search, guardrails, evaluation, experimentation, governance, and observability.
  • •Use open-source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, and Nemo Guardrails to build and run solutions.
  • •Invent and introduce state-of-the-art LLM optimization techniques to improve scalability, cost, latency, and throughput in production systems.
  • •Contribute to the technical vision and long-term roadmap for foundational AI systems.

Pay and Benefits

Salary: USD 215,200 - 245,600 annually

Key Requirements

  • •Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus 4+ years developing AI/ML algorithms or technologies, or a Master's degree plus 2+ years.
  • •4+ years programming with Python, Go, Scala, or Java.
  • •Experience deploying scalable and responsible AI solutions on cloud platforms (e.g., AWS, Google Cloud, Azure).
  • •Experience designing, developing, delivering, and supporting AI services.
  • •Experience developing and applying LLM inference/similarity search/vector database and guardrails techniques, and optimizing training/inference software for performance and cost.
Experience:4+ yearsAI and MLLLM inferenceCloudResponsible AI
Education:Bachelor's
Skills:Technical problem-solvingCommunicationAdaptabilityOwnershipResearch-oriented mindset
Tech Stack:AWS UltraclustersHuggingfaceVectorDBsNemo GuardrailsPyTorchAWSGoogle CloudAzurePythonGoScalaJavaC++C#GolangFoundation model trainingLarge language model inferenceSimilarity searchGuardrailsModel evaluation

Eligibility

Work Authorization:Sponsorship available.

Company Brief

Discover Financial
Provides consumer banking products, credit cards, personal loans, and payment services through the Discover brand. It operates a major U.S. financial network and serves individuals and merchants with lending and digital payment solutions.
Industry: Retail Banking
Company Size: Enterprise (1,001+ employees)
Revenue: USD 10M to 25M
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Riverwoods, United States
Founded: 1985
WebsiteLinkedIn