Senior Lead AI Engineer (FM Hosting, LLM Inference)

Discover Financial
New York, San Jose
Workplace: OnsiteFull timeUSD 229,900 - 262,400 annuallyFunction: Data Science & Machine LearningExperience: 6+ yearsEducation: bachelorsSkills: ["Communication","Presentation","Collaboration"]

Design, develop, test, deploy, and support foundational AI software for large-scale LLM inference and responsible AI capabilities. Partner with engineers, research scientists, program managers, and product managers to deliver AI-powered products and build core AI infrastructure. Leverage tools such as AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, and PyTorch, while inventing LLM optimization techniques to improve scalability, cost, latency, and throughput.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Discover Financial
Discover Financial
1 month ago

Senior Lead AI Engineer (FM Hosting, LLM Inference)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 6 hours agoStatus: Live

Job Summary

Design, develop, test, deploy, and support foundational AI software for large-scale LLM inference and responsible AI capabilities. Partner with engineers, research scientists, program managers, and product managers to deliver AI-powered products and build core AI infrastructure. Leverage tools such as AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, and PyTorch, while inventing LLM optimization techniques to improve scalability, cost, latency, and throughput.
Location: New York, San Jose
Workplace: Onsite
Employment Type: Full time
Job Function: Data Science & Machine Learning
Seniority: Mid level

Key Responsibilities

  • •Partner cross-functionally to deliver AI-powered products that change how associates work and how customers interact.
  • •Build AI software components for foundation model training, LLM inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
  • •Use Open Source and SaaS AI technologies (including AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, and PyTorch).
  • •Develop state-of-the-art LLM optimization techniques to improve scalability, cost, latency, and throughput for production AI systems.
  • •Contribute to the technical vision and long-term roadmap for foundational AI systems.

Pay and Benefits

Salary: USD 229,900 - 262,400 annually
Perks:Health Insurance401kRemote WorkLearning BudgetPaid Leave

Key Requirements

  • •Bachelor’s degree in Computer Science/AI/Electrical or Computer Engineering (or related) plus at least 6 years of experience developing AI/ML algorithms or technologies, or a Master’s degree plus at least 4 years.
  • •At least 6 years of experience programming with Python, Go, Scala, or Java.
  • •Experience deploying scalable and responsible AI solutions on cloud platforms (e.g., AWS, Google Cloud, Azure, or equivalent private cloud).
  • •Experience designing, developing, integrating, delivering, and supporting complex AI systems.
  • •Experience developing and applying state-of-the-art techniques to optimize training and inference software for hardware utilization, latency, throughput, and cost.
Experience:6+ yearsAI/MLLLM inferenceCloudResponsible AI
Education:Bachelor's
Skills:CommunicationPresentationCollaboration
Tech Stack:AWS UltraclustersHuggingfaceVectorDBsNemo GuardrailsPyTorchOpen SourceSaaSFoundation model trainingLarge language model inferenceSimilarity searchGuardrailsModel evaluationExperimentationGovernanceObservabilityLLM optimization

Eligibility

Work Authorization:Sponsorship available.

Company Brief

Discover Financial
Provides consumer banking products, credit cards, personal loans, and payment services through the Discover brand. It operates a major U.S. financial network and serves individuals and merchants with lending and digital payment solutions.
Industry: Retail Banking
Company Size: Enterprise (1,001+ employees)
Revenue: USD 10M to 25M
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Riverwoods, United States
Founded: 1985
WebsiteLinkedIn