Lead AI Engineer (FM Hosting, LLM Inference)

Discover Financial
New York, Cambridge, San Jose
Workplace: OnsiteFull timeUSD 215,200 - 245,600 annuallyFunction: Data Science & Machine LearningExperience: 4+ yearsSkills: ["Collaboration","Technical problem-solving","Staying current with research","Communicating clearly","Adapting to ambiguity"]

Build and deploy foundational AI capabilities across large-scale LLM inference and related components, working with engineers, research scientists, TPMs, and product managers. Design, develop, test, and support AI software for foundation model training, similarity search, guardrails, model evaluation, experimentation, governance, and observability. Use Open Source and SaaS AI technologies on cloud platforms and invent LLM optimization techniques to improve scalability, cost, latency, and throughput.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Discover Financial
Discover Financial
2 months ago

Lead AI Engineer (FM Hosting, LLM Inference)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 2 hours agoStatus: Live

Job Summary

Build and deploy foundational AI capabilities across large-scale LLM inference and related components, working with engineers, research scientists, TPMs, and product managers. Design, develop, test, and support AI software for foundation model training, similarity search, guardrails, model evaluation, experimentation, governance, and observability. Use Open Source and SaaS AI technologies on cloud platforms and invent LLM optimization techniques to improve scalability, cost, latency, and throughput.
Location: New York, Cambridge, San Jose
Workplace: Onsite
Employment Type: Full time
Job Function: Data Science & Machine Learning
Seniority: Mid level

Key Responsibilities

  • •Partner with cross-functional teams to deliver AI-powered products that change how associates work and how customers interact.
  • •Design, develop, test, deploy, and support AI software components including foundation model training and large language model inference.
  • •Leverage Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, and PyTorch.
  • •Invent and introduce state-of-the-art LLM optimization techniques to improve scalability, cost, latency, and throughput.
  • •Contribute to the technical vision and long-term roadmap of foundational AI systems.

Pay and Benefits

Salary: USD 215,200 - 245,600 annually

Key Requirements

  • •Bachelor’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus 4+ years developing AI/ML algorithms or technologies, or a Master’s degree plus 2+ years.
  • •At least 4 years programming with Python, Go, Scala, or Java.
  • •6 years of experience deploying scalable and responsible AI solutions on cloud platforms (e.g., AWS, Google Cloud, Azure, or equivalent private cloud).
  • •Experience designing, developing, delivering, and supporting AI services.
  • •Experience developing AI/ML algorithms or technologies (e.g., LLM inference, similarity search and VectorDBs, guardrails, memory) using Python, C++, C#, Java, or Golang.
Experience:4+ yearsAIMLCloud
Education:
Skills:CollaborationTechnical problem-solvingStaying current with researchCommunicating clearlyAdapting to ambiguity
Tech Stack:AWSAWS UltraclustersHuggingfaceVectorDBsNemo GuardrailsPyTorchPythonGoScalaJavaC++C#GolangLLM InferenceSimilarity searchGuardrailsModel evaluationExperimentationGovernanceObservability

Eligibility

Work Authorization:Sponsorship available.

Company Brief

Discover Financial
Provides consumer banking products, credit cards, personal loans, and payment services through the Discover brand. It operates a major U.S. financial network and serves individuals and merchants with lending and digital payment solutions.
Industry: Retail Banking
Company Size: Enterprise (1,001+ employees)
Revenue: USD 10M to 25M
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Riverwoods, United States
Founded: 1985
WebsiteLinkedIn