Lead AI Engineer (FM Hosting, LLM Inference)

Discover Financial
Cambridge, New York, San Jose
Workplace: OnsiteFull timeUSD 215,200 - 245,600 annuallyFunction: Data Science & Machine LearningExperience: 4+ yearsEducation: bachelorsSkills: ["Communication","Problem-solving","Adaptability","Technical judgment"]

Build and deploy AI software components for large-scale foundation model training and LLM inference, including similarity search, guardrails, model evaluation, experimentation, governance, and observability. Partner with cross-functional engineers, research scientists, and product teams to deliver AI-powered products, invent LLM optimization techniques to improve scalability, cost, latency, and throughput, and help shape the long-term roadmap for foundational AI systems on production cloud infrastructure.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Discover Financial
Discover Financial
1 month ago

Lead AI Engineer (FM Hosting, LLM Inference)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 2 hours agoStatus: Live

Job Summary

Build and deploy AI software components for large-scale foundation model training and LLM inference, including similarity search, guardrails, model evaluation, experimentation, governance, and observability. Partner with cross-functional engineers, research scientists, and product teams to deliver AI-powered products, invent LLM optimization techniques to improve scalability, cost, latency, and throughput, and help shape the long-term roadmap for foundational AI systems on production cloud infrastructure.
Location: Cambridge, New York, San Jose
Workplace: Onsite
Employment Type: Full time
Job Function: Data Science & Machine Learning
Seniority: Mid level

Key Responsibilities

  • •Partner with cross-functional engineers, research scientists, technical program managers, and product managers to deliver AI-powered products.
  • •Design, develop, test, deploy, and support AI software components including foundation model training and large language model inference.
  • •Use open source and SaaS AI technologies (e.g., AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch) to build production systems.
  • •Invent LLM optimization techniques to improve scalability, cost, latency, and throughput of large-scale production AI systems.
  • •Contribute to the technical vision and long-term roadmap for foundational AI systems.

Pay and Benefits

Salary: USD 215,200 - 245,600 annually

Key Requirements

  • •Bachelor’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 4 years of experience developing AI and ML algorithms or technologies, or a Master’s degree plus at least 2 years.
  • •At least 4 years programming with Python, Go, Scala, or Java.
  • •Experience deploying scalable and responsible AI solutions on cloud platforms such as AWS, Google Cloud, Azure (or equivalent private cloud).
  • •Experience designing, developing, delivering, and supporting AI services.
  • •Experience developing AI/ML algorithms and techniques such as LLM inference, similarity search, and vector databases (e.g., using Python, C++, C#, Java, or Golang).
Experience:4+ yearsAIMachine learningCloudLLM inference
Education:Bachelor's in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields
Skills:CommunicationProblem-solvingAdaptabilityTechnical judgment
Tech Stack:PythonGoScalaJavaC++C#GolangAWSGoogle CloudAzureHuggingfacePyTorchVectorDBsNemo GuardrailsUltraclustersLLM inferenceSimilarity searchGuardrailsModel evaluationExperimentation

Eligibility

Work Authorization:Sponsorship available.

Company Brief

Discover Financial
Provides consumer banking products, credit cards, personal loans, and payment services through the Discover brand. It operates a major U.S. financial network and serves individuals and merchants with lending and digital payment solutions.
Industry: Retail Banking
Company Size: Enterprise (1,001+ employees)
Revenue: USD 10M to 25M
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Riverwoods, United States
Founded: 1985
WebsiteLinkedIn