Lead AI Engineer (FM Hosting, LLM Inference)

Discover Financial
New York, San Francisco, San Jose
Workplace: OnsiteFull timeUSD 215,200 - 245,600 annuallyFunction: Data Science & Machine LearningExperience: 4+ yearsEducation: bachelorsSkills: ["Cross-functional collaboration","Problem-solving","Scientific curiosity","Communication","Resilience"]

Build and deploy AI software components for foundation model training and large language model inference, including similarity search, guardrails, evaluation, experimentation, governance, and observability. Partner with engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that improve associate workflows and customer interactions. Optimize large-scale production LLM systems to improve scalability, cost, latency, and throughput using cloud and open-source AI technologies.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Discover Financial
Discover Financial
1 month ago

Lead AI Engineer (FM Hosting, LLM Inference)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 6 hours agoStatus: Live

Job Summary

Build and deploy AI software components for foundation model training and large language model inference, including similarity search, guardrails, evaluation, experimentation, governance, and observability. Partner with engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that improve associate workflows and customer interactions. Optimize large-scale production LLM systems to improve scalability, cost, latency, and throughput using cloud and open-source AI technologies.
Location: New York, San Francisco, San Jose
Workplace: Onsite
Employment Type: Full time
Job Function: Data Science & Machine Learning

Key Responsibilities

  • •Partner with cross-functional teams to deliver AI-powered products that change how associates work and how customers interact.
  • •Design, develop, test, deploy, and support AI software components such as foundation model training and LLM inference.
  • •Leverage open source and SaaS AI technologies including AWS Ultraclusters, Huggingface, VectorDBs, and Nemo Guardrails.
  • •Invent and introduce state-of-the-art LLM optimization techniques to improve performance (scalability, cost, latency, throughput).
  • •Contribute to the technical vision and long-term roadmap of foundational AI systems.

Pay and Benefits

Salary: USD 215,200 - 245,600 annually

Key Requirements

  • •Bachelor’s degree in Computer Science/AI/Electrical Engineering/Computer Engineering or related fields plus at least 4 years of AI/ML algorithm or technology experience, or a Master’s degree plus at least 2 years experience.
  • •At least 4 years of experience programming with Python, Go, Scala, or Java.
  • •Strong technical foundation in engineering and mathematics, with expertise spanning hardware, software, and AI.
  • •Ability to stay abreast of the latest research and apply novel techniques judiciously in production.
  • •Experience with deploying scalable, responsible AI solutions on cloud platforms (e.g., AWS, Google Cloud, Azure) is preferred.
Experience:4+ yearsMachine learningAILLM inferenceCloudLLM optimization
Education:Bachelor's in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields
Skills:Cross-functional collaborationProblem-solvingScientific curiosityCommunicationResilience
Tech Stack:AWS UltraclustersHuggingfaceVectorDBsNemo GuardrailsPyTorchPythonGoScalaJavaC++C#GolangLLM inferenceFoundation model trainingSimilarity searchGuardrailsModel evaluationExperimentationGovernanceObservability

Eligibility

Work Authorization:Sponsorship available.

Company Brief

Discover Financial
Provides consumer banking products, credit cards, personal loans, and payment services through the Discover brand. It operates a major U.S. financial network and serves individuals and merchants with lending and digital payment solutions.
Industry: Retail Banking
Company Size: Enterprise (1,001+ employees)
Revenue: USD 10M to 25M
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Riverwoods, United States
Founded: 1985
WebsiteLinkedIn