Senior Lead AI Engineer (Gen AI Platform Services: Distributed Systems)

Discover Financial
Cambridge, San Francisco, Virginia, San Jose, New York
Workplace: OnsiteFull timeUSD 229,900 - 262,400 annuallyFunction: Data Science & Machine LearningExperience: 6+ yearsSkills: ["Leadership","Mentoring","Communication","Presentation","Problem-solving"]

Build and operate GenAI platform services for responsible, scalable AI at scale. Partner with engineers and research scientists to design, develop, test, deploy, and support AI software components such as foundation model training, LLM inference, similarity search, guardrails, evaluation, experimentation, governance, and observability. Work with open-source and SaaS AI tools on AWS infrastructure, and invent optimization techniques to improve scalability, cost, latency, and throughput for production systems.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Discover Financial
Discover Financial
5 days ago

Senior Lead AI Engineer (Gen AI Platform Services: Distributed Systems)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 13 hours agoStatus: Live

Job Summary

Build and operate GenAI platform services for responsible, scalable AI at scale. Partner with engineers and research scientists to design, develop, test, deploy, and support AI software components such as foundation model training, LLM inference, similarity search, guardrails, evaluation, experimentation, governance, and observability. Work with open-source and SaaS AI tools on AWS infrastructure, and invent optimization techniques to improve scalability, cost, latency, and throughput for production systems.
Location: Cambridge, San Francisco, Virginia, San Jose, New York
Workplace: Onsite
Employment Type: Full time
Job Function: Data Science & Machine Learning
Seniority: Sr. Manager level

Key Responsibilities

  • •Partner with cross-functional teams to deliver AI-powered products that change how associates work and how customers interact.
  • •Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, similarity search, guardrails, evaluation, experimentation, governance, and observability.
  • •Leverage open-source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, and PyTorch.
  • •Invent and apply LLM optimization techniques to improve performance across scalability, cost, latency, and throughput in production systems.
  • •Contribute to the technical vision and long-term roadmap for foundational AI systems.

Pay and Benefits

Salary: USD 229,900 - 262,400 annually

Key Requirements

  • •Bachelor’s degree in Computer Science/AI/Electrical Engineering/Computer Engineering (or related) plus 6+ years building AI/ML algorithms/technologies, or a Master’s degree plus 4+ years.
  • •6+ years programming with Python, Go, Scala, or Java.
  • •7+ years deploying scalable, responsible AI solutions on cloud platforms (e.g., AWS, Google Cloud, Azure, or equivalent private cloud).
  • •Experience designing, developing, integrating, delivering, and supporting complex AI systems.
  • •Ability to lead and mentor an engineering team and influence cross-functional stakeholders.
Experience:6+ yearsAI/MLGenAILLMCloud platforms
Education:
Skills:LeadershipMentoringCommunicationPresentationProblem-solving
Tech Stack:AWS UltraclustersHuggingfaceVectorDBsNemo GuardrailsPyTorchFoundation model trainingLarge language model inferenceSimilarity searchGuardrailsModel evaluationExperimentationGovernanceObservabilityAWSGoogle CloudAzurePythonGoScalaJava

Eligibility

Work Authorization:Sponsorship available.

Company Brief

Discover Financial
Provides consumer banking products, credit cards, personal loans, and payment services through the Discover brand. It operates a major U.S. financial network and serves individuals and merchants with lending and digital payment solutions.
Industry: Retail Banking
Company Size: Enterprise (1,001+ employees)
Revenue: USD 10M to 25M
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Riverwoods, United States
Founded: 1985
WebsiteLinkedIn