Senior Distinguished Engineer, AI Compute (Remote Eligible)

Discover Financial
San Francisco, Cambridge, New York, Richmond, San Jose
Workplace: RemoteFull timeUSD 286,200 - 326,700 annuallyFunction: Data Science & Machine LearningExperience: 10+ yearsEducation: bachelorsSkills: ["System design","Hands-on technical leadership","Collaboration","Mentoring","Code review"]

Design and build foundational AI compute capabilities for a cloud enterprise AI/ML platform, enabling secure, multi-tenant control and data planes for real-time and batch workloads. Lead distributed compute engine solutions using Ray/Spark to accelerate LLM pre-training, reinforcement learning, training, inference, and feature generation pipelines. Drive operational excellence through automation, direct execution across a diverse technical portfolio, and mentor talent while collaborating with product and program stakeholders.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Discover Financial
Discover Financial
1 month ago

Senior Distinguished Engineer, AI Compute (Remote Eligible)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 2 hours agoStatus: Live

Job Summary

Design and build foundational AI compute capabilities for a cloud enterprise AI/ML platform, enabling secure, multi-tenant control and data planes for real-time and batch workloads. Lead distributed compute engine solutions using Ray/Spark to accelerate LLM pre-training, reinforcement learning, training, inference, and feature generation pipelines. Drive operational excellence through automation, direct execution across a diverse technical portfolio, and mentor talent while collaborating with product and program stakeholders.
Location: San Francisco, Cambridge, New York, Richmond, San Jose
Workplace: Remote
Employment Type: Full time
Job Function: Data Science & Machine Learning

Key Responsibilities

  • •Architect and build control and data plane implementations for a highly available, multi-tenant, secure machine learning platform.
  • •Develop Ray and Spark distributed compute engine solutions to accelerate diverse workloads, including LLM pre-training and reinforcement learning.
  • •Engineer operational excellence improvements by automating KTLO (Keep The Lights On) workflows.
  • •Direct technical execution across a diverse project portfolio, from distributed microservices to running large foundation models.
  • •Collaborate cross-functionally with product and program management and lead system design and code review sessions while mentoring internal talent and recruiting externally.

Pay and Benefits

Salary: USD 286,200 - 326,700 annually

Key Requirements

  • •Bachelor’s degree in Computer Science/AI/Electrical or Computer Engineering (or related) plus 10+ years building AI/ML algorithms/technologies, or a Master’s plus 8+ years.
  • •10+ years programming with Python, Go, Scala, or Java.
  • •Hands-on experience building distributed compute frameworks and systems for large-scale AI workloads.
  • •Experience with containerized and serverless runtime environments (e.g., Kubernetes and AWS Lambda) for secure, scalable platforms.
  • •Experience building AI platform capabilities for LLM training, fine-tuning, and/or high-throughput inference.
Experience:10+ yearsAIMachine learningDistributed systemsLLM trainingInferenceCloud platform
Education:Bachelor's
Skills:System designHands-on technical leadershipCollaborationMentoringCode review
Tech Stack:GolangPythonScalaJavaSparkDaskRayFlinkKubernetesAWS LambdaAWSEKSEC2 UltraClustersGravitonTransformersLLMMicroservicesDistributed microservicesRay (Actors/GCS/Scheduling)Spark (Query Optimizer/Memory Management)

Eligibility

Work Authorization:Sponsorship available.

Company Brief

Discover Financial
Provides consumer banking products, credit cards, personal loans, and payment services through the Discover brand. It operates a major U.S. financial network and serves individuals and merchants with lending and digital payment solutions.
Industry: Retail Banking
Company Size: Enterprise (1,001+ employees)
Revenue: USD 10M to 25M
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Riverwoods, United States
Founded: 1985
WebsiteLinkedIn