Lead AI/ML Engineer (Platform, kubeflow)

Discover Financial
New York, San Francisco, San Jose
Workplace: OnsiteFull timeUSD 215,200 - 245,600 annuallyFunction: Data Science & Machine LearningExperience: 4+ yearsEducation: bachelorsSkills: ["System thinking","Quality focus","Ability to communicate","Adaptability","Technical leadership"]

Lead the design and delivery of responsible, scalable AI software components for foundational model training and production LLM inference. Partner with engineering, research, technical program, and product teams to build capabilities spanning similarity search, guardrails, evaluation, experimentation, governance, and observability. Work with open-source and SaaS AI technologies (e.g., AWS Ultraclusters, Hugging Face, VectorDBs, Nemo Guardrails, PyTorch) and invent LLM optimization techniques to improve scalability, cost, latency, and throughput.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Discover Financial
Discover Financial
1 month ago

Lead AI/ML Engineer (Platform, kubeflow)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 2 hours agoStatus: Live

Job Summary

Lead the design and delivery of responsible, scalable AI software components for foundational model training and production LLM inference. Partner with engineering, research, technical program, and product teams to build capabilities spanning similarity search, guardrails, evaluation, experimentation, governance, and observability. Work with open-source and SaaS AI technologies (e.g., AWS Ultraclusters, Hugging Face, VectorDBs, Nemo Guardrails, PyTorch) and invent LLM optimization techniques to improve scalability, cost, latency, and throughput.
Location: New York, San Francisco, San Jose
Workplace: Onsite
Employment Type: Full time
Job Function: Data Science & Machine Learning
Seniority: Sr. Manager level

Key Responsibilities

  • •Partner cross-functionally to deliver AI-powered products that improve associate workflows and customer interactions.
  • •Design, develop, test, deploy, and support AI software components spanning foundation model training, LLM inference, similarity search, guardrails, evaluation, experimentation, governance, and observability.
  • •Leverage open-source and SaaS AI technologies such as AWS Ultraclusters, Hugging Face, VectorDBs, Nemo Guardrails, and PyTorch.
  • •Invent and introduce state-of-the-art LLM optimization techniques to improve scalability, cost, latency, and throughput of production AI systems.
  • •Contribute to the technical vision and long-term roadmap for foundational AI systems at Capital One.

Pay and Benefits

Salary: USD 215,200 - 245,600 annually
Perks:Health Insurance

Key Requirements

  • •Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 4 years developing AI/ML algorithms or technologies (or Master's plus 2 years).
  • •At least 4 years programming with Python, Go, Scala, or Java.
  • •6+ years deploying scalable and responsible AI solutions on cloud platforms such as AWS, Google Cloud, Azure, or equivalent private cloud.
  • •Experience designing, developing, delivering, and supporting AI services, including LLM inference, similarity search, VectorDBs, guardrails, and memory.
  • •Experience applying state-of-the-art optimization techniques to improve training/inference software for hardware utilization, latency, throughput, and cost.
Experience:4+ yearsAI/MLLLMResponsible AICloudProduction AI
Education:Bachelor's
Skills:System thinkingQuality focusAbility to communicateAdaptabilityTechnical leadership
Tech Stack:KubeflowAWSAWS UltraclustersHuggingfaceHugging FaceVectorDBsNemo GuardrailsPyTorchPythonGoScalaJavaC++C#GolangFoundation model trainingLarge language model inferenceSimilarity searchGuardrailsModel evaluation

Eligibility

Work Authorization:Sponsorship available.

Company Brief

Discover Financial
Provides consumer banking products, credit cards, personal loans, and payment services through the Discover brand. It operates a major U.S. financial network and serves individuals and merchants with lending and digital payment solutions.
Industry: Retail Banking
Company Size: Enterprise (1,001+ employees)
Revenue: USD 10M to 25M
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Riverwoods, United States
Founded: 1985
WebsiteLinkedIn