Senior Lead AI Engineer (AI Foundations, VLM Customization)

Discover Financial
New York, Virginia, Cambridge, San Jose
Workplace: OnsiteFull timeFunction: Data Science & Machine LearningExperience: 6+ yearsSkills: ["Engineering leadership","Mentorship","Cross-functional influence","Communication","Problem-solving"]

Build and support AI software components for foundational and LLM-based capabilities, including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability. Partner with engineers, research scientists, and product teams to deliver AI-powered products. Leverage AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, and PyTorch, and invent optimization techniques to improve scalability, cost, latency, and throughput in production AI systems.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Discover Financial
Discover Financial
18 hours ago

Senior Lead AI Engineer (AI Foundations, VLM Customization)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 5 hours agoStatus: Live

Job Summary

Build and support AI software components for foundational and LLM-based capabilities, including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability. Partner with engineers, research scientists, and product teams to deliver AI-powered products. Leverage AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, and PyTorch, and invent optimization techniques to improve scalability, cost, latency, and throughput in production AI systems.
Location: New York, Virginia, Cambridge, San Jose
Workplace: Onsite
Employment Type: Full time
Job Function: Data Science & Machine Learning
Seniority: Sr. Manager level

Key Responsibilities

  • •Partner with cross-functional engineers, research scientists, technical program managers, and product managers to deliver AI-powered products.
  • •Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, similarity search, guardrails, evaluation, experimentation, governance, and observability.
  • •Leverage Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, and PyTorch.
  • •Invent and introduce LLM optimization techniques to improve scalability, cost, latency, and throughput for production AI systems.
  • •Contribute to the technical vision and long-term roadmap for foundational AI systems at Capital One.

Key Requirements

  • •Bachelor’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a related field plus at least 6 years developing AI/ML algorithms or technologies, or a Master’s degree plus at least 4 years.
  • •At least 6 years programming with Python, Go, Scala, or Java.
  • •7 years experience deploying scalable, responsible AI solutions on cloud platforms (e.g., AWS, Google Cloud, Azure) and leading/mentoring engineering teams.
  • •Experience designing, developing, integrating, delivering, and supporting complex AI systems and production LLM-related capabilities (inference, similarity search, VectorDBs, guardrails, memory) using languages including Python, C++, C#, Java, or Golang.
  • •Ability to apply state-of-the-art optimization techniques to improve training/inference performance metrics like hardware utilization, latency, throughput, and cost.
Experience:6+ yearsAIMLLLM
Education:
Skills:Engineering leadershipMentorshipCross-functional influenceCommunicationProblem-solving
Tech Stack:AWS UltraclustersHuggingfaceVectorDBsNemo GuardrailsPyTorchPythonGoScalaJavaC++C#GolangLarge language model inferenceFoundation model trainingSimilarity searchGuardrailsModel evaluationExperimentationGovernanceObservability

Eligibility

Work Authorization:Sponsorship available.

Company Brief

Discover Financial
Provides consumer banking products, credit cards, personal loans, and payment services through the Discover brand. It operates a major U.S. financial network and serves individuals and merchants with lending and digital payment solutions.
Industry: Retail Banking
Company Size: Enterprise (1,001+ employees)
Revenue: USD 10M to 25M
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Riverwoods, United States
Founded: 1985
WebsiteLinkedIn