Senior Manager, AI Engineer (Gen AI Platform Services: Agentic AI, Guardrails, Evaluation)

Discover Financial
New York, San Francisco, San Jose, Cambridge, Virginia
Workplace: OnsiteFull timeUSD 229,900 - 286,200 annuallyFunction: Data Science & Machine LearningExperience: 4+ yearsEducation: bachelorsSkills: ["Mentoring","Coaching","Communication","Presentation","Leadership"]

Lead AI engineering for the Intelligent Foundations and Experiences team, partnering with engineers, research scientists, program managers, and product managers to deliver responsible, scalable GenAI capabilities. Oversee end-to-end development and operations of foundation model training, LLM inference, similarity search, guardrails, evaluation, experimentation, governance, and observability. Drive build-vs-buy decisions across open source and SaaS AI tooling and invent LLM optimization techniques to improve production scalability, cost, latency, and throughput.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Discover Financial
Discover Financial
4 days ago

Senior Manager, AI Engineer (Gen AI Platform Services: Agentic AI, Guardrails, Evaluation)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 17 hours agoStatus: Live

Job Summary

Lead AI engineering for the Intelligent Foundations and Experiences team, partnering with engineers, research scientists, program managers, and product managers to deliver responsible, scalable GenAI capabilities. Oversee end-to-end development and operations of foundation model training, LLM inference, similarity search, guardrails, evaluation, experimentation, governance, and observability. Drive build-vs-buy decisions across open source and SaaS AI tooling and invent LLM optimization techniques to improve production scalability, cost, latency, and throughput.
Location: New York, San Francisco, San Jose, Cambridge, Virginia
Workplace: Onsite
Employment Type: Full time
Job Function: Data Science & Machine Learning
Seniority: Sr. Manager level

Key Responsibilities

  • •Partner with cross-functional teams to deliver AI-powered products that change how associates work and how customers interact.
  • •Oversee the design, development, testing, deployment, and support of AI software components including foundation model training, LLM inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
  • •Make high judgment build-vs-buy decisions across open source and SaaS AI technologies (e.g., AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails).
  • •Invent and introduce LLM optimization techniques to improve production scalability, cost, latency, and throughput.
  • •Contribute to the technical vision and long-term roadmap for foundational AI systems; attract and retain talent and nurture team development.

Pay and Benefits

Salary: USD 229,900 - 286,200 annually

Key Requirements

  • •Bachelor’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 6 years developing AI/ML algorithms or technologies, or a Master’s degree plus at least 4 years experience.
  • •At least 1 year of people leadership experience.
  • •Manage and lead an engineering team (preferred: 3 years).
  • •Experience deploying scalable and responsible AI solutions on cloud platforms (preferred: 6 years; e.g., AWS, Google Cloud, Azure).
  • •Experience developing AI/ML algorithms or technologies such as LLM inference, similarity search and vector databases, and guardrails (preferred).
Experience:4+ years
Education:Bachelor's
Skills:MentoringCoachingCommunicationPresentationLeadership
Tech Stack:AWS UltraclustersOpen SourceSaaSHuggingfaceVectorDBsNemo GuardrailsPyTorchAWSGoogle CloudAzurePythonC++C#JavaGolangLLM InferenceSimilarity SearchFoundation model trainingExperimentationGovernance

Eligibility

Work Authorization:Sponsorship available.

Company Brief

Discover Financial
Provides consumer banking products, credit cards, personal loans, and payment services through the Discover brand. It operates a major U.S. financial network and serves individuals and merchants with lending and digital payment solutions.
Industry: Retail Banking
Company Size: Enterprise (1,001+ employees)
Revenue: USD 10M to 25M
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Riverwoods, United States
Founded: 1985
WebsiteLinkedIn