AI Engineer 5 (Gen AI Platform Services: Agentic AI, Guardrails, Evaluation)

Discover Financial
New York, San Francisco, Virginia, Cambridge, San Jose
Workplace: OnsiteFull timeUSD 250,800 - 286,200 annuallyFunction: Data Science & Machine LearningExperience: 6+ yearsEducation: bachelorsSkills: ["Communication","Mentorship","Problem-solving","Presentation","Cross-functional collaboration"]

Build and run responsible, scalable GenAI platform capabilities that power foundation model training and LLM inference, agentic and multi-agent workflows, similarity search, guardrails, and evaluation. Partner with engineers and research scientists to design AI software components, orchestration pipelines, experimentation and governance, and observability. Optimize model performance for cost, latency, and throughput using techniques that improve hardware utilization, and lead design councils and cost-performance governance reviews.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Discover Financial
Discover Financial
14 hours ago

AI Engineer 5 (Gen AI Platform Services: Agentic AI, Guardrails, Evaluation)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 14 hours agoStatus: Live

Job Summary

Build and run responsible, scalable GenAI platform capabilities that power foundation model training and LLM inference, agentic and multi-agent workflows, similarity search, guardrails, and evaluation. Partner with engineers and research scientists to design AI software components, orchestration pipelines, experimentation and governance, and observability. Optimize model performance for cost, latency, and throughput using techniques that improve hardware utilization, and lead design councils and cost-performance governance reviews.
Location: New York, San Francisco, Virginia, Cambridge, San Jose
Workplace: Onsite
Employment Type: Full time
Job Function: Data Science & Machine Learning
Seniority: Mid level

Key Responsibilities

  • •Partner with cross-functional engineers, research scientists, technical program managers, and product managers to deliver AI-powered products.
  • •Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, agentic/multi-agent workflows, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
  • •Leverage Open Source and SaaS AI technologies (e.g., AWS Ultraclusters, Huggingface, VectorDBs, PyTorch) to build platform capabilities.
  • •Invent and apply foundation model optimization techniques to improve scalability, cost, latency, and throughput of production AI systems.
  • •Lead cost-performance governance reviews and design review boards; mentor Principal and Manager-level AI engineers.

Pay and Benefits

Salary: USD 250,800 - 286,200 annually

Key Requirements

  • •Bachelor’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related field plus at least 6 years of experience developing AI/ML algorithms or technologies, or a Master’s degree plus at least 4 years.
  • •At least 6 years of experience programming with Python, Go, Scala, CUDA, or Java.
  • •Experience leading development AI systems with tradeoff decisions around cost, latency, throughput, and accuracy.
  • •7 years of experience deploying scalable and responsible AI solutions on cloud platforms (e.g., AWS, Google Cloud, Azure, or equivalent private cloud).
  • •Experience developing and applying state-of-the-art techniques for optimizing training and inference software to improve hardware utilization, latency, throughput, and cost.
Experience:6+ yearsAI/MLCloudGenAIResponsible AI
Education:Bachelor's
Skills:CommunicationMentorshipProblem-solvingPresentationCross-functional collaboration
Tech Stack:PythonGoScalaCUDAJavaC++C#GolangAWS UltraclustersHuggingfaceVectorDBsPyTorchLLM inferenceVector searchGuardrailsSimilarity searchMulti-agent workflowsObservabilityGPU utilization

Eligibility

Work Authorization:Sponsorship available.

Company Brief

Discover Financial
Provides consumer banking products, credit cards, personal loans, and payment services through the Discover brand. It operates a major U.S. financial network and serves individuals and merchants with lending and digital payment solutions.
Industry: Retail Banking
Company Size: Enterprise (1,001+ employees)
Revenue: USD 10M to 25M
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Riverwoods, United States
Founded: 1985
WebsiteLinkedIn