Senior AI/ML Engineer - Agentic AI

SAP
United States
Workplace: HybridFull timeUSD 131,000 - 271,600 annuallyFunction: Data Science & Machine LearningExperience: 6+ yearsSkills: ["Mentoring","Engineering leadership","Writing design docs","Decision-making","Working in ambiguous environments"]

Build agentic AI systems and specialized foundation models that accelerate SAP customers’ data transformation and power SAP’s Autonomous Enterprise across finance, supply chain, HR, and procurement. Architect and lead multi-agent designs end-to-end—from prototype to production—covering serving, guardrails, cost/latency optimization, evaluation strategy, and observability. Partner with pretraining/fine-tuning teams globally and mentor engineers while raising technical quality.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
SAP
SAP
2 hours ago

Senior AI/ML Engineer - Agentic AI

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 2 hours agoStatus: Live

Job Summary

Build agentic AI systems and specialized foundation models that accelerate SAP customers’ data transformation and power SAP’s Autonomous Enterprise across finance, supply chain, HR, and procurement. Architect and lead multi-agent designs end-to-end—from prototype to production—covering serving, guardrails, cost/latency optimization, evaluation strategy, and observability. Partner with pretraining/fine-tuning teams globally and mentor engineers while raising technical quality.
Location: United States
Workplace: Hybrid
Employment Type: Full time
Job Function: Data Science & Machine Learning
Seniority: Mid level

Key Responsibilities

  • •Architect and lead multi-agent systems, including orchestration patterns, failure modes, memory, planning, and human-in-the-loop.
  • •Own the path from prototype to production, covering containerization, guardrails, cost/latency optimization, and scalable serving.
  • •Define the team’s evaluation strategy using offline/online harnesses, trajectory quality, tool-call accuracy, regression testing, and CI/CD evaluation gates.
  • •Lead instrumentation and observability with tracing, span capture, automated scoring, and a trace-to-eval-to-fix feedback loop.
  • •Drive tool integration architecture via MCP across multiple product teams and mentor junior/mid engineers through code and architecture reviews.
Travel: Low travel

Pay and Benefits

Salary: USD 131,000 - 271,600 annually

Key Requirements

  • •6+ years building and shipping ML systems, including 3+ years hands-on with LLMs and agents in production.
  • •BS, MS, or PhD in Computer Science, ML, or a related field.
  • •Expert Python with strong system design, testing, modularity, async, and API design fundamentals.
  • •Production experience with agent frameworks/orchestration (at least three) such as LangGraph/LangChain, CrewAI/AutoGen, and MCP-based tool integration.
  • •Inference and evaluation expertise, including optimization tools (e.g., vLLM/TensorRT-LLM, quantization) and observability/evaluation tooling (e.g., Langfuse/LangSmith/Arize).
Experience:6+ yearsMLLLMsAgentic AIFoundation models
Education:
Skills:MentoringEngineering leadershipWriting design docsDecision-makingWorking in ambiguous environments
Tech Stack:PythonPyTorchLoRAQLoRAPEFTVLLMTensorRT-LLMQuantizationInt8Int4GPTQAWQLangGraphLangChainCrewAIAutoGenAG2MCPClaude CodeOpenCode

Company Brief

SAP
Global enterprise software company best known for ERP systems and business applications covering finance, supply chain, procurement, HR, analytics, and customer management for large organizations.
Industry: Enterprise Software
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Walldorf, Germany
Founded: 1972
Glassdoor
Glassdoor: 4.1
WebsiteLinkedInGlassdoor