Staff Agentic AI Engineer

Netomi
Toronto
Workplace: RemoteFull timeFunction: Data Science & Machine LearningExperience: 5+ yearsEducation: bachelorsSkills: ["Engineering judgment","Independent work","Comfort operating as a senior individual contributor"]

Design and improve production-grade agentic AI systems for Netomi’s core platform, including workflow architecture for reasoning, tool use, retrieval, guardrails, escalation, and monitoring. Build scalable Python services deployed on AWS, and develop LLM evaluation infrastructure (LLM-as-judge, regression evals, guardrail testing, quality metrics). Model enterprise knowledge as structured graphs and implement RAG/embedding capabilities for reliable customer-facing automation.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Netomi
Netomi
4 days ago

Staff Agentic AI Engineer

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 8 hours agoStatus: Live

Job Summary

Design and improve production-grade agentic AI systems for Netomi’s core platform, including workflow architecture for reasoning, tool use, retrieval, guardrails, escalation, and monitoring. Build scalable Python services deployed on AWS, and develop LLM evaluation infrastructure (LLM-as-judge, regression evals, guardrail testing, quality metrics). Model enterprise knowledge as structured graphs and implement RAG/embedding capabilities for reliable customer-facing automation.
Location: Toronto
Workplace: Remote
Employment Type: Full time
Job Function: Data Science & Machine Learning
Seniority: Mid level

Key Responsibilities

  • •Design, build, and improve production-grade AI agentic systems for developing agents on Netomi’s core platform.
  • •Architect agent workflows covering reasoning, tool use, retrieval, guardrails, escalation paths, and performance monitoring.
  • •Evaluate agent orchestration patterns and frameworks (including Deep Agent, Claude Agent, OpenAI Agent, LangGraph) for new use cases.
  • •Build and maintain LLM evaluation systems such as LLM-as-judge workflows, regression evals, guardrail testing, quality metrics, and production behavior analysis.
  • •Design and implement RAG and embedding-based capabilities, and build scalable Python services deployed in AWS cloud environments.

Key Requirements

  • •Bachelor’s Degree or higher in a quantitative field (Statistics, Computer Science, Engineering, Mathematics).
  • •5-7+ years of experience in AI/ML engineering, applied machine learning, natural language processing, and/or AI systems development.
  • •2+ years of hands-on experience building production LLM or AI agent systems.
  • •Hands-on experience building production agents for external customers or enterprise/business users using LangGraph, LangChain, or similar orchestration frameworks.
  • •Experience building structured-output systems from messy, unstructured source material (schemas/ontologies/data contracts) including entity resolution, disambiguation, and conflict resolution.
Experience:5+ yearsAI/MLNatural language processingEnterprise automation
Education:Bachelor's
Skills:Engineering judgmentIndependent workComfort operating as a senior individual contributor
Tech Stack:PythonAWSLangGraphLangChainOpenAIClaudeRAGEmbeddingsLLM-as-judgeLLM evaluationRegression testingCodexClaude CodeCursor

Company Brief

Netomi
Provides an AI-powered customer service platform that automates conversational support across channels, using natural language understanding and automation to resolve customer issues, reduce contact center volume, and improve agent productivity.
Industry: SaaS
Company Size: Medium (51 to 250 employees)
Growth: Growth Stage Startup
Headquarters: San Francisco, United States
WebsiteLinkedIn