Principal AI Engineer - Context - Agents and Context

Elastic
Canada
Workplace: HybridFull timeCAD 154,000 - 243,600 annuallyFunction: Data Science & Machine LearningSkills: ["Low-ego","Mentorship","Eval-driven development","Cross-functional communication","Trade-off communication"]

Own the end-to-end improvement loop for a Context Engine that powers AI agents working on enterprise data in Elasticsearch. Build and ship production code while designing offline evaluations, telemetry, and safe rollout/guardrails for prompts, skills, and automations. Partner with data science and product to diagnose agent behavior from traces, run experiments, and raise the engineering bar so customer agent experiences improve continuously.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Elastic
Elastic
23 hours ago

Principal AI Engineer - Context - Agents and Context

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 8 hours agoStatus: Live

Job Summary

Own the end-to-end improvement loop for a Context Engine that powers AI agents working on enterprise data in Elasticsearch. Build and ship production code while designing offline evaluations, telemetry, and safe rollout/guardrails for prompts, skills, and automations. Partner with data science and product to diagnose agent behavior from traces, run experiments, and raise the engineering bar so customer agent experiences improve continuously.
Location: Canada
Workplace: Hybrid
Employment Type: Full time
Job Function: Data Science & Machine Learning
Seniority: Mid level

Key Responsibilities

  • •Own the production improvement loop for Context Engine, diagnosing failure modes and proving fixes.
  • •Define safe iteration of prompts, skills, and automations via versioning, rollout, regression coverage, staged/shadow evaluations, and guardrails.
  • •Design telemetry from agent traces, tool calls, and retrieval/knowledge flows and connect it to evaluation and feedback dashboards.
  • •Partner with data science on evaluation strategy, including golden datasets and evaluators for quality, latency, and cost gates.
  • •Review designs and PRs, mentor engineers in eval-driven development, and write technical proposals shaping the roadmap.

Pay and Benefits

Salary: CAD 154,000 - 243,600 annually
Equity and Bonus:Equity
Perks:Health InsuranceEquityRrsp MatchingParental LeaveVolunteer Time

Key Requirements

  • •10+ years of software engineering experience, shipping and operating AI-driven products on real production traffic.
  • •Track record of eval-driven improvement: diagnose agent/LLM behavior from traces and feedback, design evaluations, ship fixes, and measure outcomes.
  • •Direct experience building agents with state and memory, and iterating on prompts/skills/tool behavior safely in production.
  • •Familiarity with MCP, including exposing public MCP servers and tools.
  • •Backend skills in Python or TypeScript (APIs, stateful workflows, data pipelines, and production services).
Experience:AI-driven productsLLM/agent systemsEnterprise softwarePublic APIsProduction telemetry
Skills:Low-egoMentorshipEval-driven developmentCross-functional communicationTrade-off communication
Languages:English
Tech Stack:TypeScriptPythonElasticsearchAPIsMCPLangChainClaude CodeLangGraphCrewAIClaude Agent SDKTelemetryDashboards

Company Brief

Elastic
Builds the Elastic Stack (Elasticsearch, Kibana, Beats, Logstash) and provides search, observability, and security solutions that enable organizations to search, analyze, and protect data in real time across applications, infrastructure, and enterprises.
Industry: Data Infrastructure
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Amsterdam, Netherlands
Founded: 2012
WebsiteLinkedIn