Principal AI Engineer - Context - Agents and Context

Elastic
Ireland
Workplace: HybridFull timeEUR 104,800 - 165,700 annuallyFunction: Data Science & Machine LearningExperience: 10+ yearsSkills: ["Evaluating performance","Diagnosing issues","Mentorship","Collaboration","Low-ego communication"]

Build and own the end-to-end improvement loop for the Context Engine, the knowledge layer that powers AI agents working with enterprise data in Elasticsearch. You’ll ship production code, design evaluation and telemetry, and help safely evolve agent behaviors via versioning, rollouts, regression coverage, and guardrails. Partner with data science, backend engineers, product, and UX to diagnose failure modes, measure outcomes, and raise engineering standards.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Elastic
Elastic
23 hours ago

Principal AI Engineer - Context - Agents and Context

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 8 hours agoStatus: Live

Job Summary

Build and own the end-to-end improvement loop for the Context Engine, the knowledge layer that powers AI agents working with enterprise data in Elasticsearch. You’ll ship production code, design evaluation and telemetry, and help safely evolve agent behaviors via versioning, rollouts, regression coverage, and guardrails. Partner with data science, backend engineers, product, and UX to diagnose failure modes, measure outcomes, and raise engineering standards.
Location: Ireland
Workplace: Hybrid
Employment Type: Full time
Job Function: Data Science & Machine Learning
Seniority: Mid level

Key Responsibilities

  • •Own the production improvement loop for Context Engine, analyzing extraction automations, retrieval tools, and memory using offline evaluations, telemetry, and customer conversations.
  • •Define safe iteration for agents and skills, including versioning/rollouts, regression coverage, staged/shadow evaluation, and behavioral guardrails.
  • •Design telemetry for agent traces, tool calls, and knowledge retrieval, and feed it into Elasticsearch-backed evaluation, dashboards, and feedback loops.
  • •Partner with data science to build evaluation strategies, including golden datasets and quality/latency/cost evaluators.
  • •Raise team standards through design/PR review, mentoring, and technical proposals that shape the roadmap.

Pay and Benefits

Salary: EUR 104,800 - 165,700 annually
Perks:Health InsurancePaid LeaveParental Leave

Key Requirements

  • •10+ years of software engineering experience shipping and operating AI-driven products on production traffic, ideally with public APIs and evolving data models.
  • •A track record of eval-driven product improvement: diagnose agent/LLM behavior from traces or user feedback, design evaluations, ship fixes, and measure outcomes.
  • •Direct experience building agents with state and memory, iterating on prompts/skills/tool behavior safely in production.
  • •Familiarity with MCP, including exposing public MCP servers and tools.
  • •Strong backend skills in Python or TypeScript (APIs, stateful workflows, data pipelines, and production services), with experience translating between measurement and shipping.
Experience:10+ yearsAI-driven productsEnterprise dataPublic APIs
Skills:Evaluating performanceDiagnosing issuesMentorshipCollaborationLow-ego communication
Tech Stack:TypeScriptPythonElasticsearchMCPAPILangChainClaude CodeLangGraphCrewAIClaude Agent SDK

Company Brief

Elastic
Builds the Elastic Stack (Elasticsearch, Kibana, Beats, Logstash) and provides search, observability, and security solutions that enable organizations to search, analyze, and protect data in real time across applications, infrastructure, and enterprises.
Industry: Data Infrastructure
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Amsterdam, Netherlands
Founded: 2012
WebsiteLinkedIn