AI Engineer

Ditto
Atlanta, San Francisco
Workplace: RemoteFull timeUSD 223,000 - 259,000 annuallyFunction: Data Science & Machine LearningExperience: 5+ yearsSkills: ["Ownership","Communication","Navigating ambiguity","Curiosity","Adaptability","Grit"]

Build the agent execution runtime and typed tool surface that power reliable, real-time application behavior, turning prompts into measurable agent runs. Own the evaluation loop, telemetry, and benchmarks that quantify quality, cost, and latency—then use those signals to tune prompts, topology, and routing. Work across hosted and on-prem serving, focusing on debuggability, sandboxed execution, and end-to-end system ownership for engineer users.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Ditto
Ditto
1 day ago

AI Engineer

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 8 hours agoStatus: Live

Job Summary

Build the agent execution runtime and typed tool surface that power reliable, real-time application behavior, turning prompts into measurable agent runs. Own the evaluation loop, telemetry, and benchmarks that quantify quality, cost, and latency—then use those signals to tune prompts, topology, and routing. Work across hosted and on-prem serving, focusing on debuggability, sandboxed execution, and end-to-end system ownership for engineer users.
Location: Atlanta, San Francisco
Workplace: Remote
Employment Type: Full time
Job Function: Data Science & Machine Learning
Seniority: Mid level

Key Responsibilities

  • •Design and ship the agent execution runtime that compiles briefs into running multi-agent teams, including topology, handoffs, deterministic gates, message bus, session lifecycle, and recovery behavior.
  • •Create typed, versioned toolpacks backed by reviewed repository recipes, with sandboxed execution boundaries and safe MCP server integrations.
  • •Build evals, benchmarks, and metric sets to score runs, instrument per-phase timing and structured error taxonomies, and tune prompts/topology based on measurable signal.
  • •Own the model substrate as a swappable input by binding briefs to capability classes, working with routing/inference across hosted and on-prem serving, and tuning context/caching/model selection for cost/latency/accuracy.
  • •Partner with engineering teams to translate workflows into trusted briefs, establish reusable patterns, and mentor engineers as agentic development becomes standard.

Pay and Benefits

Salary: USD 223,000 - 259,000 annually
Perks:Health InsuranceDentalVisionLife InsuranceDisability Insurance401kRemote Work

Key Requirements

  • •5+ years of professional software engineering experience building and operating LLM-backed systems in production (not prototypes).
  • •Hands-on depth with agentic systems including tool/function calling, multi-agent orchestration, and prompt/context engineering with structured outputs.
  • •Strong developer-tooling instincts (CLIs, build systems, CI/CD, internal platforms) and empathy for fast daily iteration loops.
  • •A rigorous approach to evaluation, with experience building evals or benchmarks and using measurement to guide decisions.
  • •Strong Python experience (async, typed interfaces, Pydantic or similar) plus systems fundamentals for debugging across a polyglot codebase.
Experience:5+ yearsLLM-backed systemsDeveloper toolingAgentic systemsStartup environments
Skills:OwnershipCommunicationNavigating ambiguityCuriosityAdaptabilityGrit
Tech Stack:PythonAsyncPydanticLLMOpenTelemetryVLLMMCPRustSwiftKotlin

Company Brief

Ditto
Offers online trademark search, filing, monitoring, and portfolio management services to help startups and businesses register, protect, and enforce trademarks globally through a cost-effective, attorney-supported web platform with automated workflows.
Industry: LegalTech
Website