Senior Frontier Agents Engineer (Applied AI)

Scale AI
San Francisco, Seattle, New York
Workplace: OnsiteFull timeUSD 216,000 - 270,000 annuallyFunction: Data Science & Machine LearningExperience: 5+ yearsSkills: ["Communication","Collaboration","Experimentation","Customer focus"]

Design and deploy production AI agents that combine frontier large language models with retrieval, memory, reasoning, and enterprise software. Own experimentation end-to-end—from offline benchmarks and A/B tests to ablation studies and LLM-as-a-Judge evaluations—and translate research advances into reliable, safe, low-latency systems. Partner directly with enterprise customers to turn ambiguous business needs into agent architectures and measurable business outcomes across diverse industries.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Scale AI
Scale AI
1 month ago

Senior Frontier Agents Engineer (Applied AI)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 5 hours agoStatus: Live

Job Summary

Design and deploy production AI agents that combine frontier large language models with retrieval, memory, reasoning, and enterprise software. Own experimentation end-to-end—from offline benchmarks and A/B tests to ablation studies and LLM-as-a-Judge evaluations—and translate research advances into reliable, safe, low-latency systems. Partner directly with enterprise customers to turn ambiguous business needs into agent architectures and measurable business outcomes across diverse industries.
Location: San Francisco, Seattle, New York
Workplace: Onsite
Employment Type: Full time
Job Function: Data Science & Machine Learning
Seniority: Mid level

Key Responsibilities

  • •Design and deploy production AI agents using LLMs, reasoning, retrieval, memory, and tool use.
  • •Architect systems that combine LLMs, traditional ML, structured knowledge, enterprise data, and deterministic software into reliable workflows.
  • •Own experimentation and evaluation lifecycle, including offline benchmarks, online A/B tests, golden datasets, regression suites, and human evaluation.
  • •Build production AI systems with reliability, observability, latency, safety, and cost controls, including guardrails and monitoring.
  • •Partner with enterprise customers to translate ambiguous problems into AI architectures and prototypes that evolve into scalable production deployments.

Pay and Benefits

Salary: USD 216,000 - 270,000 annually
Perks:Health InsuranceDentalVisionRetirement BenefitsLearning BudgetPaid Leave

Key Requirements

  • •5+ years of software engineering, machine learning, or applied AI experience.
  • •Strong Python programming skills.
  • •Experience building production AI systems using LLMs.
  • •Experience with modern AI tooling such as OpenAI, Claude, MCP, agent frameworks, vector databases, or retrieval systems.
  • •Strong understanding of ML fundamentals and experience designing/evaluating AI systems using quantitative metrics.
Experience:5+ yearsApplied AIEnterprise AILLMs
Skills:CommunicationCollaborationExperimentationCustomer focus
Languages:English
Tech Stack:PythonLLMsOpenAIClaudeMCPAgent frameworksVector databasesRetrieval systemsA/B experimentsLLM-as-a-JudgeAWSAzureGCPDockerKubernetesCI/CDObservabilityRAGSemantic searchKnowledge graphs

Company Brief

Scale AI
Provides data labeling, annotation, and infrastructure services to accelerate machine learning and AI development. Supplies high-quality training data, tooling, and APIs for customers in autonomous vehicles, mapping, robotics, and enterprise AI applications.
Industry: AI & Machine Learning
Company Size: Enterprise (1,001+ employees)
Growth: Scaleup
Valuation: Unicorn (USD 1B+)
Funding: Series E+
Headquarters: San Francisco, United States
Founded: 2016
WebsiteLinkedIn