Frontier Agents Engineer (Applied AI)

Scale AI
San Francisco, Seattle, New York
Workplace: OnsiteFull timeUSD 180,000 - 225,000 annuallyFunction: Data Science & Machine LearningExperience: 4+ yearsSkills: ["Communication","Customer collaboration"]

Design and deploy production AI agents that combine frontier large language models with retrieval, memory, structured knowledge, and deterministic enterprise software. Own experimentation and evaluation using offline benchmarks, online A/B tests, and human judgment to measure real business impact. Build safe, reliable systems with observability and guardrails, and collaborate with infrastructure and enterprise customers to translate ambiguous problems into scalable AI architectures across multiple industries.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Scale AI
Scale AI
1 month ago

Frontier Agents Engineer (Applied AI)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 7 hours agoStatus: Live

Job Summary

Design and deploy production AI agents that combine frontier large language models with retrieval, memory, structured knowledge, and deterministic enterprise software. Own experimentation and evaluation using offline benchmarks, online A/B tests, and human judgment to measure real business impact. Build safe, reliable systems with observability and guardrails, and collaborate with infrastructure and enterprise customers to translate ambiguous problems into scalable AI architectures across multiple industries.
Location: San Francisco, Seattle, New York
Workplace: Onsite
Employment Type: Full time
Job Function: Data Science & Machine Learning
Seniority: Mid level

Key Responsibilities

  • •Design and deploy production AI agents using LLMs, reasoning, retrieval, memory, and tool use.
  • •Architect reliable production workflows that combine LLMs, traditional ML, structured knowledge, enterprise data, and deterministic software.
  • •Own the experimentation lifecycle, including evaluation framework design and controlled experiments with ablation studies.
  • •Build production-quality systems emphasizing reliability, observability, latency, safety, and cost, including guardrails and monitoring.
  • •Partner with enterprise customers to translate business and data challenges into scalable AI architectures and prototypes.

Pay and Benefits

Salary: USD 180,000 - 225,000 annually
Equity and Bonus:Equity
Perks:Health InsuranceDentalVisionRetirement BenefitsLearning BudgetPaid LeaveCommuter Benefits

Key Requirements

  • •4+ years of software engineering, machine learning, or applied AI experience.
  • •Strong Python programming skills.
  • •Experience building production AI systems using LLMs.
  • •Experience with modern AI tooling, including OpenAI, Claude, MCP, agent frameworks, and retrieval/vector databases.
  • •Strong understanding of machine learning fundamentals and modern language models, including designing or evaluating AI systems with quantitative metrics.
Experience:4+ yearsAIMachine learningApplied AIEnterprise software
Skills:CommunicationCustomer collaboration
Tech Stack:PythonLarge language modelsLLMsOpenAIClaudeMCPAgent frameworksVector databasesRetrieval systemsA/B experimentsDockerKubernetesCI/CDAWSAzureGCPObservabilityLLM-as-a-JudgeRAGKnowledge graphs

Company Brief

Scale AI
Provides data labeling, annotation, and infrastructure services to accelerate machine learning and AI development. Supplies high-quality training data, tooling, and APIs for customers in autonomous vehicles, mapping, robotics, and enterprise AI applications.
Industry: AI & Machine Learning
Company Size: Enterprise (1,001+ employees)
Growth: Scaleup
Valuation: Unicorn (USD 1B+)
Funding: Series E+
Headquarters: San Francisco, United States
Founded: 2016
WebsiteLinkedIn