2 days ago

Staff Frontier Agents Engineer (Applied AI)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 7 hours agoStatus: Live

Job Summary

Design and deploy production AI agents that blend frontier models with structured knowledge, retrieval, memory, and deterministic software. Own experimentation from hypothesis to rollout using offline benchmarks, online A/B tests, ablations, and LLM-as-a-judge, measuring success via business outcomes. Build reliable, observable, low-latency agent workflows with guardrails and human oversight, and partner directly with enterprise customers to translate ambiguous problems into scalable AI architectures.

Location: San Francisco, Seattle, New York

Workplace: Onsite

Employment Type: Full time

Job Function: Data Science & Machine Learning

Seniority: Mid level

Key Responsibilities

•Design and deploy production AI agents leveraging large language models, reasoning, retrieval, memory, and tool use.
•Architect reliable systems that combine LLMs, traditional machine learning, structured knowledge, enterprise data, and deterministic software into production workflows.
•Own the full experimentation lifecycle, including evaluation frameworks, ablation studies, and confidence/continuous learning systems using real-world feedback.
•Build production-quality agent guardrails, fallback strategies, tracing/monitoring, and evaluation pipelines to enable safe deployment.
•Partner directly with enterprise customers to understand business/data challenges, translate them into AI architectures, and evolve prototypes into scalable deployments.

Pay and Benefits

Salary: USD 252,000 - 315,000 annually

Equity and Bonus:Equity

Perks:Health InsuranceDentalVisionRetirement BenefitsLearning BudgetPaid LeaveCommuter Benefits

Key Requirements

•8+ years of software engineering, machine learning, or applied AI experience.
•Strong Python programming skills.
•Experience building production AI systems using large language models (LLMs).
•Experience with modern AI tooling, including OpenAI, Claude, MCP, agent frameworks, and vector databases/retrieval systems.
•Strong understanding of machine learning fundamentals and modern language models, including designing or evaluating AI systems with quantitative metrics.

Experience:8+ years

Skills:CommunicationCustomer collaboration

Languages:English

Tech Stack:PythonOpenAIClaudeMCPLLMsAgent frameworksVector databasesRetrieval systemsMachine learningA/B experimentsOffline benchmarksRegression suitesLLM-as-a-JudgeHuman evaluationObservabilityTracingMonitoringAWSAzureGCP

Company Brief

Scale AI

Provides data labeling, annotation, and infrastructure services to accelerate machine learning and AI development. Supplies high-quality training data, tooling, and APIs for customers in autonomous vehicles, mapping, robotics, and enterprise AI applications.

Industry: AI & Machine Learning

Company Size: Enterprise (1,001+ employees)

Growth: Scaleup

Valuation: Unicorn (USD 1B+)

Funding: Series E+

Headquarters: San Francisco, United States

Founded: 2016

Website LinkedIn

Loading job details...

Preparing the role view and application actions.

Scale AI

2 days ago

Staff Frontier Agents Engineer (Applied AI)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 7 hours agoStatus: Live

Job Summary

Location: San Francisco, Seattle, New York

Workplace: Onsite

Employment Type: Full time

Job Function: Data Science & Machine Learning

Seniority: Mid level

Key Responsibilities

•Design and deploy production AI agents leveraging large language models, reasoning, retrieval, memory, and tool use.
•Architect reliable systems that combine LLMs, traditional machine learning, structured knowledge, enterprise data, and deterministic software into production workflows.
•Own the full experimentation lifecycle, including evaluation frameworks, ablation studies, and confidence/continuous learning systems using real-world feedback.
•Build production-quality agent guardrails, fallback strategies, tracing/monitoring, and evaluation pipelines to enable safe deployment.
•Partner directly with enterprise customers to understand business/data challenges, translate them into AI architectures, and evolve prototypes into scalable deployments.

Pay and Benefits

Salary: USD 252,000 - 315,000 annually

Equity and Bonus:Equity

Perks:Health InsuranceDentalVisionRetirement BenefitsLearning BudgetPaid LeaveCommuter Benefits

Key Requirements

•8+ years of software engineering, machine learning, or applied AI experience.
•Strong Python programming skills.
•Experience building production AI systems using large language models (LLMs).
•Experience with modern AI tooling, including OpenAI, Claude, MCP, agent frameworks, and vector databases/retrieval systems.
•Strong understanding of machine learning fundamentals and modern language models, including designing or evaluating AI systems with quantitative metrics.

Experience:8+ years

Skills:CommunicationCustomer collaboration

Languages:English

Company Brief

Scale AI

Industry: AI & Machine Learning

Company Size: Enterprise (1,001+ employees)

Growth: Scaleup

Valuation: Unicorn (USD 1B+)

Funding: Series E+

Headquarters: San Francisco, United States

Founded: 2016

Website LinkedIn