Research Scientist, AI Controls and Monitoring

Scale AI
San Francisco, New York
Workplace: OnsiteFull-timeUSD 197,400 - 246,750 annuallyFunction: Data Science & Machine LearningExperience: 3+ yearsSkills: ["Communication","Collaboration","Writing","Problem-solving"]

Join Scale Labs as a Research Scientist focused on AI controls and monitoring, designing experiments and real-time observability for advanced AI systems. You’ll develop layered control mechanisms, run red-team simulations, and collaborate with policymakers, engineers, and researchers to establish standards for AI monitoring and escalation, contributing to safe, secure, and trustworthy AI deployments at scale.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Scale AI
Scale AI
4 months ago

Research Scientist, AI Controls and Monitoring

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 17 hours agoStatus: Live

Job Summary

Join Scale Labs as a Research Scientist focused on AI controls and monitoring, designing experiments and real-time observability for advanced AI systems. You’ll develop layered control mechanisms, run red-team simulations, and collaborate with policymakers, engineers, and researchers to establish standards for AI monitoring and escalation, contributing to safe, secure, and trustworthy AI deployments at scale.
Location: San Francisco, New York
Workplace: Onsite
Job Function: Data Science & Machine Learning

Key Responsibilities

  • •Design methods, systems, and experiments to ensure AI models and agents stay aligned with intended goals in high-stakes or adversarial environments.
  • •Develop monitoring techniques and observability methods that track AI behavior in real time to identify deviations or anomalous outputs.
  • •Research layered control mechanisms including fail-safes, oversight protocols, and intervention methods to halt or redirect AI systems when risks are detected.
  • •Design red-team simulations to probe oversight weaknesses and build mitigations to close identified gaps.
  • •Collaborate with policymakers, engineers, and researchers to establish standards and benchmarks for AI monitoring and escalation.

Pay and Benefits

Salary: USD 197,400 - 246,750 annually
Perks:Health InsuranceDentalVisionRetirement BenefitsLearning BudgetPaid LeaveCommuter Benefits

Key Requirements

  • •At least three years of experience addressing sophisticated ML problems, whether in a research setting or in product development.
  • •Practical experience conducting technical research collaboratively, comfortable designing control and monitoring experiments for AI systems, building prototype systems, and turning ideas into working prototypes.
  • •A track record of published research in machine learning, particularly in generative AI.
  • •Strong written and verbal communication skills to operate in a cross-functional team.
  • •Experience researching AI controls and monitoring or related areas (e.g., scalable oversight, interpretability, debate) is a plus.
Experience:3+ yearsMachine learningAI research
Skills:CommunicationCollaborationWritingProblem-solving
Languages:English
Tech Stack:Machine learningRLHFDPOGRPORL techniquesMonitoringObservability

Company Brief

Scale AI
Provides data labeling, annotation, and infrastructure services to accelerate machine learning and AI development. Supplies high-quality training data, tooling, and APIs for customers in autonomous vehicles, mapping, robotics, and enterprise AI applications.
Industry: AI & Machine Learning
Company Size: Enterprise (1,001+ employees)
Growth: Scaleup
Valuation: Unicorn (USD 1B+)
Funding: Series E+
Headquarters: San Francisco, United States
Founded: 2016
WebsiteLinkedIn