Senior Machine Learning Engineer, Agent Oversight
Scale AI
San Francisco, New York
Workplace: OnsiteFull timeUSD 216,000 - 270,000 annuallyFunction: Data Science & Machine LearningExperience: 5+ yearsSkills: ["Experimentation","Collaboration","Mentoring","Statistical thinking","Cross-functional communication"]Own the end-to-end lifecycle of production agent reliability and continuous improvement. Build observability to understand agent behavior in production, design evaluation methodologies and scalable metrics, and develop ML systems that detect drift, anomalies, and misalignment. Run rigorous experiments to validate improvements before deployment, working with software engineers and product, customers, and other teams to translate enterprise and government requirements into dependable platform capabilities.

