Research Engineer, Benchmarks

Build and own rigorous benchmark suites to evaluate frontier AI agents on realistic, domain-specific tasks. Work with subject-matter experts to design tasks and scoring, implement benchmark infrastructure to run models reliably, and develop metrics that characterize difficulty, reliability, and failure modes. Validate benchmark relevance against real-world evals and customer expectations, and communicate results through clear technical documentation and benchmark reports.