Member of Engineering (Evaluations)

Design and implement infrastructure and tooling to support evaluations and benchmarks for Large Language Models, collaborating with applied research and product teams to define meaningful metrics that capture progress on real-world software development skills. You will work on base model and instruction-following evaluations, contribute to multi-language engineering efforts, and help shape the evaluation framework used by researchers and engineers.