Member of Technical Staff, Model Evaluation

The role focuses on designing and building evaluation metrics and scalable evaluation pipelines for large language models, to quantify quality, safety, reliability, and regression performance. You’ll create robust evaluation frameworks, conduct statistical analyses to identify failure modes, and translate real-world use cases into meaningful evaluation criteria, collaborating with product and customer teams to shape model evaluation at production scale.