Staff Applied Scientist - Agentic Interfaces

Define and implement the evaluation framework for Datadog’s AI agent integrations. Build metrics, datasets, and regression harnesses to measure quality, cost, and end-to-end agent performance, driving improvements in retrieval relevance and tool selection across cross-functional teams in a product-driven AI environment.