Staff Applied Scientist - Dashboards

DataDog
New York
Workplace: HybridFull timeUSD 276,000 - 345,000 annuallyFunction: Research & Scientific (R&D)Experience: 10+ yearsSkills: []

Lead evaluation and measurement for Datadog’s Dashboards AI system at scale. Define offline/online metrics, build eval datasets and regression tests, improve retrieval relevance and tool selection, and provide cross-team technical leadership to deliver high-quality, measurable AI-driven dashboard experiences.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
DataDog
DataDog
3 months ago

Staff Applied Scientist - Dashboards

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 10 hours agoStatus: Live

Job Summary

Lead evaluation and measurement for Datadog’s Dashboards AI system at scale. Define offline/online metrics, build eval datasets and regression tests, improve retrieval relevance and tool selection, and provide cross-team technical leadership to deliver high-quality, measurable AI-driven dashboard experiences.
Location: New York
Workplace: Hybrid
Employment Type: Full time
Job Function: Research & Scientific (R&D)

Key Responsibilities

  • •Define the evaluation strategy for Dashboards and related teams, identifying offline/online, quality, cost, and usage metrics to optimize across the organization.
  • •Build evaluation datasets, golden traces, and regression harnesses to detect quality changes before affecting customers and enable reuse across teams.
  • •Drive improvements in retrieval relevance, tool-selection accuracy, and context efficiency, in collaboration with engineers.
  • •Provide technical leadership through design reviews, working groups, and mentorship across the Dashboards team and broader organization.

Pay and Benefits

Salary: USD 276,000 - 345,000 annually
Equity and Bonus:Equity
Perks:RsusEsppHealth Insurance401kParental Planning

Key Requirements

  • •BS/MS/PhD in a scientific field or equivalent experience;
  • •10+ years of relevant engineering or applied science experience, including time as a technical lead;
  • •Proven track record of leading ML or GenAI initiatives in a product-driven environment, from research through production;
  • •Significant experience with evaluation, experimentation, or measurement of ML systems at scale;
  • •Strong product mindset and ability to drive initiatives across cross-functional teams;
Experience:10+ yearsAI/MLGenAIProduct developmentObservability
Languages:English
Tech Stack:MLEvaluationRegression harnessesRetrievalTool-selection

Company Brief

DataDog
Provides a cloud-native monitoring and observability platform that unifies metrics, traces, logs, and security signals to help engineering, operations, and security teams monitor and troubleshoot modern applications and infrastructure.
Industry: Developer Tools
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: New York, United States
Founded: 2010
Glassdoor
Glassdoor: 4.1
WebsiteLinkedIn