DataDog

1 month ago

Staff Applied Scientist - Dashboards

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 17 hours agoStatus: Live

Job Summary

Lead evaluation and measurement for Datadog’s Dashboards AI system at scale. Define offline/online metrics, build eval datasets and regression tests, improve retrieval relevance and tool selection, and provide cross-team technical leadership to deliver high-quality, measurable AI-driven dashboard experiences.

Location: New York

Workplace: Hybrid

Employment Type: Full time

Job Function: Research & Scientific (R&D)

Key Responsibilities

•Define the evaluation strategy for Dashboards and related teams, identifying offline/online, quality, cost, and usage metrics to optimize across the organization.
•Build evaluation datasets, golden traces, and regression harnesses to detect quality changes before affecting customers and enable reuse across teams.
•Drive improvements in retrieval relevance, tool-selection accuracy, and context efficiency, in collaboration with engineers.
•Provide technical leadership through design reviews, working groups, and mentorship across the Dashboards team and broader organization.

Pay and Benefits

Salary: USD 276,000 - 345,000 annually

Equity and Bonus:Equity

Perks:RsusEsppHealth Insurance401kParental Planning

Key Requirements

•BS/MS/PhD in a scientific field or equivalent experience;
•10+ years of relevant engineering or applied science experience, including time as a technical lead;
•Proven track record of leading ML or GenAI initiatives in a product-driven environment, from research through production;
•Significant experience with evaluation, experimentation, or measurement of ML systems at scale;
•Strong product mindset and ability to drive initiatives across cross-functional teams;

Experience:10+ yearsAI/MLGenAIProduct developmentObservability

Languages:English

Tech Stack:MLEvaluationRegression harnessesRetrievalTool-selection

Company Brief

DataDog

Provides a cloud-native monitoring and observability platform that unifies metrics, traces, logs, and security signals to help engineering, operations, and security teams monitor and troubleshoot modern applications and infrastructure.

Industry: Developer Tools

Company Size: Enterprise (1,001+ employees)

Revenue: USD 1B+

Growth: Public Company

Valuation: Public Company (Market Cap in USD)

Funding: IPO / Publicly Listed

Headquarters: New York, United States

Founded: 2010

Glassdoor: 4.1

Website LinkedIn

Loading job details...

Preparing the role view and application actions.

DataDog

1 month ago

Staff Applied Scientist - Dashboards

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 17 hours agoStatus: Live

Job Summary

Location: New York

Workplace: Hybrid

Employment Type: Full time

Job Function: Research & Scientific (R&D)

Key Responsibilities

•Define the evaluation strategy for Dashboards and related teams, identifying offline/online, quality, cost, and usage metrics to optimize across the organization.
•Build evaluation datasets, golden traces, and regression harnesses to detect quality changes before affecting customers and enable reuse across teams.
•Drive improvements in retrieval relevance, tool-selection accuracy, and context efficiency, in collaboration with engineers.
•Provide technical leadership through design reviews, working groups, and mentorship across the Dashboards team and broader organization.

Pay and Benefits

Salary: USD 276,000 - 345,000 annually

Equity and Bonus:Equity

Perks:RsusEsppHealth Insurance401kParental Planning

Key Requirements

•BS/MS/PhD in a scientific field or equivalent experience;
•10+ years of relevant engineering or applied science experience, including time as a technical lead;
•Proven track record of leading ML or GenAI initiatives in a product-driven environment, from research through production;
•Significant experience with evaluation, experimentation, or measurement of ML systems at scale;
•Strong product mindset and ability to drive initiatives across cross-functional teams;

Experience:10+ yearsAI/MLGenAIProduct developmentObservability

Languages:English

Tech Stack:MLEvaluationRegression harnessesRetrievalTool-selection

Company Brief

DataDog

Industry: Developer Tools

Company Size: Enterprise (1,001+ employees)

Revenue: USD 1B+

Growth: Public Company

Valuation: Public Company (Market Cap in USD)

Funding: IPO / Publicly Listed

Headquarters: New York, United States

Founded: 2010

Glassdoor: 4.1

Website LinkedIn