Staff Software Engineer - ML Observability

DataDog
Boston, New York
Workplace: HybridFull timeUSD 234,000 - 300,000 annuallyFunction: Software EngineeringEducation: mastersSkills: ["Communication","Leadership","Problem-solving"]

Lead design and development of LLM observability features for Datadog's ML Observability product, shaping direction and driving experimentation. Build scalable backend systems, collaborate cross-functionally, and mentor engineers to deliver tools for tracing, evaluating, and debugging AI/ML workloads in production. Stay close to customer pain points and industry trends to push innovative, high-performance solutions.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
DataDog
DataDog
1 year ago

Staff Software Engineer - ML Observability

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 12 minutes agoStatus: Live

Job Summary

Lead design and development of LLM observability features for Datadog's ML Observability product, shaping direction and driving experimentation. Build scalable backend systems, collaborate cross-functionally, and mentor engineers to deliver tools for tracing, evaluating, and debugging AI/ML workloads in production. Stay close to customer pain points and industry trends to push innovative, high-performance solutions.
Location: Boston, New York
Workplace: Hybrid
Employment Type: Full time
Job Function: Software Engineering

Key Responsibilities

  • •Drive design and implementation of LLM observability features.
  • •Ideate, prototype, and scale new product features to provide insights and drive improvements for generative AI systems
  • •Work cross-functionally with other eng teams, product, UX, and applied science to iterate fast and find product-market fit
  • •Develop and extend tools for tracing, evaluating, and debugging LLMs
  • •Influence architecture decisions and mentor engineers to build resilient, high-performance systems

Pay and Benefits

Salary: USD 234,000 - 300,000 annually
Equity and Bonus:Equity
Perks:Health InsuranceDental401kEquityRemote WorkPaid LeaveGym Membership

Key Requirements

  • •BS/MS/PhD in Computer Science, Engineering or related scientific field (or equivalent experience)
  • •Deep understanding of distributed systems and scalable backend architectures
  • •Hands-on experience building and shipping LLM-powered or GenAI applications
  • •Understanding of model internals, inference pipelines, evaluation techniques, and prompt engineering
  • •Ability to thrive in ambiguous, fast-changing spaces and have a product-oriented mindset
Experience:AI/MLSaaSDistributed systems
Education:Master's in Computer Science
Skills:CommunicationLeadershipProblem-solving
Languages:English
Tech Stack:LLMsGenAIObservabilityDistributed systemsBackend architectures

Company Brief

DataDog
Provides a cloud-native monitoring and observability platform that unifies metrics, traces, logs, and security signals to help engineering, operations, and security teams monitor and troubleshoot modern applications and infrastructure.
Industry: Developer Tools
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: New York, United States
Founded: 2010
Glassdoor
Glassdoor: 4.1
WebsiteLinkedIn