Senior Machine Learning Engineer

Atlassian
San Francisco
Workplace: HybridFull timeUSD 171,063 - 269,075 annuallyFunction: Data Science & Machine LearningSkills: ["Technical leadership","Hands-on problem solving","Product judgment","Mentorship","Cross-functional collaboration","Communication"]

Build and scale production ML systems that evaluate and improve Rovo’s agentic capabilities, including reasoning, planning, tool selection, retrieval, memory, and long-horizon execution. Architect evaluation pipelines—datasets, simulations, automated judges, regression suites, experimentation platforms, and online quality signals—and close the loop from failure modes to production interventions. Lead cross-org technical initiatives and mentor engineers to raise quality standards across AI-powered Atlassian experiences.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Atlassian
Atlassian
1 day ago

Senior Machine Learning Engineer

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 23 hours agoStatus: Live

Job Summary

Build and scale production ML systems that evaluate and improve Rovo’s agentic capabilities, including reasoning, planning, tool selection, retrieval, memory, and long-horizon execution. Architect evaluation pipelines—datasets, simulations, automated judges, regression suites, experimentation platforms, and online quality signals—and close the loop from failure modes to production interventions. Lead cross-org technical initiatives and mentor engineers to raise quality standards across AI-powered Atlassian experiences.
Location: San Francisco
Workplace: Hybrid
Employment Type: Full time
Job Function: Data Science & Machine Learning
Seniority: Mid level

Key Responsibilities

  • •Architect and build production ML and evaluation systems at scale, including datasets, simulations, automated judges, regression suites, experimentation platforms, and online quality signals.
  • •Advance Rovo’s agentic capabilities across reasoning, planning, tool selection and use, action correctness, retrieval, memory, and long-horizon execution.
  • •Identify systemic failure modes, develop interventions, ship them to production, and measure improvements to customer outcomes.
  • •Make high-leverage technical decisions spanning model choice, prompting, fine-tuning, data strategy, system architecture, and inference—balancing quality, latency, reliability, safety, and cost.
  • •Lead cross-organizational initiatives and multiply impact through mentorship, design reviews, and reusable quality standards.

Pay and Benefits

Salary: USD 171,063 - 269,075 annually

Key Requirements

  • •Architect and ship large-scale ML/AI systems that deliver measurable customer and business impact.
  • •Have deep experience with LLM-powered products, agentic systems, model evaluation, experimentation, and dataset development.
  • •Demonstrate strong production engineering skills with the ability to stay hands-on in a modern ML stack.
  • •Provide technical leadership by setting direction, influencing across teams, and leading complex initiatives from ambiguity to production.
  • •Show excellent product and technical judgment balancing quality, speed, reliability, safety, latency, and cost.
Experience:AILLMAgentic systemsMachine learning
Skills:Technical leadershipHands-on problem solvingProduct judgmentMentorshipCross-functional collaborationCommunication
Tech Stack:LLM-poweredAgentic systemsModel evaluationExperimentationDatasetsRetrievalMemoryInferencePromptingFine-tuningData strategyModel choiceExperimentation platformRegression suitesOnline quality signalsAutomated judgesSimulations

Company Brief

Atlassian
Atlassian develops collaboration and workflow software—Jira, Confluence, Trello, Loom and more—used by teams for project management, software development, and IT service management across enterprises worldwide.
Industry: Developer Tools
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Sydney, Australia
Founded: 2002
Glassdoor
Glassdoor: 3.1
WebsiteLinkedInGlassdoor