Principal Machine Learning Engineer

Atlassian
Seattle
Workplace: RemoteFull timeUSD 196,461 - 309,025 annuallyFunction: Data Science & Machine LearningSkills: ["Technical leadership","Mentorship","Communication","Product judgment","Cross-functional collaboration"]

Lead Rovo Chat’s ML and evaluation efforts, translating product qualities like helpfulness, correctness, judgment, and reliability into rigorous, scalable measurement systems. Architect and build production ML pipelines, datasets, automated judges, regression and experimentation platforms, and online quality signals. Drive agentic capabilities across reasoning, planning, tool use, retrieval, memory, and long-horizon execution, closing the loop between evaluation failures and shipped product impact.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Atlassian
Atlassian
1 day ago

Principal Machine Learning Engineer

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 21 hours agoStatus: Live

Job Summary

Lead Rovo Chat’s ML and evaluation efforts, translating product qualities like helpfulness, correctness, judgment, and reliability into rigorous, scalable measurement systems. Architect and build production ML pipelines, datasets, automated judges, regression and experimentation platforms, and online quality signals. Drive agentic capabilities across reasoning, planning, tool use, retrieval, memory, and long-horizon execution, closing the loop between evaluation failures and shipped product impact.
Location: Seattle
Workplace: Remote
Employment Type: Full time
Job Function: Data Science & Machine Learning
Seniority: Mid level

Key Responsibilities

  • •Set technical vision for how Rovo Chat is evaluated and improved using rigorous, measurable strategies
  • •Architect and build production ML and evaluation systems at scale, including datasets, simulations, automated judges, regression suites, and experimentation platforms
  • •Advance agentic capabilities across reasoning, planning, tool selection and use, action correctness, retrieval, memory, and long-horizon execution
  • •Identify systemic failure modes, develop interventions, ship them to production, and measure impact on customer outcomes
  • •Drive high-leverage technical decisions across model choice, prompting, fine-tuning, data strategy, system architecture, and inference while balancing quality, latency, reliability, safety, and cost

Pay and Benefits

Salary: USD 196,461 - 309,025 annually
Perks:Volunteer Days

Key Requirements

  • •7+ years of experience as a software developer
  • •Track record architecting and shipping large-scale ML or AI systems with measurable customer and business impact
  • •Deep experience with LLM-powered products, agentic systems, model evaluation, experimentation, and dataset development
  • •Strong production engineering skills with the ability to remain hands-on in a modern ML stack
  • •Principal-level technical leadership, with experience leading and supporting senior engineers and working cross-functionally
Experience:MLAI
Skills:Technical leadershipMentorshipCommunicationProduct judgmentCross-functional collaboration
Tech Stack:LLMsLLM-powered productsAgentic systemsModel evaluationExperimentationDatasets

Company Brief

Atlassian
Atlassian develops collaboration and workflow software—Jira, Confluence, Trello, Loom and more—used by teams for project management, software development, and IT service management across enterprises worldwide.
Industry: Developer Tools
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Sydney, Australia
Founded: 2002
Glassdoor
Glassdoor: 3.1
WebsiteLinkedInGlassdoor