Engineering Manager - (ML) - Evaluation Platform

Canva
Sydney
Workplace: HybridFull timeFunction: Software EngineeringSkills: ["Technical people leadership","Mentorship","Stakeholder management","First principles thinking","Problem-solving"]

Lead the Evaluation Platform team within Canva’s AI Platform Group, owning the end-to-end evaluation lifecycle for generative AI features—from test-like evals and Arena comparative evaluation to monitoring and human labelling tooling. Drive consolidation and growth while coaching a team of 9+ engineers, partnering with AI feature teams and CORE research, and delivering large cross-team initiatives that make rigorous evaluation the default across Canva.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Canva
Canva
1 day ago

Engineering Manager - (ML) - Evaluation Platform

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 18 hours agoStatus: Live

Job Summary

Lead the Evaluation Platform team within Canva’s AI Platform Group, owning the end-to-end evaluation lifecycle for generative AI features—from test-like evals and Arena comparative evaluation to monitoring and human labelling tooling. Drive consolidation and growth while coaching a team of 9+ engineers, partnering with AI feature teams and CORE research, and delivering large cross-team initiatives that make rigorous evaluation the default across Canva.
Location: Sydney
Workplace: Hybrid
Employment Type: Full time
Job Function: Software Engineering
Seniority: Manager level

Key Responsibilities

  • •Coach, mentor, and grow a team of 9+ engineers, providing regular practical feedback and supporting personal growth goals.
  • •Own and evolve the evaluation platform strategy by consolidating test-like evals, Arena comparative evaluation, monitoring evals, and labelling tooling into a coherent platform.
  • •Partner with AI feature teams and CORE leadership to understand roadmaps and identify evaluation capabilities needed for upcoming initiatives.
  • •Coordinate with adjacent platform teams and the evaluation programme PM to ensure a seamless experience across the full ML lifecycle.
  • •Drive delivery of large cross-team initiatives from ideation to completion, planning goals and success metrics aligned across company, group, and team.

Pay and Benefits

Perks:EquityParental LeaveWellness Stipend

Key Requirements

  • •History of success in technical people leadership, mentoring, and growing engineers (including senior/staff-level ICs).
  • •Experience with ML evaluation, LLM systems, or ML platform engineering, with credibility across researchers and engineers.
  • •Experience designing and building complex distributed systems, ideally involving machine learning.
  • •Strong stakeholder management across multiple internal customer teams, including negotiating scope boundaries with adjacent teams.
  • •Excellent written and verbal communication skills, plus problem-solving to break down large projects and deliver through others.
Experience:Generative AIML evaluationML platform engineering
Skills:Technical people leadershipMentorshipStakeholder managementFirst principles thinkingProblem-solving
Languages:English
Tech Stack:Machine LearningLLM systemsDistributed systemsEvaluation platformArena

Company Brief

Canva
Canva is an online visual communications platform that provides drag-and-drop design tools, templates, and media assets for creating presentations, social media graphics, videos, documents and more, serving individuals and large enterprises globally.
Industry: Enterprise Software
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Scaleup
Valuation: Decacorn (USD 10B+)
Funding: Series E+
Headquarters: Surry Hills, New South Wales, Australia
Founded: 2012
Glassdoor
Glassdoor: 3.9
WebsiteLinkedInGlassdoor