AI Inference Tools Engineer

Modular
Edinburgh, Canada
Workplace: HybridFull timeUSD 167,000 - 242,000 annuallyFunction: Data Science & Machine LearningSkills: ["Communication","Independent work","User-focused mindset","Distributed collaboration"]

Build developer tooling for an AI inference stack, enhancing the MAX framework experience from profiling and tracing to debuggers and performance dashboards. Create agent-native tools that humans and AI agents use to bring up models, triage issues, and optimize based on real workloads. Strengthen tooling interfaces across MAX, Mojo, and driver APIs, collaborating closely with kernel, model, and serving engineers in a distributed team.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Modular
Modular
1 day ago

AI Inference Tools Engineer

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 18 hours agoStatus: Live

Job Summary

Build developer tooling for an AI inference stack, enhancing the MAX framework experience from profiling and tracing to debuggers and performance dashboards. Create agent-native tools that humans and AI agents use to bring up models, triage issues, and optimize based on real workloads. Strengthen tooling interfaces across MAX, Mojo, and driver APIs, collaborating closely with kernel, model, and serving engineers in a distributed team.
Location: Edinburgh, Canada
Workplace: Hybrid
Employment Type: Full time
Job Function: Data Science & Machine Learning

Key Responsibilities

  • •Enhance the MAX developer experience by creating tools for traditional and agentic workflows and surfacing data across the AI stack.
  • •Design, build, and maintain profiling/tracing tools, debuggers, and metrics dashboards to monitor performance and health of MAX deployments.
  • •Create agent-native tooling for humans and AI agents, including writing agents to bring up models, triage issues, and profile/optimize workloads.
  • •Connect MAX tools across the stack by strengthening interfaces between MAX, Mojo, and driver APIs and integrating tool use with orchestration layers.
  • •Collaborate on design discussions and code reviews, working directly with kernel, model, and serving engineers to turn pain points into better tools.

Pay and Benefits

Salary: USD 167,000 - 242,000 annually
Equity and Bonus:Equity
Perks:Health Insurance401k MatchingPaid LeaveEquityRelocation

Key Requirements

  • •Experience designing, building, and shipping developer tools, developer infrastructure, or observability systems other engineers rely on.
  • •Fluency in one or more systems/performance languages (C++, Rust, Go) and one or more user-facing languages (Python; Mojo familiarity is a plus).
  • •Experience measuring software performance via profiling, tracing, or benchmarking, and ability to analyze results.
  • •Clear written communication and the ability to work independently in a distributed team.
  • •A user-focused mindset that prioritizes what makes tools more productive for their users.
Skills:CommunicationIndependent workUser-focused mindsetDistributed collaboration
Tech Stack:MAXMojoC++RustGoPythonPyTorchJAXTensorFlowNsight SystemsNsight ComputeRocprofPerfettoCUDAROCmMCP

Company Brief

Modular
Provides infrastructure and developer tools to build, deploy, and scale large AI models and foundation-model applications, including model hosting, orchestration, and SDKs to accelerate AI product development.
Industry: AI & Machine Learning
Website