AI Runtime Engineer

Modular
Edinburgh
Workplace: HybridFull timeGBP 82,800 - 123,600 annuallyFunction: Data Science & Machine LearningExperience: 2+ yearsSkills: ["Team-oriented attitude","Creativity","Curiosity","Problem-solving","Collaboration"]

Own a high-performance AI runtime that optimizes CPU, GPU, and accelerator execution for diverse customer models. You’ll design runtime and cross-stack performance improvements (e.g., caching, data locality, overhead reduction), collaborate across compilers, kernels, serving, and models teams, and work with customers to translate performance needs into product outcomes. You’ll also help build automated performance analysis and benchmarking systems.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Modular
Modular
2 hours ago

AI Runtime Engineer

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 2 hours agoStatus: Live

Job Summary

Own a high-performance AI runtime that optimizes CPU, GPU, and accelerator execution for diverse customer models. You’ll design runtime and cross-stack performance improvements (e.g., caching, data locality, overhead reduction), collaborate across compilers, kernels, serving, and models teams, and work with customers to translate performance needs into product outcomes. You’ll also help build automated performance analysis and benchmarking systems.
Location: Edinburgh
Workplace: Hybrid
Employment Type: Full time
Job Function: Data Science & Machine Learning
Seniority: Mid level

Key Responsibilities

  • •Design and develop runtime and cross-stack optimizations to improve CPU, GPU, and accelerator efficiency (including CPU overhead, caching, and data locality).
  • •Work with vendor-specific networking libraries to enable high-performance data transfer across multiple topologies.
  • •Collaborate with compiler, kernels, serving, and models teams to deliver state-of-the-art end-to-end performance on CPU and GPU hardware.
  • •Partner with the customer success team to understand customer performance requirements and use cases.
  • •Collaborate with tooling and infrastructure teams to design automated performance analysis and benchmarking systems.
Travel: Low travel

Pay and Benefits

Salary: GBP 82,800 - 123,600 annually
Equity and Bonus:Equity
Perks:Health InsuranceRetirement SavingsEquityPaid LeaveLearning Budget

Key Requirements

  • •2+ years of experience working on high-performance computing systems.
  • •Experience with C++ programming and complex software systems.
  • •Experience with CPU or GPU runtime optimizations and performance analysis on CPUs, GPUs, or AI accelerators.
  • •Proficiency with one or more profiling tools (CPU or GPU).
  • •A team-oriented attitude and alignment with the company culture.
Experience:2+ yearsHigh-performance computing
Skills:Team-oriented attitudeCreativityCuriosityProblem-solvingCollaboration
Tech Stack:C++CPUGPUAI acceleratorsProfiling toolsMLIRLLVMMojo

Company Brief

Modular
Provides infrastructure and developer tools to build, deploy, and scale large AI models and foundation-model applications, including model hosting, orchestration, and SDKs to accelerate AI product development.
Industry: AI & Machine Learning
Website