1 month ago

AI Library Architect

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 19 hours agoStatus: Live

Job Summary

Own and evolve core, developer-facing APIs for inference and training in the MAX framework. Shape the API surface, inference/training programming models, and quality/versioning standards while preserving performance, portability, and maintainability. Drive RFCs and technical specs, partner with compiler/runtime, kernels, cloud/serving, and DevRel teams, and deliver reference implementations and golden-path examples that enable production-ready AI systems.

Location: San Francisco, Seattle

Workplace: Remote

Employment Type: Full time

Job Function: Software Engineering

Key Responsibilities

•Influence the MAX API surface (namespaces, abstractions, extension points, programming model, compatibility guarantees, developer experience).
•Design inference APIs for serving needs including model loading, distributed inference, quantization, pipelines, batching/streaming, and deployment ergonomics.
•Design training APIs that scale from single device to distributed execution with primitives for placement, parallelism, checkpointing, and observability.
•Create a coherent programming model across Python and Mojo-adjacent surfaces and define a consistent “pit of success.”
•Drive RFCs/technical specs and provide reference implementations, templates, and best-practice exemplar code while setting API quality/versioning/deprecation/test/documentation standards.

Travel: Low travel

Pay and Benefits

Salary: USD 198,000 - 319,000 annually

Equity and Bonus:Equity

Perks:Health Insurance401kPaid LeaveEquity

Key Requirements

•Significant experience designing and evolving developer-facing APIs (SDKs, frameworks, or platforms).
•Strong understanding of modern AI frameworks and their design tradeoffs (e.g., PyTorch, JAX, TensorFlow, vLLM; XLA/MLIR-adjacent ecosystems).
•Experience with inference and training systems (model execution graphs, compilation, runtime scheduling, distributed execution, checkpointing, performance tuning).
•Fluency in systems/performance languages (C++, Rust, Go) and user-facing languages (Python; familiarity with Mojo is a plus).
•Excellent API ergonomics and communication skills to write unambiguous technical specs engineers can implement.

Experience:AI infrastructureMachine learningDeveloper platforms

Skills:API ergonomicsTechnical writingCross-functional collaborationPragmatismIncremental development

Tech Stack:PythonMojoPyTorchJAXTensorFlowVLLMXLAMLIRC++RustGo

Company Brief

Modular

Provides infrastructure and developer tools to build, deploy, and scale large AI models and foundation-model applications, including model hosting, orchestration, and SDKs to accelerate AI product development.

Industry: AI & Machine Learning

Website

Loading job details...

Preparing the role view and application actions.

Modular

1 month ago

AI Library Architect

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 19 hours agoStatus: Live

Job Summary

Location: San Francisco, Seattle

Workplace: Remote

Employment Type: Full time

Job Function: Software Engineering

Key Responsibilities

•Influence the MAX API surface (namespaces, abstractions, extension points, programming model, compatibility guarantees, developer experience).
•Design inference APIs for serving needs including model loading, distributed inference, quantization, pipelines, batching/streaming, and deployment ergonomics.
•Design training APIs that scale from single device to distributed execution with primitives for placement, parallelism, checkpointing, and observability.
•Create a coherent programming model across Python and Mojo-adjacent surfaces and define a consistent “pit of success.”
•Drive RFCs/technical specs and provide reference implementations, templates, and best-practice exemplar code while setting API quality/versioning/deprecation/test/documentation standards.

Travel: Low travel

Pay and Benefits

Salary: USD 198,000 - 319,000 annually

Equity and Bonus:Equity

Perks:Health Insurance401kPaid LeaveEquity

Key Requirements

•Significant experience designing and evolving developer-facing APIs (SDKs, frameworks, or platforms).
•Strong understanding of modern AI frameworks and their design tradeoffs (e.g., PyTorch, JAX, TensorFlow, vLLM; XLA/MLIR-adjacent ecosystems).
•Experience with inference and training systems (model execution graphs, compilation, runtime scheduling, distributed execution, checkpointing, performance tuning).
•Fluency in systems/performance languages (C++, Rust, Go) and user-facing languages (Python; familiarity with Mojo is a plus).
•Excellent API ergonomics and communication skills to write unambiguous technical specs engineers can implement.

Experience:AI infrastructureMachine learningDeveloper platforms

Skills:API ergonomicsTechnical writingCross-functional collaborationPragmatismIncremental development

Tech Stack:PythonMojoPyTorchJAXTensorFlowVLLMXLAMLIRC++RustGo

Company Brief

Modular

Industry: AI & Machine Learning

Website