6 months ago

Cloud Inference Engineer

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 19 hours agoStatus: Live

Job Summary

Build and ship an end-to-end LLM inference platform for distributed, multi-node deployments that integrate with the MAX stack. Drive operational excellence through observability, autoscaling, cold-start optimizations, and multi-cloud deployments. Partner with kernel and genAI teams to deliver top application performance, and create Helm charts and Kubernetes operators to enable simple, maintainable deployments for enterprises and developers.

Location: United States

Workplace: Remote

Employment Type: Full time

Job Function: Software Engineering

Seniority: Mid level

Key Responsibilities

•Build and ship a LLM-focused inference platform using disaggregated inference, multi-node deployment, high-performance networking, and distributed KV-cache management.
•Improve operational excellence with request-to-kernel observability, multi-cloud deployments, autoscaling, and cold-start optimizations.
•Collaborate with kernels and genAI teams to integrate kernel/serving optimizations with cluster optimizations for state-of-the-art application performance.
•Develop Helm charts and Kubernetes operators to enable simple, effective, maintainable deployments.

Travel: Low travel

Pay and Benefits

Salary: USD 166,500 - 273,000

Equity and Bonus:Equity

Perks:Health Insurance401kPaid Leave

Key Requirements

•5+ years of experience working in backend engineering.
•Experience with Kubernetes and operating your own services.
•Ability to create durable, reusable software tools and libraries leveraged across teams.
•Experience in machine learning technologies and use cases.
•Creativity, curiosity, and a team-oriented attitude aligned with company culture.

Experience:Machine learningGenAIDistributed systems

Skills:CreativityCuriosityTeam-orientedProblem-solvingCollaboration

Tech Stack:KubernetesHelmGo

Eligibility

Work Authorization:Authorization required. Sponsorship not provided.

Company Brief

Modular

Provides infrastructure and developer tools to build, deploy, and scale large AI models and foundation-model applications, including model hosting, orchestration, and SDKs to accelerate AI product development.

Industry: AI & Machine Learning

Website

Loading job details...

Preparing the role view and application actions.

Modular

6 months ago

Cloud Inference Engineer

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 19 hours agoStatus: Live

Job Summary

Location: United States

Workplace: Remote

Employment Type: Full time

Job Function: Software Engineering

Seniority: Mid level

Key Responsibilities

•Build and ship a LLM-focused inference platform using disaggregated inference, multi-node deployment, high-performance networking, and distributed KV-cache management.
•Improve operational excellence with request-to-kernel observability, multi-cloud deployments, autoscaling, and cold-start optimizations.
•Collaborate with kernels and genAI teams to integrate kernel/serving optimizations with cluster optimizations for state-of-the-art application performance.
•Develop Helm charts and Kubernetes operators to enable simple, effective, maintainable deployments.

Travel: Low travel

Pay and Benefits

Salary: USD 166,500 - 273,000

Equity and Bonus:Equity

Perks:Health Insurance401kPaid Leave

Key Requirements

•5+ years of experience working in backend engineering.
•Experience with Kubernetes and operating your own services.
•Ability to create durable, reusable software tools and libraries leveraged across teams.
•Experience in machine learning technologies and use cases.
•Creativity, curiosity, and a team-oriented attitude aligned with company culture.

Experience:Machine learningGenAIDistributed systems

Skills:CreativityCuriosityTeam-orientedProblem-solvingCollaboration

Tech Stack:KubernetesHelmGo

Eligibility

Work Authorization:Authorization required. Sponsorship not provided.

Company Brief

Modular

Industry: AI & Machine Learning

Website