Software Engineer 4/5 – Model Serving Systems, AI Platform

Netflix
Panama
Workplace: RemoteFull timeUSD 466,000 - 750,000 annuallyFunction: Software EngineeringEducation: bachelorsSkills: ["Best practices","Self-driven","Cross-functional collaboration","Proactive communication","Observability and logging"]

Build and expand Netflix’s model serving compute infrastructure that powers real-time inference and scalable AI/ML applications across consumer and studio experiences. Work cross-functionally with engineers, product managers, ML engineers, and research scientists to deliver low-latency, high-availability solutions for large language model (LLM) serving and efficient research-to-production workflows. Develop robust, extensible systems and deploy production hosting with strong observability and performance practices.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Netflix
Netflix
1 year ago

Software Engineer 4/5 – Model Serving Systems, AI Platform

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 5 hours agoStatus: Live

Job Summary

Build and expand Netflix’s model serving compute infrastructure that powers real-time inference and scalable AI/ML applications across consumer and studio experiences. Work cross-functionally with engineers, product managers, ML engineers, and research scientists to deliver low-latency, high-availability solutions for large language model (LLM) serving and efficient research-to-production workflows. Develop robust, extensible systems and deploy production hosting with strong observability and performance practices.
Location: Panama
Workplace: Remote
Employment Type: Full time
Job Function: Software Engineering
Seniority: Mid level

Key Responsibilities

  • •Develop and expand compute infrastructure for scalable AI/ML model serving across Netflix.
  • •Provide real-time model inference and serving capabilities for online ML applications at scale.
  • •Build and improve model serving infrastructure for LLMs and other large foundation models.
  • •Partner with product managers, ML engineers, and research/data scientists to deliver low-latency, cost-efficient serving workflows.
  • •Drive engineering excellence in deployment management, capacity planning, and production observability/logging.

Pay and Benefits

Salary: USD 466,000 - 750,000 annually
Perks:Health Insurance401kEquityPaid Leave

Key Requirements

  • •Experience building high-traffic distributed services/infrastructure for online ML model inference with high availability and performance.
  • •Experience with scalable model-serving solutions for generative models and LLMs, including reducing latency and costs and streamlining research-to-production workflows.
  • •Proficiency in object-oriented programming (preferably Java) with strong production hosting practices (performance tuning, deployment management, capacity planning).
  • •Familiarity deploying ML models using tools like Triton Inference Server, TensorRT, and Docker.
  • •Experience working with public clouds such as AWS, Azure, or GCP, plus a BS/MS in Computer Science, Applied Math, Engineering, or a related field.
Experience:Machine learningArtificial intelligenceLLMsCloud infrastructureDistributed systems
Education:Bachelor's in Computer Science, Applied Math, Engineering, or a related field
Skills:Best practicesSelf-drivenCross-functional collaborationProactive communicationObservability and logging
Tech Stack:JavaTriton Inference ServerTensorRTDockerAWSAzureGCP

Company Brief

Netflix
Global subscription streaming service that produces and distributes movies, TV series, and games across multiple devices, operating worldwide with extensive original content and localized offerings.
Industry: Streaming Platforms
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Los Gatos, United States
Founded: 1997
Glassdoor
Glassdoor: 4.1
WebsiteLinkedInGlassdoor