Member of Technical Staff, ML Platform

Runway ML
United States
Workplace: RemoteFull timeUSD 240,000 - 290,000 annuallyFunction: Software EngineeringExperience: 5+ yearsSkills: ["Systems thinking","Pragmatic production reliability","Self-starter","Humility","Open mindedness"]

Own model evaluation at scale, turning dispersed checkpoint and shipping decisions into a unified ML evaluation platform. Design systems to generate samples, score them with automated metrics and human annotations, track results across releases, and define “better” with operational metrics and confidence. Embedded with ML Platform and research teams, you’ll build collaborative CLIs/APIs/GUI and storage layers to help researchers act in minutes instead of days.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Runway ML
Runway ML
1 day ago

Member of Technical Staff, ML Platform

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 47 minutes agoStatus: Live

Job Summary

Own model evaluation at scale, turning dispersed checkpoint and shipping decisions into a unified ML evaluation platform. Design systems to generate samples, score them with automated metrics and human annotations, track results across releases, and define “better” with operational metrics and confidence. Embedded with ML Platform and research teams, you’ll build collaborative CLIs/APIs/GUI and storage layers to help researchers act in minutes instead of days.
Location: United States
Workplace: Remote
Employment Type: Full time
Job Function: Software Engineering
Seniority: Sr. Manager level

Key Responsibilities

  • •Own the evaluation platform end to end, including tooling and systems to generate, annotate, review, and adapt evaluation at frontier scale.
  • •Define the CLIs, APIs, GUIs, and storage layers to make evaluation seamless, fast, and collaborative.
  • •Partner with research teams working on video, image, audio, agents, and robotics to understand measurement needs and generalize them into the platform.
  • •Set evaluation standards for reproducibility, metric definitions, reporting formats, and decision thresholds for ship/no-ship.
  • •Drive broad adoption and integration across research, training, and production model serving.

Pay and Benefits

Salary: USD 240,000 - 290,000 annually

Key Requirements

  • •5+ years building ML infrastructure or data platforms in production, including evaluation, experimentation, or benchmarking systems.
  • •Strong Python and PyTorch, with hands-on experience running large batch GPU workloads on Kubernetes.
  • •Experience designing data pipelines and storage for large volumes of media or model outputs, with versioning and reproducibility.
  • •Familiarity with experimental statistics such as paired comparisons, confidence intervals, multiple-comparison pitfalls, and inter-rater agreement.
  • •Comfort building internal tools end to end, from the command line to the browser.
Experience:5+ yearsML infrastructureData platformsModel evaluationExperimentationBenchmarkingGenerative modelsLLMVLMRoboticsAgents
Skills:Systems thinkingPragmatic production reliabilitySelf-starterHumilityOpen mindedness
Tech Stack:PythonPyTorchKubernetesGPUsCloud-nativeCLIsAPIsGUIsData pipelinesStorageLLMVLM

Company Brief

Runway ML
Provides generative AI tools and a creative platform for creators and studios to generate, edit, and collaborate on images, video, and other media using state-of-the-art machine learning models.
Industry: AI & Machine Learning
Company Size: Large (251 to 1,000 employees)
Growth: Scaleup
Valuation: Unicorn (USD 1B+)
Funding: Series C
Headquarters: New York, United States
Founded: 2018
WebsiteLinkedIn