Machine Learning Engineer - Inference Maintainer & Developer Experience

Roboflow
New York, San Francisco
Workplace: RemoteFull timeFunction: Data Science & Machine LearningExperience: 5+ yearsSkills: ["Ownership","Accountability","Communication","Teaching","Collaboration","Public advocacy","Judgment"]

Steward and improve the inference engine that powers computer vision models across cloud GPUs and edge devices. Build an agentic-driven contribution and release pipeline with automated review, triage, CI/CD, and end-to-end testing to move from weekly to daily releases. Grow a world-grounded test suite, define review standards, streamline how new ML models are added, and teach internal teams and customers while bridging engineering and client needs.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Roboflow
Roboflow
2 months ago

Machine Learning Engineer - Inference Maintainer & Developer Experience

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 15 hours agoStatus: Live

Job Summary

Steward and improve the inference engine that powers computer vision models across cloud GPUs and edge devices. Build an agentic-driven contribution and release pipeline with automated review, triage, CI/CD, and end-to-end testing to move from weekly to daily releases. Grow a world-grounded test suite, define review standards, streamline how new ML models are added, and teach internal teams and customers while bridging engineering and client needs.
Location: New York, San Francisco
Workplace: Remote
Employment Type: Full time
Job Function: Data Science & Machine Learning
Seniority: Mid level

Key Responsibilities

  • •Build and maintain the inference open source and commercial CV inference engine, keeping it healthy and high-quality as contribution volume scales.
  • •Design an agentic-driven contribution and release pipeline, including automated and semi-automated review, triage, CI/CD, and end-to-end testing.
  • •Create and grow a world-grounded, expanding test suite to validate real build health across all targets with nightly end-to-end runs.
  • •Define and enforce review standards (“rules of the road”) for agents and contributors, encoding judgment into the system.
  • •Streamline adding new models to inference and teach internal teams and customers to get more value from the product.

Pay and Benefits

Equity and Bonus:Equity
Perks:Health InsuranceRemote WorkPaid LeaveParental LeaveEquity

Key Requirements

  • •5+ years of hands-on experience building and operating production-grade ML systems, ideally with large-scale deployment of modern AI models.
  • •A strong CV/ML foundation, including how inference works internally and how models are deployed across diverse environments.
  • •Stellar skills working with AI coding agents to automate engineering workflows (review, triage, testing, CI) with appropriate guardrails.
  • •Strong CS and systems background to tackle complex programming, architecture, and reliability challenges and know when to move fast vs add rigor.
  • •Hands-on experience with CI/CD, release engineering, and test infrastructure, plus practical expertise with ML and image/video processing tools.
Experience:5+ yearsOpen sourceComputer visionDeveloper tools
Skills:OwnershipAccountabilityCommunicationTeachingCollaborationPublic advocacyJudgment
Tech Stack:PyTorchTensorFlowONNXTensorRTVLLMOpenCVDeepStreamPillowPyAVCI/CDRelease engineeringEnd-to-end testing

Company Brief

Roboflow
Provides a computer vision platform that helps teams build, deploy, and manage object detection and image classification models. Offers tooling for dataset versioning, annotation, augmentation, and production-ready model hosting and monitoring.
Industry: AI & Machine Learning
Company Size: Medium (51 to 250 employees)
Growth: Scaleup
Headquarters: Boston, United States
Founded: 2016
WebsiteLinkedIn