hud

1 week ago

Research Engineer, QC Automation

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 9 hours agoStatus: Live

Job Summary

Build automated quality control systems for training data generated using HUD’s infrastructure. You’ll define and enforce data quality standards, design experiments and metrics to grade agent outputs, and work with data vendors to diagnose failure modes and improve data generation. Translate QC learnings into auditing systems, sampling strategies, and validation pipelines to reduce anomalies, inconsistencies, and edge cases as HUD scales RL training data and evals.

Location: San Francisco, Singapore

Workplace: Onsite

Employment Type: Full time

Job Function: Research & Scientific (R&D)

Seniority: Mid level

Key Responsibilities

•Create QC systems for training data using human judgement without relying heavily on LLMs.
•Define and enforce quality standards for training data and design experiments and metrics to grade agent outputs.
•Partner with data vendors to debug quality issues, diagnose agent failure modes, and provide actionable feedback.
•Translate QC learnings into auditing systems for supplier-generated datasets, including sampling strategies and validation pipelines.
•Continuously integrate QC learnings into infrastructure tools and the data vendor portal to reduce anomalies and edge cases.

Pay and Benefits

Salary: USD 140,000 - 250,000 annually

Perks:Health InsuranceDentalVision401kGym MembershipCommuter Benefits

Key Requirements

•Proficiency in Python, Docker, and Linux environments.
•Strong understanding of what “good data” means and how to measure it.
•Built scalable data validation pipelines and automated QA/QC systems end-to-end.
•Experience working on benchmarks and evals for realistic tasks, reliable rubrics, and useful trajectories for RL training.
•Early-stage startup experience with the ability to work independently in fast-paced environments.

Experience:3+ yearsReinforcement learningBenchmarksEvaluator design

Skills:CommunicationAttention to detailIndependent workProblem-solving

Tech Stack:PythonDockerLinuxLLMsChatGPTClaude CodeCursor

Eligibility

Work Authorization:Sponsorship available.

Company Brief

hud

Hud provides a lightweight developer-focused tool that captures and shares UI components and interactive design specs from the browser to streamline design-to-development handoff and collaboration between designers and engineers.

Industry: Developer Tools

Website

Loading job details...

Preparing the role view and application actions.

hud