Research Engineer, QC Automation

hud
San Francisco, Singapore
Workplace: OnsiteFull timeUSD 140,000 - 250,000 annuallyFunction: Research & Scientific (R&D)Experience: 3+ yearsSkills: ["Communication","Attention to detail","Independent work","Problem-solving"]

Build automated quality control systems for training data generated using HUD’s infrastructure. You’ll define and enforce data quality standards, design experiments and metrics to grade agent outputs, and work with data vendors to diagnose failure modes and improve data generation. Translate QC learnings into auditing systems, sampling strategies, and validation pipelines to reduce anomalies, inconsistencies, and edge cases as HUD scales RL training data and evals.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
hud
hud
1 month ago

Research Engineer, QC Automation

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 21 hours agoStatus: Live

Job Summary

Build automated quality control systems for training data generated using HUD’s infrastructure. You’ll define and enforce data quality standards, design experiments and metrics to grade agent outputs, and work with data vendors to diagnose failure modes and improve data generation. Translate QC learnings into auditing systems, sampling strategies, and validation pipelines to reduce anomalies, inconsistencies, and edge cases as HUD scales RL training data and evals.
Location: San Francisco, Singapore
Workplace: Onsite
Employment Type: Full time
Job Function: Research & Scientific (R&D)
Seniority: Mid level

Key Responsibilities

  • •Create QC systems for training data using human judgement without relying heavily on LLMs.
  • •Define and enforce quality standards for training data and design experiments and metrics to grade agent outputs.
  • •Partner with data vendors to debug quality issues, diagnose agent failure modes, and provide actionable feedback.
  • •Translate QC learnings into auditing systems for supplier-generated datasets, including sampling strategies and validation pipelines.
  • •Continuously integrate QC learnings into infrastructure tools and the data vendor portal to reduce anomalies and edge cases.

Pay and Benefits

Salary: USD 140,000 - 250,000 annually
Perks:Health InsuranceDentalVision401kGym MembershipCommuter Benefits

Key Requirements

  • •Proficiency in Python, Docker, and Linux environments.
  • •Strong understanding of what “good data” means and how to measure it.
  • •Built scalable data validation pipelines and automated QA/QC systems end-to-end.
  • •Experience working on benchmarks and evals for realistic tasks, reliable rubrics, and useful trajectories for RL training.
  • •Early-stage startup experience with the ability to work independently in fast-paced environments.
Experience:3+ yearsReinforcement learningBenchmarksEvaluator design
Skills:CommunicationAttention to detailIndependent workProblem-solving
Tech Stack:PythonDockerLinuxLLMsChatGPTClaude CodeCursor

Eligibility

Work Authorization:Sponsorship available.

Company Brief

hud
Hud provides a lightweight developer-focused tool that captures and shares UI components and interactive design specs from the browser to streamline design-to-development handoff and collaboration between designers and engineers.
Industry: Developer Tools
Website