Senior Master Annotator

Skild AI
Bengaluru
Workplace: OnsiteFull timeFunction: Solutions Engineering & Sales EngineeringSkills: ["Attention to detail","Communication","Mentoring","Analytical","Problem-solving"]

Senior Master Annotator needed to define, maintain, and improve annotation standards for robotic datasets. You will own Inter-Annotator Agreement measurements, calibrate annotators, and ensure high-quality labeling across image, video, 3D, and audio data, shaping data-driven model training for robotics applications in a collaborative, detail-oriented team.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Skild AI
Skild AI
5 months ago

Senior Master Annotator

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 22 hours agoStatus: Live

Job Summary

Senior Master Annotator needed to define, maintain, and improve annotation standards for robotic datasets. You will own Inter-Annotator Agreement measurements, calibrate annotators, and ensure high-quality labeling across image, video, 3D, and audio data, shaping data-driven model training for robotics applications in a collaborative, detail-oriented team.
Location: Bengaluru
Workplace: Onsite
Employment Type: Full time
Job Function: Solutions Engineering & Sales Engineering
Seniority: Sr. Manager level

Key Responsibilities

  • •Define and maintain gold-standard annotations and benchmark (“gold set”) datasets for new and existing tasks.
  • •Establish clear acceptance criteria, tolerance thresholds, and task-specific quality standards (e.g., frame-level tolerances).
  • •Develop, document, version-control, and continuously refine annotation guidelines and SOPs based on disagreement patterns and quality findings.
  • •Design and implement Inter-Annotator Agreement (IAA) frameworks (e.g., Cohen’s/Fleiss’ kappa, tolerance-based agreement models) and produce regular quality reports.
  • •Analyze disagreement trends, identify root causes, and recommend data-driven process improvements.

Key Requirements

  • •4–7+ years of experience in data annotation, quality control, or video labeling environments.
  • •Strong expertise in temporal video annotation; experience with robotics, computer vision, or autonomous systems datasets preferred.
  • •Deep understanding of Inter-Annotator Agreement methodologies (e.g., Cohen’s/Fleiss’ kappa), quality metrics, sampling strategies, and gold set creation.
  • •Experience mentoring, training, or guiding annotators to improve accuracy and consistency.
  • •Strong analytical skills with proficiency in Excel or Google Sheets (Python preferred but not required).
Experience:RoboticsData annotationComputer vision
Skills:Attention to detailCommunicationMentoringAnalyticalProblem-solving
Languages:English
Tech Stack:ExcelGoogle SheetsPython

Company Brief

Skild AI
Develops AI-driven solutions focused on applying machine learning to automate and enhance business workflows, delivering predictive insights and intelligent automation for enterprise use cases.
Industry: AI & Machine Learning
Website