Code Data Annotation Quality Specialist

Mistral
Paris, London
Workplace: HybridFull timeFunction: Quality & Regulatory (Non-Software)Experience: 2-5 yearsEducation: bachelorsSkills: ["Attention to detail","Strong writing","Problem-solving","Collaboration","Accuracy"]

Ensure high-quality code annotations used to train and evaluate AI models on the Human Data Annotation team. Audit and validate annotations against rubrics, identify edge cases and guideline gaps, and produce exemplar annotations. Build, maintain, and troubleshoot internal tooling (dashboards, scripts, utilities) that streamline annotator workflows, including diagnosing environment, version control, and other local development issues in coordination with IT and engineering.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Mistral
Mistral
2 months ago

Code Data Annotation Quality Specialist

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 1 hour agoStatus: Live
Reposted: similar role first listed 1 month ago

Job Summary

Ensure high-quality code annotations used to train and evaluate AI models on the Human Data Annotation team. Audit and validate annotations against rubrics, identify edge cases and guideline gaps, and produce exemplar annotations. Build, maintain, and troubleshoot internal tooling (dashboards, scripts, utilities) that streamline annotator workflows, including diagnosing environment, version control, and other local development issues in coordination with IT and engineering.
Location: Paris, London
Workplace: Hybrid
Employment Type: Full time
Job Function: Quality & Regulatory (Non-Software)
Seniority: Mid level

Key Responsibilities

  • •Generate and validate high-quality code data annotations based on guidelines and continuous feedback.
  • •Review and audit annotations against rubrics to uphold quality standards for AI training and evaluation.
  • •Surface systemic issues, edge cases, and guideline gaps to annotation operations and technical stakeholders.
  • •Build and maintain internal tools and automation (dashboards, scripts, utilities) to streamline annotator workflows.
  • •Troubleshoot annotator environment, tooling, and version control issues and collaborate with IT and engineering as needed.

Pay and Benefits

Perks:Health InsuranceParental LeaveRetirementRelocation SupportWellness StipendMeal AllowanceCommuter Benefits

Key Requirements

  • •Degree in computer science/engineering (or related) or 2 to 5 years of professional experience in software engineering, technical support, or tool development.
  • •Hands-on experience using code agents in your development workflow.
  • •Proficiency in at least one programming language (e.g., Python, JavaScript) and ability to read and reason about code across multiple languages.
  • •Ability to apply consistent judgment against a rubric and identify edge cases, ambiguities, or guideline gaps.
  • •Comfort working in a Unix-like terminal, including shell basics, package managers, environment setup, and version control workflows.
Experience:2-5 yearsSoftware engineeringTechnical supportTool developmentAI data annotation
Education:Bachelor's in computer science
Skills:Attention to detailStrong writingProblem-solvingCollaborationAccuracy
Languages:English
Tech Stack:PythonJavaScriptUnix-like terminalShellVersion controlPackage managers

Company Brief

Mistral
Develops state-of-the-art large language models and AI systems, offering models and developer tools for natural language understanding, generation, and enterprise AI integrations. Focuses on open research and production-ready model deployments.
Industry: AI & Machine Learning
Company Size: Medium (51 to 250 employees)
Growth: Early Stage Startup
Funding: Seed
Headquarters: Paris, France
Founded: 2023
WebsiteLinkedIn