Member of Technical Staff, Data Analysis and Evaluation

Cohere
London, Paris, New York, Toronto, Montreal, San Francisco
Workplace: HybridFull timeFunction: Data Science & Machine LearningSkills: ["Python","PyTorch","TensorFlow","JAX"]

Design and evaluate data collection processes, apply statistical methods to assess dataset quality, and analyze robustness of large language models. Collaborate with researchers, engineers, and annotators to drive data-driven improvements, train LLMs on distributed infrastructure, and run experiments to enhance model performance in diverse scenarios.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Cohere
Cohere
8 months ago

Member of Technical Staff, Data Analysis and Evaluation

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 8 hours agoStatus: Live

Job Summary

Design and evaluate data collection processes, apply statistical methods to assess dataset quality, and analyze robustness of large language models. Collaborate with researchers, engineers, and annotators to drive data-driven improvements, train LLMs on distributed infrastructure, and run experiments to enhance model performance in diverse scenarios.
Location: London, Paris, New York, Toronto, Montreal, San Francisco
Workplace: Hybrid
Employment Type: Full time
Job Function: Data Science & Machine Learning

Key Responsibilities

  • •Design and oversee data collection tasks, including supporting human annotators and ensuring data quality.
  • •Develop and apply statistical methods to evaluate the quality and reliability of datasets.
  • •Analyse and assess the generalisability and robustness of ML systems across diverse use cases.
  • •Collaborate with teams to improve dataset quality and model performance.
  • •Train and fine-tune large language models (LLMs) on distributed training infrastructures.

Pay and Benefits

Perks:Health InsuranceDentalParential LeaveCo-working StipendPaid Leave

Key Requirements

  • •Strong software engineering skills.
  • •Experience designing data collection tasks, including working with human annotators.
  • •Strong statistical skills and experience evaluating experiments related to data collection and model performance.
  • •Experience analyzing datasets for quality, biases, and suitability for training ML models.
  • •Hands-on experience training large language models on distributed training infrastructures.
Experience:Artificial intelligenceMachine learningLLMs
Skills:PythonPyTorchTensorFlowJAX
Languages:English
Tech Stack:PythonPyTorchTensorFlowJAX

Company Brief

Cohere
Builds security-first foundation models and enterprise AI products (LLMs, retrieval, agent platforms) for regulated industries, enabling customizable, private deployments across cloud and on-premises for real-world business applications.
Industry: AI & Machine Learning
Company Size: Large (251 to 1,000 employees)
Growth: Scaleup
Valuation: Unicorn (USD 1B+)
Funding: Series D
Headquarters: Toronto, Canada
Founded: 2019
Glassdoor
Glassdoor: 2.9
WebsiteLinkedInGlassdoor