Cohere

1 month ago

Data Annotation Specialist, Safety

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 12 hours agoStatus: Live

Job Summary

Data Annotation Specialist role focused on safety, content moderation, and AI model evaluation. You’ll label, rank, and audit text to improve model safety, write prompts and safety test cases, and provide feedback for data quality in a remote, contract setting across Canada/US. 16 hours per week minimum at 45 CAD/hour or 45 USD/hour, 12-month contract, BYOD, with exposure to sensitive content.

Location: Toronto, Calgary, Montreal, Vancouver, San Francisco, New York, Seattle, Washington

Workplace: Remote

Employment Type: Contract · 12 months

Key Responsibilities

•Evaluate and improve model safety by labeling, ranking, auditing, and refining human- and model-generated text to improve safety, quality, and policy alignment, including content that may be sexual, violent, or psychologically disturbing.
•Apply nuanced safety judgment by assessing model outputs against detailed guidelines, rubrics, and style standards, making consistent decisions across ambiguous, sensitive, and context-dependent cases.
•Create prompts and safety test cases: write realistic prompts, scenarios, and adversarial examples to evaluate model behavior and uncover unsafe or policy-inconsistent responses.
•Support quality and calibration: identify annotation inconsistencies or unclear guidelines, and provide actionable feedback on edge cases, model failures, and opportunities to improve data quality.
•Work with precision and independence in a globally distributed, asynchronous team environment.

Pay and Benefits

Salary: CAD 45 hourly

Key Requirements

•1+ years of experience in Content Moderation, Trust & Safety, AI data annotation, LLM evaluation, or related analytical role; exposure to QA, red teaming, and/or prompt engineering is a plus.
•Excellent command of written English with the ability to justify content evaluations (safe/unsafe/high-quality/low-quality).
•Comfort working with content that may be unsafe, explicit, or toxic, including sexual/violent content.
•Strong attention to detail and accuracy, able to maintain consistency across high-volume tasks.
•Able to work independently in a globally distributed, asynchronous team environment.

Experience:1+ yearsContent ModerationTrust & SafetyAI data annotationLLM evaluation

Skills:Attention to detailCommunicationTime managementJudgmentEmotional resilience

Languages:English

Tech Stack:Prompt engineeringLLMText annotationData labeling

Company Brief

Cohere

Builds security-first foundation models and enterprise AI products (LLMs, retrieval, agent platforms) for regulated industries, enabling customizable, private deployments across cloud and on-premises for real-world business applications.

Industry: AI & Machine Learning

Company Size: Large (251 to 1,000 employees)

Growth: Scaleup

Valuation: Unicorn (USD 1B+)

Funding: Series D

Headquarters: Toronto, Canada

Founded: 2019

Glassdoor: 2.9

Website LinkedIn Glassdoor

Loading job details...

Preparing the role view and application actions.

Cohere

1 month ago

Data Annotation Specialist, Safety

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 12 hours agoStatus: Live

Job Summary

Location: Toronto, Calgary, Montreal, Vancouver, San Francisco, New York, Seattle, Washington

Workplace: Remote

Employment Type: Contract · 12 months

Key Responsibilities

•Evaluate and improve model safety by labeling, ranking, auditing, and refining human- and model-generated text to improve safety, quality, and policy alignment, including content that may be sexual, violent, or psychologically disturbing.
•Apply nuanced safety judgment by assessing model outputs against detailed guidelines, rubrics, and style standards, making consistent decisions across ambiguous, sensitive, and context-dependent cases.
•Create prompts and safety test cases: write realistic prompts, scenarios, and adversarial examples to evaluate model behavior and uncover unsafe or policy-inconsistent responses.
•Support quality and calibration: identify annotation inconsistencies or unclear guidelines, and provide actionable feedback on edge cases, model failures, and opportunities to improve data quality.
•Work with precision and independence in a globally distributed, asynchronous team environment.

Pay and Benefits

Salary: CAD 45 hourly

Key Requirements

•1+ years of experience in Content Moderation, Trust & Safety, AI data annotation, LLM evaluation, or related analytical role; exposure to QA, red teaming, and/or prompt engineering is a plus.
•Excellent command of written English with the ability to justify content evaluations (safe/unsafe/high-quality/low-quality).
•Comfort working with content that may be unsafe, explicit, or toxic, including sexual/violent content.
•Strong attention to detail and accuracy, able to maintain consistency across high-volume tasks.
•Able to work independently in a globally distributed, asynchronous team environment.

Experience:1+ yearsContent ModerationTrust & SafetyAI data annotationLLM evaluation

Skills:Attention to detailCommunicationTime managementJudgmentEmotional resilience

Languages:English

Tech Stack:Prompt engineeringLLMText annotationData labeling

Company Brief

Cohere

Industry: AI & Machine Learning

Company Size: Large (251 to 1,000 employees)

Growth: Scaleup

Valuation: Unicorn (USD 1B+)

Funding: Series D

Headquarters: Toronto, Canada

Founded: 2019

Glassdoor: 2.9

Website LinkedIn Glassdoor