AI Interaction Evaluator (Codex / Claude Code, up to $200/hr)

G2i
Miami, Calgary, Mississauga, Vancouver, Boston, Montreal, Denver, Oklahoma City, Nashville, Indianapolis, Chicago, Seattle, Atlanta, Ottawa, Toronto, Austin, Dallas, San Antonio, Philadelphia, Richmond, Columbus, Las Vegas, Winnipeg, Boise, Edmonton, Washington
Workplace: RemoteContractUSD 100 - 200 hourlyFunction: People, HR & TalentSkills: ["Subjective but rigorous judgments","Direct feedback","High engineering standards","Engineering judgment"]

Evaluate AI coding agent interactions end-to-end by judging whether responses make sense, reasoning and explanations are useful, and outputs reflect strong engineering judgment. Distinguish response quality levels and provide clear, opinionated feedback on what worked, what didn’t, and what felt misleading. Help define what “great” looks like when interacting with tools like Cursor, focusing on engineering taste rather than syntax correctness.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
G2i
G2i
1 day ago

AI Interaction Evaluator (Codex / Claude Code, up to $200/hr)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 23 hours agoStatus: Live

Job Summary

Evaluate AI coding agent interactions end-to-end by judging whether responses make sense, reasoning and explanations are useful, and outputs reflect strong engineering judgment. Distinguish response quality levels and provide clear, opinionated feedback on what worked, what didn’t, and what felt misleading. Help define what “great” looks like when interacting with tools like Cursor, focusing on engineering taste rather than syntax correctness.
Location: Miami, Calgary, Mississauga, Vancouver, Boston, Montreal, Denver, Oklahoma City, Nashville, Indianapolis, Chicago, Seattle, Atlanta, Ottawa, Toronto, Austin, Dallas, San Antonio, Philadelphia, Richmond, Columbus, Las Vegas, Winnipeg, Boise, Edmonton, Washington
Workplace: Remote
Employment Type: Contract
Job Function: People, HR & Talent
Seniority: Mid level

Key Responsibilities

  • •Evaluate AI-generated coding interactions end-to-end
  • •Judge whether outputs are useful, correct at a high level, and aligned with how a strong engineer would think
  • •Assess the quality of explanations and reasoning (not just code)
  • •Distinguish response quality levels and provide clear, opinionated feedback
  • •Help define what “great” looks like when interacting with tools like Cursor

Pay and Benefits

Salary: USD 100 - 200 hourly

Key Requirements

  • •Staff/Principal-level engineer (or equivalent experience)
  • •Strong background in TypeScript/JavaScript or Python
  • •Hands-on experience using OpenAI Codex, Claude Code, and Cursor
  • •Deep familiarity with modern AI-assisted dev workflows
  • •Able to evaluate code without fully executing or deeply reviewing every line
Experience:AI-assisted developmentCoding agentsPrompt evaluation
Skills:Subjective but rigorous judgmentsDirect feedbackHigh engineering standardsEngineering judgment
Tech Stack:TypeScriptJavaScriptPythonOpenAI CodexClaude CodeCursor

Company Brief

G2i
G2i is a video-first hiring platform that connects companies with pre-vetted remote engineers (React, React Native, GraphQL, etc.) using technical screening, live interviews, and AI-assisted hiring infrastructure to speed hiring.
Industry: HR Tech
Company Size: Medium (51 to 250 employees)
Growth: Growth Stage Startup
Headquarters: Miami, United States
Founded: 2016
Glassdoor
Glassdoor: 3.3
WebsiteLinkedInGlassdoor