Senior Engineer - AI Interaction Evaluator

G2i
Miami, Calgary, Mississauga, Vancouver, Boston, Montreal, Denver, Oklahoma City, Nashville, Indianapolis, Chicago, Seattle, Atlanta, Ottawa, Toronto, Austin, Dallas, San Antonio, Philadelphia, Richmond, Columbus, Las Vegas, Winnipeg, Boise, Edmonton, Washington
Workplace: RemoteContractUSD 100 - 200 hourlyFunction: Data Science & Machine LearningSkills: []

Evaluate AI coding agents end-to-end by judging whether their responses make sense, their reasoning and explanations are useful, and their outputs reflect strong engineering judgment. You’ll provide clear, opinionated feedback on what worked, what didn’t, and what felt misleading, with a focus on engineering “taste” rather than syntax correctness. Work with tools like OpenAI Codex, Claude Code, and Cursor in a take-home and interview-based process.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
G2i
G2i
3 months ago

Senior Engineer - AI Interaction Evaluator

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 1 hour agoStatus: Live

Job Summary

Evaluate AI coding agents end-to-end by judging whether their responses make sense, their reasoning and explanations are useful, and their outputs reflect strong engineering judgment. You’ll provide clear, opinionated feedback on what worked, what didn’t, and what felt misleading, with a focus on engineering “taste” rather than syntax correctness. Work with tools like OpenAI Codex, Claude Code, and Cursor in a take-home and interview-based process.
Location: Miami, Calgary, Mississauga, Vancouver, Boston, Montreal, Denver, Oklahoma City, Nashville, Indianapolis, Chicago, Seattle, Atlanta, Ottawa, Toronto, Austin, Dallas, San Antonio, Philadelphia, Richmond, Columbus, Las Vegas, Winnipeg, Boise, Edmonton, Washington
Workplace: Remote
Employment Type: Contract
Job Function: Data Science & Machine Learning
Seniority: Mid level

Key Responsibilities

  • •Assess AI coding agent behavior in real-world scenarios by evaluating whether responses make sense.
  • •Judge usefulness of preambles, reasoning quality, and alignment with how a strong engineer would think.
  • •Evaluate output quality at different levels (e.g., distinguishing a 2 vs 4) without fully executing or deeply reviewing every line.
  • •Provide clear, opinionated feedback on what worked, what didn’t, and what felt off or misleading.
  • •Help define what “great” looks like when interacting with tools like Cursor.

Pay and Benefits

Salary: USD 100 - 200 hourly

Key Requirements

  • •Staff/Principal-level engineer (or equivalent experience).
  • •Strong background in TypeScript/JavaScript and/or Python.
  • •Hands-on experience using OpenAI Codex, Claude Code, and Cursor.
  • •Deep familiarity with modern AI-assisted dev workflows.
  • •Comfortable giving direct, opinionated feedback and making subjective but rigorous judgments about output quality.
Experience:AI-assisted development
Tech Stack:TypeScriptJavaScriptPythonOpenAI CodexClaude CodeCursor

Company Brief

G2i
G2i is a video-first hiring platform that connects companies with pre-vetted remote engineers (React, React Native, GraphQL, etc.) using technical screening, live interviews, and AI-assisted hiring infrastructure to speed hiring.
Industry: HR Tech
Company Size: Medium (51 to 250 employees)
Growth: Growth Stage Startup
Headquarters: Miami, United States
Founded: 2016
Glassdoor
Glassdoor: 3.3
WebsiteLinkedInGlassdoor