Senior Python Engineer - AI Code Evaluation (Codex / Claude Code, up to $200/hr)

G2i
Miami, Calgary, Mississauga, Vancouver, Boston, Montreal, Denver, Oklahoma City, Nashville, Indianapolis, Chicago, Seattle, Atlanta, Ottawa, Toronto, Austin, Dallas, San Antonio, Philadelphia, Richmond, Columbus, Las Vegas, Winnipeg, Boise, Edmonton, Washington
Workplace: RemoteContractUSD 100 - 200 hourlyFunction: People, HR & TalentSkills: ["Subjective but rigorous judgment","Opinionated feedback","High engineering standards"]

Evaluate the quality of AI coding agent interactions (including OpenAI Codex and Claude Code) in realistic scenarios. You’ll judge whether responses make sense, whether preambles and reasoning are useful, and whether outputs reflect strong engineering judgment. This is a non-traditional engineering role focused on engineering taste: providing clear, opinionated feedback on what worked, what didn’t, and what feels misleading—using tools like Cursor.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
G2i
G2i
1 day ago

Senior Python Engineer - AI Code Evaluation (Codex / Claude Code, up to $200/hr)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 23 hours agoStatus: Live

Job Summary

Evaluate the quality of AI coding agent interactions (including OpenAI Codex and Claude Code) in realistic scenarios. You’ll judge whether responses make sense, whether preambles and reasoning are useful, and whether outputs reflect strong engineering judgment. This is a non-traditional engineering role focused on engineering taste: providing clear, opinionated feedback on what worked, what didn’t, and what feels misleading—using tools like Cursor.
Location: Miami, Calgary, Mississauga, Vancouver, Boston, Montreal, Denver, Oklahoma City, Nashville, Indianapolis, Chicago, Seattle, Atlanta, Ottawa, Toronto, Austin, Dallas, San Antonio, Philadelphia, Richmond, Columbus, Las Vegas, Winnipeg, Boise, Edmonton, Washington
Workplace: Remote
Employment Type: Contract
Job Function: People, HR & Talent
Seniority: Sr. Manager level

Key Responsibilities

  • •Assess AI coding agent behavior end-to-end in real-world scenarios.
  • •Evaluate response usefulness, high-level correctness, and alignment with how a strong engineer would think.
  • •Assess quality of explanations and reasoning, not just code output.
  • •Distinguish between different levels of response quality (e.g., what separates a 2 vs 4).
  • •Provide clear, opinionated feedback on what worked, what didn’t, and what felt off or misleading.

Pay and Benefits

Salary: USD 100 - 200 hourly

Key Requirements

  • •Staff/Principal-level engineering experience (or equivalent).
  • •Strong background in TypeScript/JavaScript or Python.
  • •Hands-on experience using OpenAI Codex, Claude Code, and Cursor.
  • •Deep familiarity with modern AI-assisted dev workflows.
  • •Able to evaluate code without fully executing or deeply reviewing every line and provide direct, opinionated feedback.
Experience:AI-assisted developmentAI coding agentsCoding workflows
Skills:Subjective but rigorous judgmentOpinionated feedbackHigh engineering standards
Tech Stack:PythonTypeScriptJavaScriptOpenAI CodexClaude CodeCursor

Company Brief

G2i
G2i is a video-first hiring platform that connects companies with pre-vetted remote engineers (React, React Native, GraphQL, etc.) using technical screening, live interviews, and AI-assisted hiring infrastructure to speed hiring.
Industry: HR Tech
Company Size: Medium (51 to 250 employees)
Growth: Growth Stage Startup
Headquarters: Miami, United States
Founded: 2016
Glassdoor
Glassdoor: 3.3
WebsiteLinkedInGlassdoor