Senior Software Engineer - AI Interaction Evaluator (Codex / Claude Code, up to $200/hr)

G2i
Miami
Workplace: RemoteContractUSD 50 - 200 hourlyFunction: Software EngineeringSkills: ["Communication","Critical thinking","Feedback","Collaboration","Problem-solving"]

Senior staff-level software engineer will evaluate AI coding agents (Codex/Claude Code) in real-world scenarios, judging usefulness, correctness, and engineering judgment without writing production code, and providing clear, opinionated feedback to define what great AI-assisted developer interactions look like.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
G2i
G2i
2 months ago

Senior Software Engineer - AI Interaction Evaluator (Codex / Claude Code, up to $200/hr)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 7 hours agoStatus: Live

Job Summary

Senior staff-level software engineer will evaluate AI coding agents (Codex/Claude Code) in real-world scenarios, judging usefulness, correctness, and engineering judgment without writing production code, and providing clear, opinionated feedback to define what great AI-assisted developer interactions look like.
Location: Miami
Workplace: Remote
Employment Type: Contract
Job Function: Software Engineering
Seniority: Sr. Manager level

Key Responsibilities

  • •Evaluate AI-generated coding interactions end-to-end.
  • •Judge outputs for usefulness, correctness (high level), and alignment with how a strong engineer would think.
  • •Assess the quality of explanations and reasoning, not just code.
  • •Distinguish between different levels of response quality and provide clear feedback on what worked, what didn’t, and what felt off.
  • •Help define what great looks like when interacting with tools like Cursor.

Pay and Benefits

Salary: USD 50 - 200 hourly

Key Requirements

  • •Senior or staff-level software engineer with extensive experience evaluating AI coding agents (e.g., OpenAI Codex, Claude Code).
  • •Ability to assess AI outputs for usefulness, correctness at a high level, and alignment with strong engineering judgment.
  • •Strong communication to provide clear, opinionated feedback on what works, what doesn’t, and what feels off.
  • •Experience in AI-assisted developer workflows; comfortable evaluating interactions without writing production code.
  • •Proficiency in TypeScript/JavaScript or Python is preferred.
Experience:AI toolingSoftware engineeringRemote work
Skills:CommunicationCritical thinkingFeedbackCollaborationProblem-solving
Languages:English
Tech Stack:TypeScriptJavaScriptPythonOpenAI CodexClaude CodeCursorAIMachine learningNLP

Company Brief

G2i
G2i is a video-first hiring platform that connects companies with pre-vetted remote engineers (React, React Native, GraphQL, etc.) using technical screening, live interviews, and AI-assisted hiring infrastructure to speed hiring.
Industry: HR Tech
Company Size: Medium (51 to 250 employees)
Growth: Growth Stage Startup
Headquarters: Miami, United States
Founded: 2016
Glassdoor
Glassdoor: 3.3
WebsiteLinkedInGlassdoor