TypeScript Engineer, AI Coding Agent Evaluator

G2i
Anywhere
Workplace: RemoteContractUSD 100 - 200 hourlyFunction: Data Science & Machine LearningSkills: ["Engineering judgment","Subjective but rigorous evaluation","Direct feedback","Communication","Attention to explanation quality"]

Evaluate the quality of AI coding agent interactions in real-world scenarios. You’ll review end-to-end outputs from tools like OpenAI Codex and Claude Code, focusing on whether responses make sense, reasoning and explanations are useful, and the engineering judgment feels like what a strong engineer would actually do. Provide clear, opinionated, subjective-but-rigorous feedback and help define what “great” looks like when using Cursor and similar AI-first developer workflows.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
G2i
G2i
2 days ago

TypeScript Engineer, AI Coding Agent Evaluator

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 10 hours agoStatus: Live

Job Summary

Evaluate the quality of AI coding agent interactions in real-world scenarios. You’ll review end-to-end outputs from tools like OpenAI Codex and Claude Code, focusing on whether responses make sense, reasoning and explanations are useful, and the engineering judgment feels like what a strong engineer would actually do. Provide clear, opinionated, subjective-but-rigorous feedback and help define what “great” looks like when using Cursor and similar AI-first developer workflows.
Location: Anywhere
Workplace: Remote
Employment Type: Contract
Job Function: Data Science & Machine Learning

Key Responsibilities

  • •Assess how AI coding agents behave in real-world scenarios, including whether responses make sense.
  • •Evaluate whether preambles, reasoning, and explanations are useful—not just technically correct.
  • •Judge whether outputs reflect strong engineering judgment and align with how a strong engineer would think.
  • •Distinguish between levels of response quality and identify what is “off” or misleading.
  • •Provide clear, opinionated feedback and help define what “great” looks like for interactions with Cursor and similar tools.

Pay and Benefits

Salary: USD 100 - 200 hourly

Key Requirements

  • •Staff / principal-level engineer (or equivalent experience).
  • •Strong background in TypeScript/JavaScript or Python.
  • •Hands-on experience with OpenAI Codex, Claude Code, and using Cursor.
  • •Deep familiarity with modern AI-assisted development workflows and the ability to evaluate code without fully executing or deeply reviewing every line.
  • •Comfort providing direct, opinionated feedback and judging “engineering taste” at a high bar.
Experience:AI-assisted developmentCoding agents
Skills:Engineering judgmentSubjective but rigorous evaluationDirect feedbackCommunicationAttention to explanation quality
Tech Stack:TypeScriptJavaScriptPythonOpenAI CodexClaude CodeCursor

Company Brief

G2i
G2i is a video-first hiring platform that connects companies with pre-vetted remote engineers (React, React Native, GraphQL, etc.) using technical screening, live interviews, and AI-assisted hiring infrastructure to speed hiring.
Industry: HR Tech
Company Size: Medium (51 to 250 employees)
Growth: Growth Stage Startup
Headquarters: Miami, United States
Founded: 2016
Glassdoor
Glassdoor: 3.3
WebsiteLinkedInGlassdoor