Staff / Principal Rust Engineer, AI Coding Agent Evaluator

G2i
Anywhere
Workplace: RemoteContractUSD 100 - 200 hourlyFunction: Data Science & Machine LearningSkills: ["Subject-matter judgment","Opinionated feedback","Critical evaluation","Communication"]

Evaluate AI coding agents’ real-world outputs and explanations for usefulness, correctness at a high level, and whether the interaction demonstrates strong engineering judgment. You’ll review end-to-end responses from tools like OpenAI Codex, Claude Code, and Cursor, distinguish quality levels (e.g., 2 vs 4), and provide clear, opinionated feedback. This is a contract role focused on engineering taste rather than writing production code.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
G2i
G2i
5 days ago

Staff / Principal Rust Engineer, AI Coding Agent Evaluator

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 3 hours agoStatus: Live

Job Summary

Evaluate AI coding agents’ real-world outputs and explanations for usefulness, correctness at a high level, and whether the interaction demonstrates strong engineering judgment. You’ll review end-to-end responses from tools like OpenAI Codex, Claude Code, and Cursor, distinguish quality levels (e.g., 2 vs 4), and provide clear, opinionated feedback. This is a contract role focused on engineering taste rather than writing production code.
Location: Anywhere
Workplace: Remote
Employment Type: Contract · Permanent
Job Function: Data Science & Machine Learning
Seniority: Mid level

Key Responsibilities

  • •Assess AI coding agents’ behavior in real-world scenarios, including whether responses make sense.
  • •Judge usefulness, high-level correctness, and engineering-judgment alignment of outputs.
  • •Evaluate the quality of explanations and reasoning, not just code.
  • •Differentiate response quality levels and define what “great” looks like for interactions with tools like Cursor.
  • •Provide clear, opinionated feedback on what worked, what didn’t, and what felt off or misleading.

Pay and Benefits

Salary: USD 100 - 200 hourly

Key Requirements

  • •Staff/Principal-level engineer (or equivalent experience).
  • •Strong background in TypeScript/JavaScript or Python.
  • •Hands-on experience using OpenAI Codex, Claude Code, and Cursor.
  • •Deep familiarity with modern AI-assisted dev workflows.
  • •Comfort evaluating code without executing or deeply reviewing every line, and giving direct, opinionated feedback.
Experience:AI-assisted developmentDeveloper toolsAI coding agents
Skills:Subject-matter judgmentOpinionated feedbackCritical evaluationCommunication
Tech Stack:RustTypeScriptJavaScriptPythonOpenAI CodexClaude CodeCursor

Company Brief

G2i
G2i is a video-first hiring platform that connects companies with pre-vetted remote engineers (React, React Native, GraphQL, etc.) using technical screening, live interviews, and AI-assisted hiring infrastructure to speed hiring.
Industry: HR Tech
Company Size: Medium (51 to 250 employees)
Growth: Growth Stage Startup
Headquarters: Miami, United States
Founded: 2016
Glassdoor
Glassdoor: 3.3
WebsiteLinkedInGlassdoor