Intern, AI Agent Evaluations

G2
San Francisco
InternshipUSD 24 - 24 hourlyFunction: Data Science & Machine LearningEducation: mastersSkills: ["Clear writing","Communication","Problem-solving"]

Help the Agentic Marketplace team grow by evaluating AI agents on real tasks. You’ll break agent jobs into testable steps with tasks, test data, and scoring rules; review AI judge and human reviewer scores; support vendor scaling and weekly vendor pipeline updates; and track who else evaluates AI agents and what they publish.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
G2
G2
1 day ago

Intern, AI Agent Evaluations

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 12 hours agoStatus: Live

Job Summary

Help the Agentic Marketplace team grow by evaluating AI agents on real tasks. You’ll break agent jobs into testable steps with tasks, test data, and scoring rules; review AI judge and human reviewer scores; support vendor scaling and weekly vendor pipeline updates; and track who else evaluates AI agents and what they publish.
Location: San Francisco
Employment Type: Internship
Job Function: Data Science & Machine Learning
Seniority: Intern level

Key Responsibilities

  • •Break an AI agent’s job (e.g., outbound sales) into testable steps, including tasks, test data, and scoring rules.
  • •Review scores from the AI judge and human reviewers.
  • •Support scaling systems to engage with hundreds of vendors.
  • •Prepare results packets for each vendor before publication and keep the vendor pipeline current weekly.
  • •Track other AI agent evaluators and what they publish in the market landscape.

Pay and Benefits

Salary: USD 24 hourly

Key Requirements

  • •Currently enrolled in an MBA.
  • •Have built with or used AI tools such as LLM APIs, chat assistants, or agents, and explain how they work and where they fail.
  • •Write clearly and briefly.
  • •Comfortable talking with startup founders and product leaders, able to hold your view and adjust based on facts.
  • •Available 10 to 15 hours a week during the school year (internship starts October or November 2026).
Education:Master's
Skills:Clear writingCommunicationProblem-solving
Tech Stack:LLM APIsChat assistantsAI agents

Company Brief

G2
Operates the world’s largest B2B software marketplace that collects and publishes user reviews to help organizations discover, evaluate, and manage software purchases and vendor reputation.
Industry: Online Marketplaces
Company Size: Large (251 to 1,000 employees)
Growth: Scaleup
Valuation: Unicorn (USD 1B+)
Funding: Series D
Headquarters: Chicago, United States
Founded: 2012
Glassdoor
Glassdoor: 3.7
WebsiteLinkedInGlassdoor