AI Quality and Agent Operations Analyst - AI Solutions

NVIDIA
Santa Clara
Workplace: OnsiteFull timeUSD 124,000 - 195,500 annuallyFunction: Business OperationsExperience: 2+ yearsEducation: bachelorsSkills: ["Attention to detail","Collaboration","Prioritization"]

Improve the quality and production readiness of NVIDIA’s Sales AI applications by replacing ad hoc testing with standardized AI evaluation and QA workflows. Build test scenarios, assessment standards, metrics, and acceptance thresholds, then evaluate AI outputs for accuracy, safety, and business workflow alignment. Analyze evaluation results, service metrics, and user feedback, investigate failures, and partner with engineering, product, data, and solution architecture teams to drive prioritized improvements.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
NVIDIA
NVIDIA
4 days ago

AI Quality and Agent Operations Analyst - AI Solutions

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 17 hours agoStatus: Live

Job Summary

Improve the quality and production readiness of NVIDIA’s Sales AI applications by replacing ad hoc testing with standardized AI evaluation and QA workflows. Build test scenarios, assessment standards, metrics, and acceptance thresholds, then evaluate AI outputs for accuracy, safety, and business workflow alignment. Analyze evaluation results, service metrics, and user feedback, investigate failures, and partner with engineering, product, data, and solution architecture teams to drive prioritized improvements.
Location: Santa Clara
Workplace: Onsite
Employment Type: Full time
Job Function: Business Operations
Seniority: Mid level

Key Responsibilities

  • •Collaborate with application teams to replace ad hoc testing with consistent AI evaluation and quality assurance standards and workflows.
  • •Create test scenarios, assessment standards, quality metrics, and acceptance thresholds for AI outputs.
  • •Evaluate AI outputs for accuracy, relevance, consistency, safety, and alignment with business workflows; analyze evaluation results, service metrics, production data, and user feedback.
  • •Investigate failures and recurring patterns, identify performance trends, and work with technical teams on prioritized improvements while communicating findings.
  • •Support production readiness and launches through testing, validation, documentation, monitoring, issue tracking, and quality checks before and after launch.

Pay and Benefits

Salary: USD 124,000 - 195,500 annually
Equity and Bonus:Equity

Key Requirements

  • •2+ years of experience in software quality, application operations, data analysis, AI/machine learning, technical support, or business analysis.
  • •Experience testing, evaluating, monitoring, or supporting applications in development or production.
  • •Familiarity with generative AI, machine learning concepts, APIs, data workflows, or enterprise software.
  • •Experience analyzing test results, application metrics, and user feedback to identify issues and opportunities.
  • •Ability to develop structured test cases, evaluation criteria, documentation, or quality reports and collaborate across technical and business teams.
Experience:2+ yearsAIMachine learning
Education:Bachelor's
Skills:Attention to detailCollaborationPrioritization
Tech Stack:PythonSQLAPIsDashboards

Company Brief

NVIDIA
Designs and manufactures GPUs, AI accelerators, and system-on-chip products for gaming, data centers, professional visualization, and automotive markets, enabling advanced graphics, AI, and high-performance computing solutions worldwide.
Industry: Electronics Manufacturing
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Santa Clara, United States
Founded: 1993
Glassdoor
Glassdoor: 4.3
WebsiteLinkedInGlassdoor