QA Engineer

Sutherland
Chennai
Workplace: OnsiteFull timeFunction: QA, Test & Release EngineeringExperience: 5+ yearsSkills: ["Accuracy-focused","Regression testing","Data-driven evaluation","Attention to detail","Stakeholder collaboration"]

Own the technical validation of agent outputs by building and running test suites against golden-record datasets. Track and report accuracy and turnaround-time metrics to support KPI baselining, and execute regression testing whenever agent or prompt configurations change. Provide technical evidence to the human QA function for final sign-off, supporting regulated activity with measurable QA results.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Sutherland
Sutherland
3 days ago

QA Engineer

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 10 hours agoStatus: Live

Job Summary

Own the technical validation of agent outputs by building and running test suites against golden-record datasets. Track and report accuracy and turnaround-time metrics to support KPI baselining, and execute regression testing whenever agent or prompt configurations change. Provide technical evidence to the human QA function for final sign-off, supporting regulated activity with measurable QA results.
Location: Chennai
Workplace: Onsite
Employment Type: Full time
Job Function: QA, Test & Release Engineering
Seniority: Mid level

Key Responsibilities

  • •Own technical testing of agent outputs, including accuracy and turnaround-time impact, and manage regression testing as agents are iterated.
  • •Build test suites validating agent outputs against golden-record datasets across covered processes.
  • •Track and report accuracy/turnaround-time metrics to support baselining exercises agreed with the business.
  • •Run regression testing whenever agent/prompt configurations change to prevent silent accuracy drift in regulated processes.
  • •Feed findings into the human QA function for final sign-off with technical evidence for regulated activity.

Key Requirements

  • •5+ years of QA/test engineering experience, ideally including ML/LLM output validation (not just deterministic software testing).
  • •Experience defining test datasets and accuracy benchmarks for document/text-processing systems.
  • •Ability to build realistic test scenarios based on domain process familiarity (a plus).
  • •Knowledge of accuracy and completion-time KPI measurement for agent outputs.
  • •Strong understanding of regression testing approaches for iterated agent/prompt configurations.
Experience:5+ yearsML/LLMQA testing
Skills:Accuracy-focusedRegression testingData-driven evaluationAttention to detailStakeholder collaboration
Languages:English

Company Brief

Sutherland
Global digital transformation and business process services firm offering AI, automation, cloud engineering, analytics and customer experience solutions to enterprises across industries.
Industry: Professional Services
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Established Company
Funding: Private Equity Backed
Headquarters: Pittsford (Rochester), NY, United States
Founded: 1986
Glassdoor
Glassdoor: 3.5
WebsiteLinkedInGlassdoor