AI Test Engineer -Testing Services (INDIA - BENGALURU - AUTOMOTIVE, IN)

Birlasoft
Bengaluru
Workplace: HybridFull timeFunction: QA, Test & Release EngineeringExperience: 4-5 yearsSkills: ["Collaboration","Attention to detail","Problem-solving"]

Define and implement end-to-end test strategies for AI-enabled applications, including Generative AI, LLM, RAG, and AI agent workflows. Design and execute functional, integration, regression, system, and UAT testing, validate RESTful APIs, and build API automation frameworks. Validate model outputs for accuracy, relevance, consistency, hallucinations, bias, and toxicity, test prompt and RAG scenarios, and verify guardrails and responsible AI compliance. Perform SQL-based database validation and performance/load testing while collaborating with product, engineering, and ML teams.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Birlasoft
Birlasoft
1 day ago

AI Test Engineer -Testing Services (INDIA - BENGALURU - AUTOMOTIVE, IN)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 13 hours agoStatus: Live

Job Summary

Define and implement end-to-end test strategies for AI-enabled applications, including Generative AI, LLM, RAG, and AI agent workflows. Design and execute functional, integration, regression, system, and UAT testing, validate RESTful APIs, and build API automation frameworks. Validate model outputs for accuracy, relevance, consistency, hallucinations, bias, and toxicity, test prompt and RAG scenarios, and verify guardrails and responsible AI compliance. Perform SQL-based database validation and performance/load testing while collaborating with product, engineering, and ML teams.
Location: Bengaluru
Workplace: Hybrid
Employment Type: Full time
Job Function: QA, Test & Release Engineering
Seniority: Mid level

Key Responsibilities

  • •Define and implement end-to-end test strategies for AI-enabled applications.
  • •Design and execute test plans for Generative AI, LLM, RAG, and AI Agent workflows.
  • •Perform functional, integration, regression, system, and UAT testing.
  • •Validate RESTful APIs and develop/maintain API automation frameworks.
  • •Validate AI model responses (accuracy, relevance, consistency, hallucinations, bias, toxicity), test prompts and RAG pipelines, and verify AI guardrails and compliance.

Key Requirements

  • •4–5 years of experience in AI testing/quality engineering.
  • •Define and implement end-to-end test strategies for AI-enabled applications.
  • •Design and execute functional, integration, regression, system, and UAT testing for GenAI/LLM/RAG/AI agent workflows.
  • •Validate RESTful APIs and build/maintain API automation frameworks.
  • •Validate AI outputs (accuracy, relevance, consistency, hallucinations, bias, toxicity) plus prompt engineering, RAG pipelines, and responsible AI guardrails.
Experience:4-5 yearsAIGenerative AILLMRAG
Skills:CollaborationAttention to detailProblem-solving
Tech Stack:PostmanSwaggerREST AssuredRESTful APIsSQL

Company Brief

Birlasoft
Birlasoft is a global IT services and digital solutions provider delivering consulting, enterprise applications, cloud, and infrastructure services to enterprises across industries, helping accelerate digital transformation and business modernization.
Industry: Professional Services
Company Size: Enterprise (1,001+ employees)
Revenue: USD 500M to 1B
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Noida, India
WebsiteLinkedIn