AI Quality Engineer

RAKBANK
Dubai, United Arab Emirates
Workplace: HybridFull timeFunction: QA, Test & Release EngineeringExperience: 8-10 yearsEducation: bachelorsSkills: ["Analytical","Stakeholder management","Problem-solving","Mentoring"]

Lead end-to-end quality engineering for generative, conversational, agentic AI, and intelligent automation initiatives. Define AI testing strategies and release-readiness criteria, evaluate and benchmark LLMs for accuracy, safety, and latency, and build testing frameworks for RAG evaluation, hallucination detection, and AI safety. Automate testing using Python, PyTest, Playwright, API automation, and CI/CD quality gates, and ensure chatbot/assistant copilot quality across multi-turn English/Arabic journeys.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
RAKBANK
RAKBANK
2 days ago

AI Quality Engineer

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 15 hours agoStatus: Live

Job Summary

Lead end-to-end quality engineering for generative, conversational, agentic AI, and intelligent automation initiatives. Define AI testing strategies and release-readiness criteria, evaluate and benchmark LLMs for accuracy, safety, and latency, and build testing frameworks for RAG evaluation, hallucination detection, and AI safety. Automate testing using Python, PyTest, Playwright, API automation, and CI/CD quality gates, and ensure chatbot/assistant copilot quality across multi-turn English/Arabic journeys.
Location: Dubai, United Arab Emirates
Workplace: Hybrid
Employment Type: Full time
Job Function: QA, Test & Release Engineering
Seniority: Manager level

Key Responsibilities

  • •Lead end-to-end quality engineering for generative AI, conversational AI, agentic AI, and intelligent automation solutions.
  • •Define AI testing strategies, evaluation frameworks, quality standards, and release-readiness criteria.
  • •Evaluate and benchmark LLMs for accuracy, safety, relevance, latency, groundedness, and cost.
  • •Design and implement AI testing frameworks for RAG evaluation, hallucination detection, AI safety, prompt validation, and model regression.
  • •Mentor QA and automation teams and partner with Product, Engineering, and Data Science teams to embed quality across the AI development lifecycle.

Key Requirements

  • •Bachelor's degree plus 8-10 years of testing experience, including at least 3 years supporting banking technology projects in a lead or SME capacity.
  • •Strong expertise in Generative AI, Conversational AI, Agentic AI testing, LLM evaluation, RAG frameworks, and AI quality assurance methodologies.
  • •Hands-on experience with Python, PyTest, Playwright, and API automation, including test automation and AI quality assurance.
  • •Knowledge of AI safety testing, prompt injection/jailbreak testing, hallucination detection, privacy controls, and guardrail validation.
  • •Experience integrating automated testing and AI evaluation into Azure DevOps, Jenkins, GitLab, and modern CI/CD pipelines.
Experience:8-10 yearsBankingDigital bankingGenerative AIConversational AIIntelligent automation
Education:Bachelor's
Skills:AnalyticalStakeholder managementProblem-solvingMentoring
Languages:EnglishArabic
Tech Stack:PythonPyTestPlaywrightAPI automationCI/CDAzure DevOpsJenkinsGitLabUiPath Test SuiteRAGLLM evaluationRPAJiraEmbeddingsVector databases

Company Brief

RAKBANK
RAKBANK is a United Arab Emirates-based bank offering personal, business, and commercial banking services, including accounts, cards, loans, deposits, and digital banking products. It serves retail customers and SMEs across the UAE.
Industry: Banking
Company Size: Large (251 to 1,000 employees)
Revenue: USD 1B+
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Ras Al Khaimah, United Arab Emirates
Founded: 1976
WebsiteLinkedIn