Specialist - Data QA

Almosafer
Amman
Workplace: OnsiteFull timeFunction: QA, Test & Release EngineeringEducation: bachelorsSkills: ["Analytical skills","Problem-solving","Communication","Collaboration","Root-cause analysis"]

Ensure the quality, reliability, and performance of data, AI, and machine learning solutions by designing and executing data quality checks and automated test frameworks. Validate data accuracy and consistency with SQL and Python, support source-to-target reconciliation and regression testing, and evaluate AI/ML models for requirements, performance, drift, bias, and reliability. Verify GenAI/LLM/RAG outputs for factuality and hallucinations through prompt/scenario-based testing while partnering with Data, ML, Software, and Product teams on quality standards and acceptance criteria.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Almosafer
Almosafer
2 days ago

Specialist - Data QA

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 12 hours agoStatus: Live

Job Summary

Ensure the quality, reliability, and performance of data, AI, and machine learning solutions by designing and executing data quality checks and automated test frameworks. Validate data accuracy and consistency with SQL and Python, support source-to-target reconciliation and regression testing, and evaluate AI/ML models for requirements, performance, drift, bias, and reliability. Verify GenAI/LLM/RAG outputs for factuality and hallucinations through prompt/scenario-based testing while partnering with Data, ML, Software, and Product teams on quality standards and acceptance criteria.
Location: Amman
Workplace: Onsite
Employment Type: Full time
Job Function: QA, Test & Release Engineering
Seniority: Mid level

Key Responsibilities

  • •Design and execute data quality checks, including validation for accuracy, completeness, and consistency.
  • •Perform source-to-target validation and reconciliation; use SQL and Python to investigate anomalies.
  • •Develop automated testing frameworks and support regression testing for production data and ML solutions.
  • •Evaluate AI/ML models against business requirements and test for model performance, data drift, bias, and reliability.
  • •Support GenAI/LLM/RAG validation by testing response accuracy and factuality, identifying hallucinations and bias, and running prompt/scenario-based tests.

Key Requirements

  • •Bachelor’s degree in Computer Science, Data Science, Engineering, or a related field.
  • •Experience in Data QA, Data Science, Data Engineering, Machine Learning, or AI/ML testing.
  • •Strong Python and SQL skills for investigating data anomalies.
  • •Experience with automated testing frameworks (preferably PyTest) and regression testing for production data/ML solutions.
  • •Experience validating GenAI/LLM/RAG quality, including prompt engineering and AI evaluation; familiarity with MCP servers and AI agent/configuration files.
Education:Bachelor's
Skills:Analytical skillsProblem-solvingCommunicationCollaborationRoot-cause analysis
Tech Stack:PythonSQLPyTestGenAILLMRAGRagasTruLensDeepEvalOpenAIAnthropicLlamaAWSAzureGCPCI/CDMCP (Model Context Protocol)Claude Code

Company Brief

Almosafer
Almosafer is a Saudi-based online travel agency and booking platform offering flights, hotels, holiday packages, and travel services across the Middle East. It focuses on localized solutions and Arabic-language customer support for regional travelers.
Industry: TravelTech
Headquarters: Riyadh, Saudi Arabia
Founded: 2017
WebsiteLinkedIn