LLM Research & Validation Specialist

Abu Dhabi Islamic Bank
Abu Dhabi
Workplace: OnsiteFull timeFunction: Research & Scientific (R&D)Experience: 1-3 yearsEducation: mastersSkills: ["Technical writing","Communication","Critical reading","Mentorship","Stakeholder management"]

Lead independent validation of LLMs, multimodal models, RAG systems, and agentic AI used or proposed by ADIB. Develop reproducible evaluation harnesses and adversarial test suites to quantify uncertainty, robustness, factuality, retrieval quality, grounding, and safety risks such as prompt/tool injection and failure propagation. Produce evidence-based validation reports, challenge model owners and vendors, and maintain reusable Python validation tooling and automation.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Abu Dhabi Islamic Bank
Abu Dhabi Islamic Bank
22 hours ago

LLM Research & Validation Specialist

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 12 hours agoStatus: Live

Job Summary

Lead independent validation of LLMs, multimodal models, RAG systems, and agentic AI used or proposed by ADIB. Develop reproducible evaluation harnesses and adversarial test suites to quantify uncertainty, robustness, factuality, retrieval quality, grounding, and safety risks such as prompt/tool injection and failure propagation. Produce evidence-based validation reports, challenge model owners and vendors, and maintain reusable Python validation tooling and automation.
Location: Abu Dhabi
Workplace: Onsite
Employment Type: Full time
Job Function: Research & Scientific (R&D)
Seniority: Mid level

Key Responsibilities

  • •Lead independent validation of LLM, multimodal, RAG, and agentic AI use cases across design, implementation, deployment, and ongoing monitoring.
  • •Assess transformer architecture and model components (tokenisation, embeddings, attention, context-window behaviour, decoding, fine-tuning, alignment, quantisation, inference configuration).
  • •Design reproducible evaluation harnesses and adversarial test suites (golden datasets, counterfactual tests, canary sets) with statistically defensible acceptance criteria.
  • •Conduct deep testing for prompt injection, indirect injection, data leakage, tool-use safety, excessive agency, multi-step failure propagation, kill-switches, and human oversight.
  • •Build reusable Python validation toolkits and automated test pipelines; document findings and prepare validation reports and governance briefings; mentor junior validators.

Key Requirements

  • •Master’s degree in Theoretical Physics, Applied Physics, Mathematics, Applied Mathematics, or a closely related quantitative discipline.
  • •1–3 years of relevant experience in AI research, machine learning, quantitative modelling, model validation, scientific computing, or a closely related field.
  • •Deep understanding of probability, statistics, linear algebra, optimisation, numerical computation, experimental design, and uncertainty quantification.
  • •Strong understanding of transformers/LLM training and inference, embeddings, RAG, fine-tuning, alignment, evaluation, agentic systems, and AI safety failure modes.
  • •Advanced Python proficiency and experience with scientific/ML libraries; exposure to PyTorch, Hugging Face, evaluation frameworks, experiment tracking, SQL, Git, and cloud AI platforms is expected.
Experience:1-3 yearsAI researchMachine learningModel validationScientific computing
Education:Master's in Theoretical Physics, Applied Physics, Mathematics, Applied Mathematics (or closely related quantitative discipline)
Skills:Technical writingCommunicationCritical readingMentorshipStakeholder management
Tech Stack:PythonPyTorchHugging FaceSQLGit

Company Brief

Abu Dhabi Islamic Bank
Abu Dhabi Islamic Bank (ADIB) is a public Islamic bank providing retail, corporate, wealth and investment banking services across the UAE and international markets, offering Sharia-compliant financial products and digital banking solutions.
Industry: Banking
Company Size: Enterprise (1,001+ employees)
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Abu Dhabi, United Arab Emirates
Founded: 1997
Glassdoor
Glassdoor: 3.5
WebsiteLinkedInGlassdoor