VLM Engineer

Technology Innovation Institute
United Arab Emirates
Workplace: OnsiteFull timeFunction: Data Science & Machine LearningEducation: phdSkills: ["Analytical skills","Collaboration","Research and development","Evaluation mindset","Data analysis"]

Work on the Extreme-Scale Language Model team to advance vision-language and large language model research. Conduct vision model and data ablation studies, collaborate on identifying optimal data types for training, and develop evaluation protocols across benchmarks and real-world scenarios. Help train and optimize models, including integrating LLMs with vision models such as CLIP, using distributed and multi-GPU deep learning practices.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Technology Innovation Institute
Technology Innovation Institute
11 months ago

VLM Engineer

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 2 hours agoStatus: Live

Job Summary

Work on the Extreme-Scale Language Model team to advance vision-language and large language model research. Conduct vision model and data ablation studies, collaborate on identifying optimal data types for training, and develop evaluation protocols across benchmarks and real-world scenarios. Help train and optimize models, including integrating LLMs with vision models such as CLIP, using distributed and multi-GPU deep learning practices.
Location: United Arab Emirates
Workplace: Onsite
Employment Type: Full time
Job Function: Data Science & Machine Learning

Key Responsibilities

  • •Conduct comprehensive ablation studies on vision model components and configurations, and report findings with researchers.
  • •Perform data ablation studies to identify optimal data types and structures for training vision-language models, including vision-language alignment effects.
  • •Develop and implement evaluation protocols to assess vision-language model performance across benchmarks and real-world scenarios.
  • •Engage in model training and optimization, emphasizing integration of LLMs with vision models like CLIP.
  • •Collaborate with team members on research execution, analysis, and communication of results.

Key Requirements

  • •PhD degree in deep learning.
  • •Expertise in machine learning with strong focus on vision-language models and LLMs.
  • •Strong understanding of model architectures such as CLIP for vision-language tasks.
  • •Experience with distributed training techniques and multi-GPU optimization.
  • •Deep learning framework proficiency, e.g., PyTorch, with analytical skills for ablation and evaluation.
Experience:Deep learningVision-language modelsLLMsDistributed trainingResearch
Education:PhD / Doctorate in deep learning
Skills:Analytical skillsCollaborationResearch and developmentEvaluation mindsetData analysis
Tech Stack:PyTorchCLIPLLMsDeep learningDistributed trainingMulti-GPU training

Company Brief

Technology Innovation Institute
Government-backed applied research institute in Abu Dhabi focused on advanced technology development across AI, robotics, quantum, cryptography, autonomous systems, and other deep-tech fields. It collaborates with industry and academia to turn research into practical solutions.
Industry: Scientific Research
Company Size: Enterprise (1,001+ employees)
Growth: Government & Public Sector
Funding: Government Funded
Headquarters: Abu Dhabi, United Arab Emirates
Founded: 2020
WebsiteLinkedIn