Vision-Language Model Engineer

About the Organization

Technology Innovation Institute (TII) is a government-funded research establishment located in Abu Dhabi, UAE. It hosts a varied international team of leading scientists, engineers, mathematicians, and researchers committed to transforming challenges into groundbreaking research and prototype technologies that advance society.

Artificial Intelligence and Digital Research Centre

Within TII's Artificial Intelligence Research Center, the Extreme-Scale Language Model team focuses on developing and applying innovative deep learning technologies with applications ranging from Natural Language Processing to Perception and Vision. The team has previously developed Falcon models and is advancing research into large language models.

Position Overview and Responsibilities

• Perform extensive ablation studies on vision models to evaluate how different components and configurations influence performance, working closely with researchers to analyze and document findings.
• Collaborate on data ablation studies to identify the most effective data types and structures for training vision-language models, with a focus on vision-language alignment impacts.
• Design and execute comprehensive evaluation methodologies for vision-language models, benchmarking against diverse tasks and real-world use cases.
• Engage in training and optimizing models, particularly integrating large language models with vision systems such as CLIP.

Required Skills and Expertise

• Advanced machine learning knowledge, specialized in vision-language models and large language models (LLMs).
• Deep understanding of architectures like CLIP relevant to vision-language tasks.
• Experience with distributed training approaches and multi-GPU performance optimization.
• Proficiency with deep learning frameworks, such as PyTorch.
• Strong analytical capability for conducting ablation research and evaluating model outcomes.
• Familiarity with preparing and managing datasets for vision and language applications.

Educational Qualifications

• PhD in deep learning or a related field.
• Demonstrated research and development experience in vision-language models.
• Publications in leading conferences are highly advantageous.

Additional Information

At TII, we pursue solutions to significant societal challenges via rigorous scientific investigation, utilizing cutting-edge infrastructural support and collaborations with top international institutions. Our research spans AI, advanced materials, autonomous robotics, cryptography, digital security, directed energy, quantum computing, and secure systems.