Quality Analyst

About the Role

We are seeking a Quality Analyst based in Abu Dhabi to join our team in the Defense & Aerospace sector. The candidate will be responsible for ensuring the accuracy and reliability of AI-driven systems through rigorous testing and validation.

Key Responsibilities

• Verify data pipelines, ensure data integrity, and reconcile data across source systems, backend services, and AI-generated outputs.
• Conduct thorough testing on frontend, backend, APIs, and complete end-to-end processes within AI applications.
• Assess outputs from AI, Machine Learning models, and Large Language Models for precision, relevance, and consistency.
• Evaluate and identify errors or hallucinations in Retrieval-Augmented Generation (RAG) outputs, chatbot interactions, and AI-created content.
• Develop and implement comprehensive test cases, plans, validation scenarios as well as perform regression testing.
• Maintain detailed defect documentation, track issues systematically, and collaborate with development teams to resolve problems.
• Continuously monitor production data quality and system outputs to suggest enhancements.
• Work closely with cross-functional teams including AI, Backend, Frontend, and Product departments on quality assurance and validation initiatives.
• Generate and present reports covering quality metrics, defect tracking, and validation results.

Qualifications and Experience

• Bachelor's degree is required.
• 2 to 5 years of relevant experience in quality assurance, preferably within AI, defense, or aerospace industries.
• Strong command of the English language.