AI Data Engineer

About the Role

We are seeking a skilled AI Data Engineer to join our team remotely, responsible for building and maintaining robust data pipelines, ETL workflows, and data storage mechanisms that support seamless data gathering, processing, and analysis. This role involves ensuring high data quality and availability to support data-driven insights, working closely with data scientists and analysts.

Key Responsibilities

• Lead vital projects to scale and enhance the data platform in alignment with business objectives and emerging technologies within the MDO division.
• Design and develop scalable data models and pipelines to extract, load, and transform data securely on Azure services such as ADF, HDI, Databricks, Synapse, and Fabric, while maintaining data quality and compliance standards.
• Create and integrate datasets to support AI, machine learning, and Co-Pilot applications.
• Work collaboratively with data scientists, analysts, and stakeholders to identify data requirements and deliver effective solutions.
• Implement and oversee CI/CD pipelines (using YAML and Classic pipelines) for data engineering tasks through Azure DevOps.
• Proactively address data governance by planning data modeling and management procedures that satisfy legal and policy requirements and govern data accessibility within pipelines.
• Serve as a Designated Responsible Individual (DRI) to mentor engineers, maintain and monitor system health, respond to service degradation or downtime promptly, and manage incident resolution.

Qualifications

• Bachelor's degree in Computer Science, Engineering, or related fields; or a Master’s degree in Computer Science, Mathematics, Software Engineering, Computer Engineering, or equivalent experience.
• At least 5 years of experience in data engineering or a related discipline.
• Strong proficiency in programming languages including Python, Scala, or Java.
• Extensive knowledge of SQL and database systems.
• Experience working with big data technologies and Microsoft Azure ecosystem components, including PySpark, Fabric, Azure Data Factory (ADF), Databricks, and Synapse.

Notice Period and Work Mode

This position is fully remote and requires a notice period of 30 days or less for joining.

Additional Information

Applicants are encouraged to submit their details through the designated application form to seize this opportunity.