- Experiência
- Mais de 5 anos
- Salário
- —
- Vagas
- 1
- Publicado
- há 1 hora
- Modo de trabalho
- Trabalhe em casa
- Educação
- B.Tech / B.E.
- Elegibilidade
- Candidates possessing a Bachelor of Technology (B.Tech) or Bachelor of Engineering (B.E.) degree in any specialization are eligible to apply.
- Retomar
- Obrigatório candidatar-se
Descrição da vaga
About the Role
We are seeking a skilled AI Data Engineer to join our team remotely, responsible for building and maintaining robust data pipelines, ETL workflows, and data storage mechanisms that support seamless data gathering, processing, and analysis. This role involves ensuring high data quality and availability to support data-driven insights, working closely with data scientists and analysts.
Key Responsibilities
- Lead vital projects to scale and enhance the data platform in alignment with business objectives and emerging technologies within the MDO division.
- Design and develop scalable data models and pipelines to extract, load, and transform data securely on Azure services such as ADF, HDI, Databricks, Synapse, and Fabric, while maintaining data quality and compliance standards.
- Create and integrate datasets to support AI, machine learning, and Co-Pilot applications.
- Work collaboratively with data scientists, analysts, and stakeholders to identify data requirements and deliver effective solutions.
- Implement and oversee CI/CD pipelines (using YAML and Classic pipelines) for data engineering tasks through Azure DevOps.
- Proactively address data governance by planning data modeling and management procedures that satisfy legal and policy requirements and govern data accessibility within pipelines.
- Serve as a Designated Responsible Individual (DRI) to mentor engineers, maintain and monitor system health, respond to service degradation or downtime promptly, and manage incident resolution.
Qualifications
- Bachelor's degree in Computer Science, Engineering, or related fields; or a Master’s degree in Computer Science, Mathematics, Software Engineering, Computer Engineering, or equivalent experience.
- At least 5 years of experience in data engineering or a related discipline.
- Strong proficiency in programming languages including Python, Scala, or Java.
- Extensive knowledge of SQL and database systems.
- Experience working with big data technologies and Microsoft Azure ecosystem components, including PySpark, Fabric, Azure Data Factory (ADF), Databricks, and Synapse.
Notice Period and Work Mode
This position is fully remote and requires a notice period of 30 days or less for joining.
Additional Information
Applicants are encouraged to submit their details through the designated application form to seize this opportunity.
Habilidades
Estilos de trabalho que eles procuram
Resolução de Problemas
Colaboração
Proactive Monitoring