Data Engineer

Role Overview

The position involves evaluating complex new data sources derived from both SAP and non-SAP systems, swiftly transforming these into business-insightful datasets, and integrating them into our Azure Data platform. A key responsibility is analyzing structured, semi-structured, and unstructured data to assess their quality, completeness, and business relevance.

Key Responsibilities

• Conduct detailed analysis of various data formats for integrity and business importance.
• Design, document, develop, implement, and test rapid prototypes to showcase data value to different stakeholders.
• Engage in early design phases and defining new features.
• Architect, build, and deploy robust scalable data pipelines on the Microsoft Azure data platform with Azure Databricks.
• Create reusable and scalable data integration pipelines.
• Collaborate effectively with team members across engineering disciplines to transition prototypes into mainline intelligence products.

Skill and Experience Requirements

• Advanced expertise with relational and non-relational database systems.
• Proven experience in constructing and optimizing big data pipelines, architectures, and datasets.
• Strong analytical abilities with unstructured data.
• Proficiency in Azure Data Factory, Azure Databricks, EventHub, Python, PySpark, Azure Synapse, and SQL.
• Mandatory experience with Azure DevOps for deploying data components.
• Seven or more years of Azure domain experience, including at least five years relevant to this role.
• At least three full-cycle implementations of analytics solutions on the Azure platform.
• Experience within the automotive industry is essential.
• Knowledge of the Azure cloud stack.
• Familiarity with SAP IS-Auto, SAP BW/BO, Tableau, and PowerBI considered a strong plus.
• Certifications on Azure platform tools are advantageous.
• Bachelor’s degree in Computer Science or a closely related field required.