i
Data Engineer (Azure Fabric)
Sydney, New South Wales, Australia · Full Time
Be the first to apply
- Experience
- 10+ yrs
- Salary
- —
- Openings
- 1
- Posted
- há 3 horas
- Work mode
- In office
- Eligibility
- Applicants must have full working rights in Australia, preferably located in Sydney or Melbourne.
- Resume
- Required to apply
Where you'll work
Job description
About the Role
- Actively gather client requirements and design appropriate data solutions.
- Bring over 10 years of total professional experience, including at least 5 years specializing as a Data Engineer.
Location
Position based in Sydney or Melbourne with full working rights in Australia.
Responsibilities
- Engage hands-on as a Data Engineer focusing on data ingestion and ETL processes using Azure Fabric.
- Integrate and connect data from multiple source systems for ingestion.
- Implement ETL pipelines with Dataflow Gen2 to ingest raw data into the Bronze data layer.
- Perform data cleansing, de-normalization, and transfer data into the Silver layer.
- Create and maintain scheduled ingestion jobs for data pipelines.
- Develop reconciliation workflows to ensure data integrity.
- Establish monitoring and logging mechanisms for tracking data flows and processes.
Required Skills
- Demonstrable project experience using Azure Fabric or Databricks platforms.
- Proficiency with Dataflow Gen2 or Azure Data Factory (ADF).
- Experience working with Dataverse environments.
- Knowledge of OData APIs for data integration.
- Familiarity with Data API Builder (DAB) tools.
- Practical expertise implementing the Medallion Architecture across various data layers (Bronze, Silver, Gold).