Data Engineer

Job Overview

We are seeking a skilled Data Engineer proficient in SSIS, ADF, Azure, SQL, Python, and PySpark to join our team at Bitwise Solutions Pvt Ltd in Pune, India. The ideal candidate will have a robust understanding of ETL/ELT processes and data warehousing principles to develop and maintain efficient data pipelines and warehouses.

Key Responsibilities

• Design and implement ETL/ELT pipelines using SSIS, Azure Data Factory (ADF), and related technologies.
• Develop and optimize SQL queries for data extraction, transformation, and loading, including advanced querying techniques, joins, window functions, and performance tuning.
• Build and maintain data warehouses utilizing star and snowflake schemas, fact and dimension modeling, and handling Slowly Changing Dimensions (SCD).
• Write efficient Python scripts for data processing tasks.
• Leverage PySpark for large-scale distributed data processing and transformation.

Required Skills and Expertise

• Extensive hands-on experience with SSIS, Azure Data Factory, Azure, and SQL database technologies.
• Deep knowledge of ETL/ELT methodologies and data pipeline design.
• Solid understanding of data warehousing concepts, including schema designs and dimension modeling.
• Proficiency in Python programming.
• Experience using PySpark in big data contexts.

Additional Information

No formal graduation degree is necessary to apply for this role.