Data Engineer

Role Overview

As a Data Engineer at EasyRewardz Software Services Private Limited in Gurugram, you will be responsible for creating and managing data pipelines to extract meaningful insights from extensive datasets. Your role involves collaborating with various internal teams to understand business needs and delivering effective data solutions.

Key Responsibilities

• Design, build, validate, and deploy data flow pipelines utilizing Airflow for orchestrating tasks.
• Work closely with cross-functional stakeholders to capture requirements and craft solutions that satisfy business goals.
• Author Python scripts integrating PySpark to efficiently handle and analyze large-scale data.
• Identify and resolve problems within current data pipelines, enhancing their efficiency and reliability.
• Maintain data accuracy and consistency through rigorous validation and testing processes.

Experience and Skills Requirements

• In-depth knowledge of Airflow as a workflow orchestration platform.
• Proficient with Python, especially in leveraging PySpark for big data computations.
• Competent in architecting and developing data systems that scale effectively.
• Strong analytical mindset complemented by meticulous attention to detail.
• Ability to collaborate productively within team settings.
• Experience or familiarity with data analytics and visualization tools is beneficial.

Eligibility

This position welcomes candidates regardless of graduation status, emphasizing skill and experience over formal education.