GCP Data Engineer

Role Overview

We are seeking a skilled GCP Data Engineer to design and implement robust, scalable data pipelines and processing solutions using Google Cloud technologies. This role demands in-depth knowledge of BigQuery, Dataflow, PySpark/Python, SQL, and Cloud Storage.

Key Responsibilities

• Develop efficient and scalable data processing pipelines on Google Cloud Platform.
• Utilize BigQuery for advanced data querying and analytics.
• Leverage Dataflow and PySpark/Python for data transformation and integration tasks.
• Manage data storage solutions using Cloud Storage services.

Additional Skills and Experience

• Familiarity with Dataproc clusters for managed Spark and Hadoop services.
• Experience using Composer (Airflow) to orchestrate workflow pipelines.
• Working knowledge of Pub/Sub messaging service for event-driven data processing.
• Understanding of CI/CD practices for data pipeline deployment.
• Experience with ETL/ELT processes and cloud data warehousing methodologies.
• Knowledge of data modeling techniques is considered a plus.

Eligibility

Applicants should hold at least a graduate degree in any discipline.