- Esperienza
- Qualsiasi
- Stipendio
- —
- Aperture
- 1
- Pubblicato
- 20 ore fa
- Modalità di lavoro
- In ufficio
- Istruzione
- Qualsiasi laureato
- Requisiti di ammissibilità
- Any graduate can apply for this position.
- Riprendere
- È necessario candidarsi
Dove lavorerai
Descrizione del lavoro
Role Overview
We are seeking a skilled GCP Data Engineer to design and implement robust, scalable data pipelines and processing solutions using Google Cloud technologies. This role demands in-depth knowledge of BigQuery, Dataflow, PySpark/Python, SQL, and Cloud Storage.
Key Responsibilities
- Develop efficient and scalable data processing pipelines on Google Cloud Platform.
- Utilize BigQuery for advanced data querying and analytics.
- Leverage Dataflow and PySpark/Python for data transformation and integration tasks.
- Manage data storage solutions using Cloud Storage services.
Additional Skills and Experience
- Familiarity with Dataproc clusters for managed Spark and Hadoop services.
- Experience using Composer (Airflow) to orchestrate workflow pipelines.
- Working knowledge of Pub/Sub messaging service for event-driven data processing.
- Understanding of CI/CD practices for data pipeline deployment.
- Experience with ETL/ELT processes and cloud data warehousing methodologies.
- Knowledge of data modeling techniques is considered a plus.
Eligibility
Applicants should hold at least a graduate degree in any discipline.