- 经验
- 任何
- 薪水
- —
- 职位空缺
- 1
- 发布
- 1天前
- 工作模式
- 在办公室
- 学历
- 任何毕业生
- 合格
- Any graduate can apply for this position.
- 恢复
- 需要申请
你的工作地点
职位描述
Role Overview
We are seeking a skilled GCP Data Engineer to design and implement robust, scalable data pipelines and processing solutions using Google Cloud technologies. This role demands in-depth knowledge of BigQuery, Dataflow, PySpark/Python, SQL, and Cloud Storage.
Key Responsibilities
- Develop efficient and scalable data processing pipelines on Google Cloud Platform.
- Utilize BigQuery for advanced data querying and analytics.
- Leverage Dataflow and PySpark/Python for data transformation and integration tasks.
- Manage data storage solutions using Cloud Storage services.
Additional Skills and Experience
- Familiarity with Dataproc clusters for managed Spark and Hadoop services.
- Experience using Composer (Airflow) to orchestrate workflow pipelines.
- Working knowledge of Pub/Sub messaging service for event-driven data processing.
- Understanding of CI/CD practices for data pipeline deployment.
- Experience with ETL/ELT processes and cloud data warehousing methodologies.
- Knowledge of data modeling techniques is considered a plus.
Eligibility
Applicants should hold at least a graduate degree in any discipline.