- 経験
- どれでも
- 給料
- —
- 求人情報
- 1
- 投稿済み
- 21時間前
- 作業モード
- 在任中
- 教育
- 卒業生であれば誰でも
- 資格
- Any graduate can apply for this position.
- 再開する
- 応募必須
勤務地
仕事内容
Role Overview
We are seeking a skilled GCP Data Engineer to design and implement robust, scalable data pipelines and processing solutions using Google Cloud technologies. This role demands in-depth knowledge of BigQuery, Dataflow, PySpark/Python, SQL, and Cloud Storage.
Key Responsibilities
- Develop efficient and scalable data processing pipelines on Google Cloud Platform.
- Utilize BigQuery for advanced data querying and analytics.
- Leverage Dataflow and PySpark/Python for data transformation and integration tasks.
- Manage data storage solutions using Cloud Storage services.
Additional Skills and Experience
- Familiarity with Dataproc clusters for managed Spark and Hadoop services.
- Experience using Composer (Airflow) to orchestrate workflow pipelines.
- Working knowledge of Pub/Sub messaging service for event-driven data processing.
- Understanding of CI/CD practices for data pipeline deployment.
- Experience with ETL/ELT processes and cloud data warehousing methodologies.
- Knowledge of data modeling techniques is considered a plus.
Eligibility
Applicants should hold at least a graduate degree in any discipline.