Data Engineer - Data Platforms (AWS)

About IBM Consulting

IBM Consulting builds long-standing partnerships with clients and works with organizations around the world to help them evolve their hybrid cloud and AI initiatives. Backed by IBM technology, Red Hat, and strategic alliances, the team focuses on creating practical change and delivering measurable business outcomes. The culture values curiosity, innovation, empathy, and continuous professional growth.

Role Overview

As a Data Engineer focused on Data Platforms on AWS, you will design, implement, and support data engineering solutions within the AWS ecosystem. The role centers on building both batch and streaming pipelines, shaping data layers, and ensuring reliable operation of data services across the platform.

Key Work Areas

• Plan, develop, and run batch and real-time pipelines using AWS services such as EMR, Glue, Glue Catalog, and Kinesis.
• Build and maintain data layers on Redshift, Aurora, and DynamoDB, and handle data migration through AWS DMS.
• Schedule and administer data services on AWS so that platform operations remain efficient and stable.
• Develop data pipelines for data warehouse and data lake environments using Kinesis and Managed Streaming for Apache Kafka.
• Apply open-source tools such as Apache Airflow and dbt, along with Spark/Python or Spark/Scala on AWS.
• Work with AWS Glue Databrew for data preparation and quality-related activities.
• Use Lambda functions with Python for data processing and transformation tasks.
• Support warehousing and analytics use cases through Redshift Spectrum.

Skills and Exposure

The role calls for practical experience with AWS-based data engineering, streaming and batch processing, orchestration tools, and data platform components. Familiarity with cloud-native data services, data movement, and scalable processing frameworks is important.

Eligibility

Applicants with any graduate degree are eligible to apply.

Additional Information

This opportunity is based in Navi Mumbai, India. No salary, stipend, joining date, application deadline, number of openings, or duration details were provided in the source.