Hadoop Administrator Contract Role

Role Overview

This contract position is for a Hadoop Administrator based in Kolkata, India. The role focuses on running and improving big data infrastructure that supports banking workloads, with responsibility for cluster health, reliability, security, and coordination with data engineering teams.

Company Overview

RiDiK is part of CLPS Incorporation (Nasdaq: CLPS) and delivers consulting and technology solutions to organizations ranging from startups to large enterprises. Its work spans business consulting, dashboard development, strategy planning, technology architecture, and process improvement.

Key Responsibilities

• Set up, tune, and support Apache Spark clusters.
• Track cluster behavior, identify issues, and resolve Spark job failures.
• Administer Linux servers and use Bash or Python scripts to automate recurring tasks.
• Oversee Starburst/Trino environments, including cluster configuration and connector management.
• Maintain platform security, access permissions, and compliance with banking requirements.
• Partner with data engineering and analytics teams to improve performance.
• Keep essential banking data pipelines highly available and stable.

Required Experience and Skills

• At least 8 years of experience administering Spark and other big data platforms.
• Strong Linux administration background, preferably on RHEL.
• Practical experience with Starburst/Trino.
• Working knowledge of the Hadoop stack, including HDFS, Hive, and Ranger.
• Ability to automate and script using Bash and Python.
• Good understanding of authentication, networking, and security concepts.

Preferred Background

• Exposure to cloud platforms such as AWS, Azure, or GCP.
• Experience working with banking data flows and governance practices.

Additional Information

For any queries, please contact HR Sriram at 9600808162.

Eligibility

Candidates with any graduate qualification may apply.