Pyspark Data Engineer - Pan India

Role Overview and Responsibilities

We are seeking a skilled Data Engineer proficient in PySpark to design, build, test, deploy, and support large-scale data pipelines on AWS infrastructure. The candidate will work collaboratively with various teams to understand requirements and deliver robust data solutions. Key responsibilities also include developing sophisticated ETL processes to derive meaningful insights from both structured and unstructured datasets while ensuring the applications maintain high scalability, reliability, and performance standards.

Candidate Profile and Requirements

• Must have between 2 and 5 years of hands-on experience in PySpark-based development along with expertise in AWS services such as S3, Glue, and Lambda.
• Strong command over SQL including concepts like joins, aggregations, and subqueries.
• Proficiency in Python programming and familiarity with key data libraries such as NumPy and pandas.
• Experience with the DataBricks framework to develop scalable and maintainable data pipelines.
• Possession of a bachelor’s degree in any discipline like B.Sc, B.C.A., B.Tech, or B.E.

Company Overview

Infosys is a global frontrunner in digital services and consulting, aiding clients in 46 countries with their digital transformation journeys. Leveraging over three decades of experience, Infosys powers enterprises with AI-enabled core solutions and agile digital scale capabilities to enhance performance and customer satisfaction. The company also emphasizes continuous learning and innovation to sustain excellence.