Big Data Engineer

Role overview

Infosys is looking for a Big Data Engineer to design and support scalable data processing solutions for batch and streaming use cases. The role is based in Hyderabad, India, with PAN India location preference, and requires 5-15 years of experience.

What you will do

• Design, build, and support large-scale Spark and Scala pipelines for both batch and real-time data processing.
• Create and improve Hive-based workflows for querying, transforming, and organizing data for warehouse consumption.
• Set up dependable ingestion and integration approaches for high-volume datasets while maintaining quality, consistency, and completeness.
• Develop reusable Spark utilities, jobs, and frameworks that help standardize engineering practices across teams.
• Optimize Spark performance through better partitioning, caching, shuffle handling, memory management, and runtime tuning.
• Partner with stakeholders to understand data needs and produce well-structured datasets for downstream users and systems.
• Build monitoring, alerting, and runbook support to improve pipeline stability and speed up incident handling.
• Review code, promote engineering standards, and contribute to ongoing improvements in the data platform.

Preferred qualifications and technical strengths

• Practical experience with Kafka for streaming ingestion and event-driven pipelines.
• Ability to design end-to-end data architectures covering ingestion, processing, storage, and serving layers.
• Strong knowledge of partitioning strategies, file formats, and efficient processing approaches for big data systems.
• Experience leading technical discussions, guiding engineers, and encouraging best practices across delivery teams.
• Comfort with automated checks, data quality validation, and reliability-focused operations.

Good-to-have tools

Hadoop, HDFS, YARN, Airflow, and HBase are desirable additions to the profile.

Additional information

Employment type: job. Location: Hyderabad, India. Preferred location flexibility: PAN India. Experience required: 5 to 15 years.

Eligibility

Candidates with a B.Tech or B.E. degree in any specialization can apply.

About Infosys

Infosys is a global leader in digital services and consulting. With more than four decades of experience and a workforce of over 300,000, the company supports clients in over 50 countries through cloud-enabled transformation, AI-powered core systems, agile digital delivery, and continuous learning. Infosys emphasizes sustainability, good governance, and an inclusive environment where diverse talent can thrive.