Kafka, Java, and Data Engineer

About the Role

Cognizant is seeking experienced Kafka, Java, and Data Engineers to design and develop scalable streaming pipelines and data platforms capable of managing large volumes of data, both in batch and real-time modes. The role demands considerable expertise in distributed systems and hands-on experience with modern big data technologies and cloud services.

Key Responsibilities

• Architect and implement real-time streaming data pipelines using Kafka.
• Develop high-throughput, fault-tolerant producers and consumers.
• Take ownership of both development and troubleshooting, addressing any post-production issues effectively.
• Build event-driven architectures leveraging Kafka technology.
• Lead around 70% of the time in design, architecture, and coding, and 30% in mentoring, guidance, and coordinating the team.
• Demonstrate ability to write optimized code in Java, Kafka, Python, or PySpark within a time-restricted setting, emphasizing data quality and transformations.
• Resolve bugs and issues in existing code samples under time constraints.

Required Technical Expertise

• Proficiency in Java, Kafka, and the Hadoop ecosystem including Spark, Hive, YARN, and HDFS.
• Familiarity with Scala and Cassandra database.
• Experience working in Linux environments, using on-premises setups.
• Hands-on experience with CI/CD tools such as Jenkins and GitHub.
• Monitoring and observability knowledge with tools like Dynatrace.
• Working knowledge of Databricks, Azure cloud PaaS services, Azure Data Factory, Azure Data Lake Storage (ADLS), Kubernetes, Docker, and CI/CD pipelines.
• Strong scripting and ETL capabilities using Pandas, Pola.rs, PySpark, and Ibis.
• Deep understanding of SQL and NoSQL databases including Cassandra and MongoDB.
• Grasp of distributed system architecture concepts such as caching, replication, and data modeling.
• Experience working with workflow orchestration tools like NiFi, Griffin, Hamilton, or Airflow.

Additional Qualifications

• Excellent communication skills in both written and verbal forms.
• Experience working within Agile development frameworks.
• Functional knowledge or experience in retail banking, capital markets, or securities processing is advantageous.

Interview Process

Candidates will be evaluated on their ability to write accurate, efficient code in Java, Kafka, Python, or PySpark under a limited time-frame without AI assistance. This will include coding for data quality, transformation scenarios, and debugging existing code.

Eligibility and Education

Open to all graduates meeting the technical criteria.

Location

This role is based in Bengaluru, India and requires on-site presence.