AWS Databricks Engineer

About the Company

Tata Consultancy Services (TCS) is a prominent global organization specializing in IT services, consulting, and business solutions. Part of the Tata Group, TCS is renowned for its expertise in digital transformation, innovation, engineering excellence, and customer-focused service. It operates across 46 countries and holds a leadership position within the IT services sector.

Job Overview

The position is for an experienced AWS Data Engineer with specialization in Databricks. The role involves working at locations including Bengaluru, Noida, Gandhinagar, Pune, or Chennai. The ideal candidate will design, develop, and enhance scalable ETL/ELT pipelines and contribute to data lake and data warehouse solutions to empower data-centric business strategies.

Key Responsibilities

• Construct and sustain ETL/ELT processes within the Databricks environment.
• Integrate Databricks workflows with AWS data platforms and services.
• Develop and fine-tune data processing solutions leveraging Apache Spark.
• Support and maintain data lake and data warehouse systems for enhanced data management.
• Manage workflow orchestration, enforce data quality standards, and uphold governance protocols.
• Engage with business stakeholders to deliver scalable and effective data solutions.

Skills and Technical Expertise

• Proficiency with Databricks and Apache Spark frameworks.
• In-depth knowledge of AWS data services including S3, Glue, Lambda, and Redshift.
• Strong programming abilities in Python or Scala.
• Advanced command of SQL for data querying and manipulation.
• Experience in ETL/ELT development processes.
• Solid understanding of data warehousing concepts and data modeling principles.
• Familiarity with workflow orchestration tools such as Airflow or Databricks Workflows.

Candidate Qualifications

• Extensive experience of 48 years in Data Engineering (likely a typographical error or placeholder—requires clarification).
• Hands-on expertise with Databricks and AWS data ecosystem.
• Proficiency in Python or Scala programming languages along with SQL.
• Well-versed with data warehousing architecture and data modeling techniques.

Certifications

• Mandatory: AWS Databricks Associate Certification.
• Preferred: AWS Certified Data Engineer and Databricks Certified Data Engineer.

Additional Information

The job location can be at Bengaluru, Noida, Gandhinagar, Pune, or Chennai. Candidates should have a B.Tech or B.E. degree in any specialization to be eligible for this position.