T
Senior AWS Data Engineer
Pune, Maharashtra, India · Tempo total
Seja o primeiro a se candidatar
- Experiência
- Qualquer
- Salário
- —
- Vagas
- 1
- Publicado
- há 1 hora
- Modo de trabalho
- No escritório
- Educação
- Qualquer graduado
- Elegibilidade
- Graduates from any discipline may apply.
- Retomar
- Obrigatório candidatar-se
Onde você trabalhará
Descrição da vaga
Overview
Tata Consultancy Services Ltd. is seeking an experienced Senior AWS Data Engineer to join their teams in Pune, Bangalore, Mumbai, or Chennai. The ideal candidate will be proficient in building and maintaining data pipelines and warehouses using AWS technologies and related tools, supporting business objectives with scalable data solutions.
Key Responsibilities
- Architect and develop robust data pipelines leveraging AWS services alongside PySpark.
- Construct and uphold efficient data ingestion, transformation, and ETL processes.
- Implement both batch and near real-time data processing mechanisms to meet business needs.
- Handle and optimize extensive, complex datasets to fulfill various requirements.
- Administer and enhance data warehouses, specifically on AWS Redshift or Hive platforms, ensuring peak performance.
- Guarantee data quality, integrity, security, and adherence to governance policies.
- Execute thorough SQL performance tuning and query optimization.
- Automate workflows to boost scalability and reliability of data platforms.
- Work cross-functionally with Product, Data, Engineering, and Business units to deliver effective data solutions.
- Develop and maintain technical documentation and assist with operational readiness.
Required Skills and Experience
- Strong expertise in Python, PySpark, Apache Spark, and SQL development including query tuning.
- Comprehensive knowledge of AWS services such as Redshift, Glue, EMR, S3, and Lambda.
- Experience with data warehousing concepts, particularly on Redshift or Hive.
- Proficient in ETL/ELT pipeline creation and management.
- Familiarity with Airflow or comparable scheduling/orchestration tools.
- Understanding of the Hadoop ecosystem and batch/near real-time data pipelines.
- Good grasp of data security, protection best practices and OLTP/OLAP database systems.
Additional Preferred Skills
- Hands-on experience with Data Lakes, Data Modeling, Netezza, Informatica.
- Knowledge of NoSQL databases like DynamoDB and MongoDB.
- Working knowledge of AWS Athena and Step Functions.
- Exposure to the Investment Banking domain is advantageous.
Eligibility
Candidates who have completed any graduate degree are eligible to apply.