T
AWS Data Engineer
Kolkata, West Bengal, India · Tempo total
Seja o primeiro a se candidatar
- Experiência
- 6+ anos
- Salário
- —
- Vagas
- 1
- Publicado
- há 1 hora
- Modo de trabalho
- No escritório
- Educação
- Qualquer graduado
- Elegibilidade
- Graduates from any discipline can apply.
- Retomar
- Obrigatório candidatar-se
Onde você trabalhará
Descrição da vaga
Overview
Tata Consultancy Services Ltd. is seeking an experienced Data Engineer for locations in Pune, Bengaluru, NCR, Kolkata, and Hyderabad. This role requires over 6 years of professional experience and strong expertise in AWS ecosystem, Python programming, PySpark, and Databricks platforms to develop scalable data processing systems.
Key Duties
- Create and maintain ETL/ELT data pipelines using AWS technologies including Lambda, Step Functions, Glue, and S3 alongside Python scripting.
- Develop and optimize data transformation workflows leveraging PySpark and Databricks.
- Design and implement complex data transformation engines to handle large datasets efficiently.
- Manage PostgreSQL and MongoDB databases ensuring performance and reliability.
- Collaborate with software engineering teams and other stakeholders to align on data solution design.
- Participate actively in code reviews, technical discussions, and planning sessions.
- Drive automation efforts supporting continuous integration and deployment processes.
- Create and maintain technical documentation and follow industry best practices for software development.
Mandatory Expertise
- Advanced programming skills in Python.
- Good command over AWS services such as Lambda, Step Functions, Glue, S3.
- Experience in PySpark and Databricks for data processing.
- Proficient with SQL, PostgreSQL, and MongoDB databases.
- Hands-on development of ETL/ELT pipelines with large-scale data.
- Data modeling and transformation to support analytics and reporting.
Preferred Skills
- Experience with AWS Glue.
- Understanding of CI/CD and DevOps methodologies.
- Knowledge of data quality and monitoring frameworks.
- Version control using Git.
Educational Qualifications
- Bachelor's degree in Computer Science, Information Technology, Engineering, or related fields; however, equivalent experience is also considered.
Certifications
- Optional but preferred AWS certifications including AWS Certified Cloud Practitioner, Developer Associate, and Data Engineer Associate.