- Experiencia
- 2–6 yrs
- Salario
- —
- Vacantes
- 1
- Al corriente
- Hace 5 horas
- Modo de trabajo
- En la oficina
- Educación
- Cualquier graduado
- Elegibilidad
- Candidates with any graduate degree are eligible to apply.
- Reanudar
- Se requiere solicitud
Dónde trabajarás
Descripción del trabajo
About eClerx
eClerx is a global provider of business process management, automation, and analytics solutions serving numerous Fortune 2000 companies across diverse sectors such as financial services, communications, retail, fashion, media, manufacturing, travel, and technology. Established in 2000, the company is publicly listed on the Bombay and National Stock Exchanges of India and employs over 13,000 professionals worldwide across locations including Australia, Canada, Germany, India, Italy, Netherlands, Philippines, Singapore, Thailand, UK, and USA.
Role Responsibilities
- Utilize solid expertise in Python programming to develop and optimize data processes.
- Apply hands-on experience with PySpark, Spark SQL, and distribute data processing workflows efficiently.
- Design and implement ETL pipelines alongside data wrangling tasks to manage and manipulate large datasets.
- Optimize performance tuning for Apache Spark applications to enhance data processing effectiveness.
- Work with SQL databases, data lake architectures, and be familiar with big data ecosystems, including optional use of Hadoop and Hive.
- Employ version control using Git and manage workflow orchestration tools like Apache Airflow.
- Collaborate effectively in Agile team environments, utilizing strong analytical and problem-solving capabilities.
Candidate Qualifications
- Bachelor’s degree holder with 2 to 6 years' relevant experience primarily in Python development.
- Proven programming skills in Python and practical knowledge of PySpark and Spark SQL.
- Exposure to ETL processes, data wrangling techniques, and performance optimization in distributed systems.
- Understanding of SQL, data lakes, and optional familiarity with Hadoop and Hive.
- Knowledge of source control tools such as Git and workflow orchestration platforms like Airflow.
- Basic experience or knowledge of cloud providers such as AWS, Google Cloud Platform, or Microsoft Azure is an advantage.
- Strong analytical thinking and problem-solving skills with experience working in Agile methodologies.
Eligibility
Open to candidates possessing any graduate degree.