DevOps Engineer

Role Overview

We seek a certified DevOps Engineer with over five years of practical experience, proficient in bridging infrastructure, development, and data engineering workflows. This position demands mastery in continuous integration and deployment (CI/CD), cloud environments, and data pipelines, enabling the construction of scalable, dependable, and automated systems.

Core Responsibilities

• Design, deploy, and administer scalable cloud infrastructure across major platforms such as AWS, Azure, or Google Cloud.
• Create and sustain CI/CD pipelines tailored for both application and data processing workflows.
• Implement automated deployment using Infrastructure as Code tools like Terraform or CloudFormation.
• Monitor operational performance and system availability using Prometheus, Grafana, or equivalent cloud-native monitoring services.
• Architect and oversee ETL/ELT pipelines for efficient data ingestion and transformation processes.
• Develop scalable data workflows leveraging orchestration tools such as Apache Airflow, AWS Glue, or Azure Data Factory.
• Ensure consistent data quality and validation throughout pipeline operations.
• Optimize systems for batch and real-time data processing demands.
• Apply role-based access controls (RBAC) and maintain cloud security best practices.
• Manage sensitive information, including secrets and credentials, securely.
• Adhere to organizational data governance and security standards and compliance.
• Automate infrastructure provisioning and application deployment to enhance productivity.
• Integrate third-party tools, APIs, and diverse data sources seamlessly into workflows.
• Facilitate cohesive collaboration among development, quality assurance, and data teams.

Professional Experience and Skills

• Minimum of 5 years in DevOps or Cloud Engineering roles.
• Proficient with CI/CD platforms such as GitHub Actions, Jenkins, or GitLab CI/CD.
• Experienced in containerization technologies including Docker and Kubernetes.
• Skilled in Infrastructure as Code, with preference for Terraform expertise.
• Certified on cloud platforms (AWS, Azure, or GCP) targeting DevOps competencies.
• Comprehensive understanding of cloud computing services encompassing compute, storage, networking, and access management (IAM).
• Strong Linux system administration and networking fundamentals.
• Able to troubleshoot deployment and cloud infrastructure challenges effectively.
• Proven experience in constructing and maintaining ETL/ELT data pipelines.
• Practical knowledge of data orchestration tools such as Airflow, Databricks, or Glue.
• Fluent in SQL with experience on databases like PostgreSQL, MySQL, BigQuery, or Snowflake.
• Familiar with data warehousing concepts, including Medallion Architecture and data lakes.

Additional Preferred Competencies

• Experience with streaming platforms like Kafka, Kinesis, or Pub/Sub.
• Understanding of machine learning operations (MLOps) and AI pipeline design.
• Use of monitoring and logging tools such as the ELK Stack or Datadog.
• Ability to script in Python or Bash to automate tasks and processes.

Educational Background

Bachelor's degree in Computer Science, Information Technology, or a related discipline.