DLH Support Engineer

About the Role

Mobilink Bank seeks a dedicated DLH Support Engineer to manage and support their Data Lakehouse (DLH) infrastructure. The position focuses on overseeing pipelines within an ecosystem that includes Iceberg/MinIO data lakehouse technology, Trino for SQL querying, Airflow orchestration, and tools such as Grafana and OpenMetadata for monitoring and governance. Oracle serves as the database and data warehouse backbone. This role requires shift work covering nights, weekends, and public holidays as part of a rotating schedule to ensure continuous 24/7 pipeline monitoring.

Key Responsibilities

• Continuously observe scheduled batch jobs, ETL pipelines, and file arrivals; proactively communicate any failures or delays to stakeholders.
• Execute predefined SQL commands to conduct basic validation on pipeline data outputs.
• Utilize command line interfaces to navigate Unix/Linux file systems for checking logs, verifying file existence and sizes, and performing routine file operations such as copying, moving, and permission inspection.
• Validate file transfers across systems via SFTP/FTP and identify discrepancies.
• Detect and resolve straightforward query or job failures, own complex incidents through root cause analysis, and document outcomes thoroughly.
• Debug failures in upstream and downstream ETL workflows within the DLH environment including Iceberg/MinIO/Trino pipelines.
• Develop and debug SQL queries to analyze data inconsistencies and errors.
• Conduct data validation, reconciliation, and batch process monitoring to preempt incidents.
• Handle batch job failures using log-based diagnostics and basic shell scripting to automate routine checks.
• Communicate incident status and delays effectively with internal teams and maintain comprehensive knowledge bases to reduce recurring issues.
• Ensure thorough handover between shifts, clearly flagging ongoing or potential issues.

Qualifications and Experience

• Bachelor's or Master’s degree in Computer Science, Information Technology, or a related discipline.
• 2 to 3 years of experience in Platform Engineering or a similar operational field.

Technical Skills

• Proficient in SQL querying and troubleshooting.
• Command of Unix/Linux systems and shell scripting.
• Experience handling file transfers using SFTP/FTP protocols.
• Strong understanding of ETL processes, Data Warehouse (DWH), and Data Lakehouse (DLH) concepts.
• Familiarity with batch job monitoring and incident management practices.
• Competent in Python scripting for automation of logs parsing, file validation, and alerting.
• Practical knowledge or exposure to Apache Iceberg, MinIO, and Trino platforms or equivalent ability to apply Data Warehouse concepts to lakehouse/object-storage models.
• Experience with S3-compatible object storage systems.
• Hands-on experience with Airflow or similar orchestration tools.
• Prior background in Managed Services or operational support roles is preferred.

Soft Skills and Work Ethic

• Strong analytical and problem-solving capabilities suited to dynamic environments.
• Ability to prioritize and distinguish critical issues rapidly during triage.
• Clear and composed communication under pressure.
• Willingness to work unconventional shifts requiring focus during low-activity periods.
• Ownership mentality ensuring issues are fully resolved or effectively transitioned.
• Quick aptitude for learning new technologies and tools.

Why Join Mobilink Bank?

• Exposure to innovative Big Data and cloud technology ecosystems.
• Collaborative workplace culture encouraging professional development.
• Chance to influence and enhance data engineering capabilities in a fast-moving sector.