Job description

Position Overview

We are seeking a Data Engineer with Active Enhanced DV Clearance for a prestigious National Security consultancy based in Central London. This is a full-time, onsite contract role with a 12-month duration, offering an attractive day rate within IR35 regulations.

Key Responsibilities

Design and implement data ingestion pipelines and orchestration tools to facilitate efficient data processing.
Create and maintain database schemas and data models tailored to project requirements.
Aggregate and enhance data from multiple sources, ensuring high data quality and consistency.
Develop and manage ETL workflows using tools such as Apache NiFi.
Produce clean, secure, and test-driven code optimized for reuse.
Support and improve architectures for data ingestion and storage systems.
Troubleshoot and resolve issues in operational data environments.
Translate stakeholder needs into clear technical specifications, aiding in backlog management and sprint planning.
Implement necessary controls to ensure data security compliance.
Monitor and optimize data platforms for robust performance and reliability.

Required Skills and Experience

Proficiency in ETL development using Python or comparable programming languages.
Experience with Apache Spark, Apache NiFi, or Apache Kafka for data processing and ingestion.
Familiarity with both relational (PostgreSQL, MySQL) and NoSQL (MongoDB, Cassandra) database technologies.
Hands-on experience with AWS and other cloud-based data services.
Knowledge of Palantir Foundry platform.
Strong ability to engage and coordinate with stakeholders.

Additional Information

Position requires an Active Enhanced Developed Vetting (eDV) Clearance.
Contract length is 12 months.
Compensation is £680 per day, subject to IR35.
Location: Full-time onsite in Central London.

Why Join?

Opportunity to contribute to critical UK Government projects with tangible impact.
Join a leading consultancy recognized for cutting-edge technical expertise and innovation.
Enjoy long-term contractual engagement and a secure working environment.