Data Engineer (Inside IR35)
£425 Per day
SC Cleared - A must to be considered for this opportunity
London
To support the formation of a new Data Team, there is a critical need to establish robust, scalable, and secure data infrastructure. Currently, data is dispersed across multiple systems with inconsistent formats and limited automation. A Data Engineer will play a key role in designing and implementing the pipelines, architecture, and tooling required to enable reliable data ingestion, transformation, and delivery.
Key Responsibilities
* Design, build, and maintain scalable data pipelines to ingest, transform, and store data from multiple sources.
* Develop and manage data models, schemas, and metadata to support analytics and reporting needs.
* Collaborate with Data Analysts, Data Scientists, and Business Analysts to ensure data availability, accessibility, and usability.
* Implement data quality checks, validation routines, and monitoring to ensure data integrity and reliability.
* Optimise data workflows for performance, cost efficiency, and maintainability using modern data-engineering tools and platforms (e.g., Azure Data Factory, AWS Data Pipeline, Databricks, Apache Spark).
* Support the integration of data into visualisation platforms and analytical environments (e.g., Power BI, ServiceNow).
* Ensure adherence to data governance, security, and privacy policies.
* Document data architecture, pipelines, and processes to support transparency and knowledge sharing.
* Contribute to the development of a modern data platform that supports both real-time and batch processing.