Data Engineer
Duration: 3 Months
Location: Remote
Rate: £450 - £470 per day DOE
Status: OUTSIDE IR35
Clearance: Eligible for SC
Start Date: ASAP
Summary:
My market leading client are looking to secure the services of a contract based Data Engineer to assist with critical project work over the coming months. Ideally coming from a consultancy background with extensive experience working in secure and regulated environments. Experience and knowledge of working in a public sector environment is essential.
Key Responsibilities
* Strong stakeholder engagement and collaboration.
* Design, build and maintain scalable data pipelines.
* Develop using Azure Databricks (PySpark, Spark SQL, Python).
* Contribute to Lakehouse architecture (Delta Lake patterns, Databricks capabilities).
* Build and manage workflows (Databricks Workflows, Delta Live Tables).
* Implement data governance (Unity Catalog – access, discovery, control).
* Support analytics/reporting using Databricks SQL.
* Ingest and transform API, structured, semi-structured and geospatial data.
* Write clean, testable, maintainable code.
* Contribute to agile delivery (ceremonies, peer reviews, planning).
Key Skills & Experience
* Strong Data Engineering experience with Azure Databricks.
* Proven delivery of production-grade data pipelines.
* Strong Python, SQL, PySpark and Spark SQL capability.
* Experience with Lakehouse / modern data platform design.
* Hands-on with Databricks tools (Unity Catalog, Workflows, Delta Live Tables, Databricks SQL).
* Data ingestion from APIs and external sources.
* Geospatial data processing experience (real-world use cases).
* Experience with geospatial formats (Shapefile, GeoParquet, GeoPackage, GeoTIFF).
* Knowledge of Apache Sedona or similar frameworks.
* Understanding of data modelling, quality, monitoring and optimisation.
* Experience with version control, CI/CD and cloud environments.
* Strong analytical and problem-solving skills.
If you’d like more information on the assignment, please drop me an email – or give me a call on 07400 28 3333.
Data Engineer