Associate Consultant - UK market | Web3 | AI | Crypto Trader | Business Development
We’re looking for a Senior Data Engineer to join a growing data team (currently three members plus a lead) and play a key role in strengthening the group’s engineering capability. The focus will be on migrating and integrating data platforms, cleaning and documenting legacy data, and contributing to the design and build of the new data architecture.
This is an opportunity to get involved early in the platform’s development, close to Greenfield, and help establish engineering standards and best practices that will support long-term scalability. The environment is primarily Databricks‑based, with legacy data quality posing some interesting challenges that the team is keen to resolve properly this time around.
What you’ll be doing:
* Building and optimising ETL/ELT pipelines with Databricks & Apache Spark
* Designing scalable solutions using Azure Data Factory, Synapse & Data Lake
* Implementing Delta Lake with ACID transactions and schema enforcement
* Automating testing and CI/CD with Azure DevOps & Terraform
* Driving data governance with Azure Purview & Unity Catalog
* Developing real‑time data solutions with Event Hubs & Structured Streaming
* Managing infrastructure as code and optimising cloud costs
* Working closely with engineers, QA, Product Owner, and stakeholders
What we’re looking for:
* Strong hands‑on experience with Azure & Databricks
* Proficiency in Python, Spark SQL, and Terraform
* Solid understanding of data governance and real‑time processing
* Great communication skills and a collaborative mindset
£600/day - outside IR35 | Hybrid | Contract | Modern tech stack | Friendly team
If this sounds like something you’d be interested in, feel free to reach out or share with someone who might be.
#J-18808-Ljbffr