We are looking for experienced Senior Data Engineers to play a key role in the evolution of a modern enterprise data platform built on Databricks and AWS.
This is an opportunity for highly autonomous engineers who enjoy ownership, solving complex data challenges, and contributing to scalable, high-quality data solutions in a cloud-first environment.
You’ll work across the full data engineering lifecycle, helping to design, build, optimise, and govern data products within a Databricks Lakehouse architecture.
Key Responsibilities
* Design, develop, and optimise scalable ETL/ELT pipelines using Databricks, Python, SQL, and Delta Live Tables (DLT).
* Build and maintain performant Delta Lake solutions, including partitioning and optimisation strategies.
* Contribute to Lakehouse architecture design and scalable ingestion frameworks.
* Develop governed, reusable, and maintainable data products.
* Implement data quality, observability, monitoring, and automated testing frameworks.
* Ensure alignment with governance, lineage, and security standards using Unity Catalog.
* Optimise Databricks cluster usage, orchestration, and cloud cost efficiency.
* Work collaboratively with architects, analysts, and stakeholders to translate business requirements into technical solutions.
* Mentor and support other engineers while contributing to engineering best practices and standards.
* Drive continuous improvement and innovation across the data platform.
* Strong commercial experience as a Data Engineer or Senior Data Engineer.
* Deep hands-on expertise with Databricks on AWS (essential).
* Strong understanding of Spark, Delta Lake, and Lakehouse architectures.
* Proven experience designing scalable and maintainable modern data platforms.
* Strong knowledge of the end-to-end data engineering lifecycle.
* Experience with AWS cloud services in data engineering environments.
* Experience with Data Asset Bundles is highly desirable.
* Strong SQL and Python development skills.
* Understanding of data governance, metadata management, and quality frameworks.
* Ability to work autonomously and thrive in a self-directed environment.
* Strong communication and stakeholder management skills
Ideal Candidate
The ideal candidate will be:
* A self-starter who enjoys autonomy and ownership.
* Comfortable operating in fast-moving engineering environments.
* Passionate about engineering quality, scalability, and continuous improvement.
* Confident influencing technical direction and best practice adoption.
* Delivery-focused with a pragmatic approach to solving problems.
#J-18808-Ljbffr