Principal Data Engineer
We are Smoove, part of the PEXA Group, simplifying the home moving and ownership experience. We are seeking an experienced Principal Data Engineer to define, lead, and scale the technical strategy of our data platform. This senior, hands‑on leadership role sits at the intersection of architecture, governance, and engineering excellence, shaping how data is collected, processed, and delivered across the organisation.
Role Responsibilities
* Design and oversee scalable, performant, and secure architectures on Databricks and distributed systems.
* Anticipate scaling challenges and ensure platforms are future‑proof.
* Lead the design and development of robust, high‑performance data pipelines using PySpark and Databricks.
* Define and ensure testing frameworks for data workflows.
* Ensure end‑to‑end data quality from raw ingestion to curated, trusted datasets powering analytics.
* Establish and enforce best practices for data governance, lineage, metadata, and security controls.
* Ensure compliance with GDPR and other regulatory frameworks.
* Act as a technical authority and mentor, guiding data engineers.
* Influence cross‑functional teams to align on data strategy, standards, and practices.
* Partner with product, engineering, and business leaders to prioritise and deliver high‑impact data initiatives.
* Build a culture of data trust, ensuring downstream analytics and reporting are always accurate and consistent.
* Evaluate and recommend emerging technologies where they add value to the ecosystem.
Skills & Experience Required
* Broad experience as a Data Engineer including technical leadership.
* Broad cloud experience, ideally both Azure and AWS.
* Deep expertise in PySpark and distributed data processing at scale.
* Extensive experience designing and optimising in Databricks.
* Advanced SQL optimisation and schema design for analytical workloads.
* Strong understanding of data security, privacy, and GDPR/PII compliance.
* Experience implementing and leading data governance frameworks.
* Proven experience leading the design and operation of a complex data platform.
* Track record of mentoring engineers and raising technical standards.
* Ability to influence senior stakeholders and align data initiatives with wider business goals.
* Strategic mindset with a holistic view of data reliability, scalability, and business value.
We welcome all qualified candidates; Smoove is an equal opportunity employer. We provide a safe and inclusive environment that values diversity and fosters innovation.
#J-18808-Ljbffr