What youll be doing
As our Cloud Data Platform Engineer, you will play a key role in designing, developing and deploying cloud based data platforms that are secure, scalable and cost efficient. Working to industry best practice and aligned to our internal standards, you will help build and maintain the core data lakehouse architecture that underpins analytics and reporting across the group.
You will work closely with the Principal Data Architect, Cloud DBA and Data Engineers to deliver robust, high performing data solutions. Alongside this, you will automate infrastructure deployment, ensure strong security governance, and proactively monitor and optimise performance across the platform.
You will be:
1. Supporting the definition, design and deployment of end to end data lakehouse architecture in line with industry best practice.
2. Developing, maintaining and versioning Terraform configurations to provision and manage GCP infrastructure.
3. Working with the Group Technology Cloud Infrastructure team to standardise deployment methods and contribute to shared modules and tooling.
4. Integrating security best practice by managing fine grained access control (IAM) and ensuring data compliance and segregation across BigQuery and Cloud Storage.
5. Continuously monitoring and tuning performance, including managing slot capacity and optimising partitioning and clustering t...