Join to apply for the Technical Lead, Google Cloud Platform role at Manchester Digital.
Working within the Data Engineering department, you will help to shape the technical direction of cloud-based solutions. Your focus will be defining the overall architecture for data ingestion from our Data Lake, including processing, storage, and analysis within GCP.
By leveraging your expertise in Google BigQuery architecture and its features, you will design and implement data models optimized for performance, scalability, and best practices.
You will act as the subject matter expert for development and optimisation to maintain data governance, while ensuring all designed solutions adhere to company standards, security best practices, and regulatory requirements.
This role is eligible for inclusion in the Company’s hybrid working from home policy.
Responsibilities
* Collaborate with Technical Leads and Software Architects to ensure scalable, reliable, and compliant solutions.
* Craft complex SQL queries, stored procedures, UDFs, and TVFs, applying performance tuning strategies for data models.
* Design, develop, and maintain automated data pipelines for efficient data ingestion, transformation, and loading (ETL/ELT) processes.
* Implement and champion data validation, sequencing, robust monitoring, and alerting frameworks to ensure accuracy, consistency, and reliability of data.
* Collaborate closely with developers to ensure seamless integration of applications with the GCP data platform.
* Serve as subject matter expert on GCP data solutions and BigQuery, providing guidance, mentorship, and knowledge transfer on best practices to the development team.
* Actively participate in code reviews and contribute to the technical direction of cloud-based data processing solutions.
Qualifications & Preferred Skills
* Proven experience as a GCP expert, focusing on data-driven solutions.
* Extensive hands-on experience with Google BigQuery, including its architecture, features, and best practices.
* Detailed understanding of data modelling, data transformation, data governance, and proficiency in SQL and other data processing languages.
* Experience with data pipeline orchestration tools, preferably Cloud Composer.
* Broad understanding of core GCP services such as BigQuery, Cloud Storage, Kubernetes, Cloud Functions, Pub/Sub, and IAM.
* Experience with IaC tools such as Terraform, Ansible, or CloudFormation to manage GCP environments.
* Familiarity with CI/CD pipelines and version control systems such as Git, GitLab, and Jenkins.
* Proficient in writing complex SQL queries, continuous queries, stored procedures, UDFs, and TVFs in BigQuery, along with performance tuning and optimisation.
* Strong understanding of GCP security best practices and BigQuery’s specific security features and access control mechanisms.
What You Will Be Doing
* Collaborating with Technical Leads and Software Architects to ensure scalable, reliable, and compliant solutions.
* Crafting complex SQL queries, stored procedures, UDFs, and TVFs, and applying performance tuning strategies for data models.
* Designing, developing, and maintaining automated data pipelines for efficient data ingestion, transformation, and loading (ETL/ELT) processes.
* Implementing and championing data validation, sequencing, robust monitoring, and alerting frameworks to ensure accuracy, consistency, and reliability of data.
* Collaborating closely with developers to ensure seamless integration of applications with the GCP data platform.
* Serving as subject matter expert on GCP data solutions and BigQuery, providing guidance, mentorship, and knowledge transfer on best practices to the development team.
* Actively participating in code reviews and contributing to the technical direction of cloud-based data processing solutions.
#J-18808-Ljbffr