Google Cloud Platform Data Engineer – PA Consulting
Company Overview
PA Consulting is an innovation and transformation consultancy that believes in the power of ingenuity to build a positive‑human future in a technology‑driven world. With a global network of FTSE 100 and Fortune 500 clients, we offer unrivalled opportunities for growth and the freedom to excel.
Job Description
As a Principal GCP Data Engineer you will be a subject matter expert in using Google Cloud’s data processing and management capabilities to develop data‑driven solutions for our clients. You will typically lead a team or the delivery effort, provide technical support, and work across multiple teams as a critical SM expert.
Key responsibilities include:
* Develop robust data processing jobs using Google Cloud Dataflow, Dataproc and BigQuery
* Design and deliver automated data pipelines using Cloud Composer
* Design end‑to‑end solutions and contribute to architecture discussions beyond data processing
* Own the development process for your team, establishing strong principles across architecture, scope, code quality and deployments
* Shape team behaviour for specifications, acceptance criteria, story estimation, sprint planning and documentation
* Continuously evolve PA’s data engineering standards and practices to maintain a modern, robust approach
* Lead and influence technical discussions with client stakeholders to secure collective buy‑in
* Coach and mentor team members of all seniorities, building their expertise and understanding
Qualifications
Required:
* Experience delivering production‑ready data processing solutions using BigQuery, Pub/Sub, Dataflow and Dataproc
* Experience developing end‑to‑end solutions using batch and streaming frameworks such as Apache Spark and Apache Beam
* Expert understanding of data storage technologies, including relational/non‑relational, document, row‑based/columnar stores, data warehousing and lakes
* Expert understanding of pipeline patterns such as event‑driven architectures, ETL/ELT, stream processing and data visualisation
* Experience translating business requirements into technical specifications and solution designs that satisfy data needs
* Experience with metadata management products such as Cloud Data Catalog, Collibra and governance tools like Dataplex
* Experience building solutions on GCP using cloud‑native principles and patterns
* Experience building data quality alerting and quarantine solutions to trust downstream datasets
* Experience implementing CI/CD pipelines, including git, branching, automated tests and deployments
* Comfortable working in an Agile team using Scrum or Kanban
Preferred:
* Experience migrating enterprise‑scale data platforms including Hadoop and traditional data warehouses
* Understanding of the machine learning model development lifecycle, feature engineering, training and testing
* Hands‑on experience with Kafka
* Experience as a DBA or developer on PostgreSQL, MySQL, Oracle or SQL Server
* Experience designing data applications for non‑functional requirements such as performance and availability
Personal Qualities
* Pragmatic and understands that coding is just one part of a data engineer’s role
* Clear communication with clients and peers, both written and in workshops
* Ability to explain technical concepts to non‑technical audiences at all levels
* Influential and persuasive with senior client stakeholders across organisational boundaries without direct authority
* Confident problem solver and troubleshooter
* Generous in sharing specialist knowledge, ideas and solutions
* Committed to continuous learning and inspiring others through teaching and example
Benefits Package
* Private medical insurance
* Interest‑free season ticket loan
* 25 days annual leave with the option to buy 5 additional days
* Company pension scheme
* Annual performance‑based bonus
* Life and income protection insurance
* Tax‑efficient benefits (cycle to work, give as you earn, childcare benefits)
* Voluntary benefits (Dental, critical illness, spouse/partner life assurance)
PA is committed to building an inclusive and supportive culture where diversity thrives, and all of our people can excel. We believe that greater diversity stimulates innovation, enabling us to fulfil our purpose of ‘Bringing Ingenuity to Life’, support the growth of our people, and deliver more enduring results for our clients.
Seniority Level – Mid‑Senior
Employment Type – Full‑time
Job Function – Consulting
Industries – Business Consulting and Services
#J-18808-Ljbffr