About the Role
This role sits within our Data and Technology team. In this role, you will own and extend our config‑driven data platform (DMC), which standardises ingestion, transformation, and delivery of paid media data across 26+ ad platforms for multiple global clients. You will work closely with the team to build and maintain ELT pipelines—from Cloud Function ingestion into BigQuery through to dbt‑powered transformation—ensuring the highest standards in data integrity and scalability. This is an exciting position with excellent career opportunities and scope to strategically shape the agency.
Responsibilities
* Own and extend the end‑to‑end data pipeline—from Cloud Function ingestion through dbt transformation (staging → intermediate → marts) to analysis‑ready tables in BigQuery.
* Develop and maintain dbt macros, Jinja templates, and platform YAML definitions that auto‑generate models across 26+ ad platforms.
* Manage and improve GCP infrastructure (BigQuery, Cloud Run, Cloud Functions, Cloud Scheduler, Pub/Sub) provisioned via Terraform.
* Build and maintain the Python CLI tooling that orchestrates client onboarding, config compilation, and pipeline execution.
* Mentor the team of data engineers, driving best practices in DataOps, code review, testing, and documentation.
* Proactively review existing processes to identify opportunities to automate manual work, optimise data delivery, and re‑design infrastructure for greater scalability.
* Collaborate with analysts, data scientists, and BI teams (PowerBI, Looker Studio, Tableau, etc.) to maximise the value delivered from data models.
* Contribute to CI/CD pipelines (Cloud Build), testing (pytest, dbt tests), and documentation (MkDocs, etc.).
Required
* Strong experience with dbt—macros, Jinja templating, incremental models, seeds, testing, and packages.
* Proficient in Python 3.11+—building CLI tools, data processing, and automation.
* Proficient in SQL, ideally BigQuery dialect.
* Experience with Google Cloud Platform—especially BigQuery, Cloud Run, Cloud Functions, Cloud Storage, Pub/Sub, and Cloud Scheduler.
* Experience with Infrastructure as Code (Terraform) for provisioning and managing cloud resources.
* Solid understanding of data modelling techniques (star schema, dim/fact architecture, slowly changing dimensions).
* Comfortable with Git (GitHub, branching strategies, pull requests) and CI/CD (Cloud Build or similar).
* Ability to translate business needs into technical specifications.
Highly Desirable
* Experience with Docker and containerised workloads (Cloud Run Jobs).
* Familiarity with CLI frameworks (Click) and config‑driven architectures (Pydantic, YAML‑based configuration).
* Knowledge of the digital media / paid media industry—processing data from 26+ ad platforms such as Google Ads, Meta, DV360, TikTok, etc.
* Exposure to multi‑cloud integrations (Azure Blob, AWS S3, SFTP).
* Mono‑repo experience—managing multi‑client configurations in a single codebase.
Nice to Have
* Experience with Databricks (and dbt‑databricks).
* Familiarity with modern Python dev tooling—Poetry, ruff, mypy, pre‑commit.
* Experience with docs‑as‑code (MkDocs or similar).
Qualities
* Ownership—managing multiple workstreams across clients with accuracy and seeing things through from design to deployment.
* Curiosity—a natural inclination to explore new tools, dig into unfamiliar systems, and understand how things work end‑to‑end.
* Resourcefulness—unblocking oneself, whether by reading source code, querying logs, or finding creative workarounds when data or documentation is limited.
* Problem‑solving—thinking through complex data issues methodically and designing clean, maintainable solutions.
* Collaboration—a desire to work openly, share knowledge, and build a team culture where code reviews and pair programming are valued.
We will process your personal data in accordance with our Recruitment Privacy Notice which is available at https://omnicommediagroup.com/recruitment-privacy-notices/.
#J-18808-Ljbffr