Platform Engineer - Apache Airflow - Contract - Hybrid/London - £460PD
A leading organisation is seeking an Apache Airflow Subject Matter Expert to fine-tune and optimise their data orchestration platform. This is not a Data Engineer role, my client are after someone who lives and breathes Airflow at platform and infrastructure level. The primary objective of this role is to fine-tune and optimize their existing Airflow environment, ensuring high reliability, performance, and scalability.
THIS ROLE IS INSIDE IR35
The Role:
* Optimise and scale an enterprise-grade Airflow environment
* Design and build reusable, modular DAGs
* Integrate Airflow with Azure services (ADF, Databricks, Synapse)
* Develop CI/CD pipelines (Azure DevOps)
* Set up monitoring/logging standards for operational excellence
* Provide architectural guidance and mentor engineers
Key Skills:
* Deep Airflow expertise (scheduler, Celery, Kubernetes executor, KEDA)
* Strong Python and Azure (ADF, Databricks, Storage) experience
* CI/CD with Azure DevOps (YAML pipelines)
* Familiar with Docker, Kubernetes, and observability tools (Grafana, Prometheus, ELK)
If you are an Airflow Optimization specialist looking for a new opportunity, please do get in touch as soon as you can for a confidential discussion.
Start ASAP - apply now to learn more.
Platform Engineer - Apache Airflow - Contract - Hybrid/London - £460PD
Randstad Digital is acting as an Employment Business in relation to this vacancy.