What success looks like in this role:
We are seeking a highly skilled Senior DataOps / Azure DevOps Engineer to join our core data platform team. This role combines Azure CloudOps, Infrastructure as Code, and CI/CD engineering with a strong focus on platform reliability, security, and automation.
The mission is to design, build, and operate a secure, scalable, and automated Databricks Lakehouse platform while ensuring enterprise‑grade DevOps practices across Azure environments.
This is a senior individual contributor position with high technical ownership and cross‑functional impact.
Key Responsibilities
1. Infrastructure as Code (Primary)
1. Design, implement, and maintain Terraform‑based IaC for Azure and Databricks.
2. Build reusable modules for multi‑environment and multi‑workspace deployments.
3. Deploy and maintain Azure components:Databricks workspaces & metastoresUnity Catalog policiesAzure Data Lake StorageNetworking, identity, and secure access patterns
4. Implement policy‑as‑code, enforcing compliance, cluster policies, and guardrails.
5. Ensure environments are secure‑by‑default, auditable, and automated end‑to‑end.
2. CI/CD Engineering (Primary)
6. Design and operate CI/CD pipelines using Azure DevOps.
7. Build CI/CD frameworks for Databricks assets (DAB):notebooks, packages, workflows, Delta Live Tables
8. Implement automated validation: linting, tests, schema checks.
9. Establish promotion strategies (dev → test → prod).
10. Integrate Azure DevOps pipelines with Databricks Repos and enterprise Git workflows.
3. Platform Reliability & Operations
11. Build monitoring and observability for Databricks workloads:job health, performance, usage, cost signals
12. Implement alerting and dashboards for proactive operational management.
13. Design systems for:safe rollback, retry strategies, idempotent operations
14. Troubleshoot complex deployment and infrastructure issues.
15. Improve performance, availability, and cost efficiency across the platform.
4. Governance, Security & Compliance
16. Enforce enterprise governance via code:RBAC / ABAC (Unity Catalog)secret & credential managementencryption, access patterns
17. Align automation with architecture and governance requirements.
18. Ensure security and compliance standards are embedded in CI/CD and IaC.
5. Cross‑Functional Collaboration
19. Partner with development, operations, data engineering, architecture, governance, and security teams.
20. Act as a technical advisor and subject‑matter expert for cloud and data platform automation.
21. Reduce operational overhead by delivering self‑service tools and automation.
You will be successful in this role if you have:
Must‑Have
22. 8+ years of experience in DevOps, DataOps, or Platform Engineering
23. Expert hands‑on experience with Terraform and IaC design
24. Strong experience with Azure Cloud and Azure DevOps CI/CD
25. Deep understanding of Databricks platform operations
26. Strong scripting skills: Python, Bash, or PowerShell
27. Solid software engineering fundamentals: testing, modular code, GitOps
28. Strong troubleshooting and problem‑solving abilities
29. Excellent communication & cross‑team collaboration skills
Nice‑to‑Have
30. Experience with Delta Lake, DLT, Databricks SQL
31. Familiarity with Azure monitoring/observability tooling
32. Exposure to streaming or event‑driven architectures
33. Experience supporting multi‑environment enterprise platforms
Location
Milton Keynes with flexible remote working and occasional client site visits
#LI-TS1
Unisys is proud to be an equal opportunity employer that considers all qualified applicants without regard to age, caste, citizenship, color, disability, family medical history, family status, ethnicity, gender, gender expression, gender identity, genetic information, marital status, national origin, parental status, pregnancy, race, religion, sex, sexual orientation, transgender status, veteran status or any other category protected by law.