Salary: £75,000 - 75,000 per year Requirements: Azure mastery: Deep expertise in the Azure Ecosystem, specifically Databricks, Azure Data Factory (ADF), Synapse and Unity Catalog. Data engineering: Proficiency in Python, PySpark and Spark SQL for ETL/ELT pipeline development. Time-series expertise: Proven experience handling real-time, high frequency data feeds (e.g. aviation, sensor or industrial data). Schema design: Advanced knowledge of Star and Snowflake Schemas and Lakehouse architectures. Quality assurance: Hands-on experience with data validation tools like Great Expectations and observability platforms like Grafana. DevOps: Familiarity with CI/CD processes using Azure DevOps or GitHub Actions. 6 years of experience in data engineering with a focus on resilient, high availability systems (preferred). Strong understanding of security protocols, including RBAC and Row-level Masking (preferred). Ability to work closely with AI/ML teams to support predictive maintenance or digital data products (preferred). Responsibilities: Data architecture & modelling: Design and implement a scalable architecture on Microsoft Azure to organise raw system data into curated, reporting-ready layers. Operational system integration: Build robust pipelines to ingest and process high-frequency time-series and IoT-like data from critical infrastructure. Cloud database production: Develop and manage the foundational cloud database using Azure Databricks, Synapse and Data Lake to serve as the single source of truth. Real-time processing: Implement and optimise streaming workloads using Kafka, Event Hub and Spark Streaming to ensure low-latency data availability for life-critical monitoring. Governance & compliance: Enforce strict data quality frameworks and maintain PII/PHI compliance, ensuring the integrity of sensitive healthcare and operational data. Visualisation & reporting: Collaborate with stakeholders to design and deploy the Master Dashboard using Power BI, utilising DAX and semantic models for actionable insights. Technologies: AI Azure CI/CD Cloud Databricks DAX DevOps ETL GitHub Grafana IoT Support Kafka Power BI Python PySpark RBAC SQL Security Snowflake Spark Unity GameDev Airflow ASP.NET Aruba Cisco Nexus More: At OKTO, we are seeking a Senior Data Engineer to lead the architecture and implementation of a critical digital operations system. This role is essential to our mission of integrating various system endpoints into a centralized, resilient cloud-based infrastructure. We pride ourselves on investing significantly in personal development and ongoing training for our employees. Our permanent team members enjoy substantial benefits including a company pension, a cycle to work scheme, paid volunteer time, private medical insurance, and opportunities for professional growth. We are located in Lisburn and are proud to employ a highly skilled technical team dedicated to excellence. last updated 8 week of 2026