Requirements
* Strong SQL skills, including optimisation and complex query development
* Experience in data ingestion, transformation and cleansing
* Experience supporting BI solutions
* Understanding of data governance, protection and data quality methodologies
* Familiarity with scripting languages such as Python
* Familiarity with GIS data
* Experience using CI/CD tooling (Azure DevOps or GitHub)
* Experience developing pipelines using Microsoft Fabric (Data Factory, Dataflows, Lakehouse, Warehouse) or similar technologies
* Working knowledge of medallion architecture and Delta lakehouse patterns
* Experience with Azure data services (Azure Storage, Data Factory, Logic Apps, Azure Functions)
What the job involves
* The Data Engineer & Analyst is responsible for developing, maintaining and optimising nexfibre’s data platforms and data engineering capability to support analytics, reporting and operational decision-making
* The role ensures that data is ingested, transformed and managed to a high standard, delivering clean, reliable and well‑structured datasets for use across the business. Working closely with the BI Manager and the Asset and Network Data Senior Manager, the postholder ensures strong alignment between data engineering outputs and business intelligence requirements
Data Engineering
* Develop and maintain end‑to‑end data pipelines using Microsoft Fabric (Data Factory, Dataflows, Lakehouse, Warehouse and Pipelines)
* Implement data storage, modelling and processing aligned to defined architecture principles
* Manage data within OneLake, Delta Lake and Azure storage services
* Ensure appropriate pipeline monitoring, scheduling and documentation in collaboration with the BI Manager and Asset and Network Data Manager where downstream reporting impacts are identified
Data Ingestion and Integration
* Design and implement ingestion processes for internal systems, APIs, external partners and third‑party data providers
* Integrate structured and semi‑structured data using Azure Functions, Logic Apps and Fabric Data Factory
* Work with the BI Manager to ensure ingestion patterns support the organisation’s reporting and analytics strategy
* Apply robust patterns for incremental ingestion, schema management and change data capture processes
Data Quality and Governance
* Apply data validation, cleansing, standardisation and deduplication routines
* Implement automated data quality checks and profiling activities
* Liaise with the BI Manager, Asset and Network Data Manager and data owners to resolve data quality issues impacting dashboards, reporting or analytics outputs
* Ensure all data solutions comply with governance and UK data protection requirements
Data Modelling and Analytics Support
* Provide structured datasets to support business reporting in partnership with the BI Manager and Asset and Network Data Manager
* Ensure consistent definitions, measures and modelling standards across reporting tools
* Support in troubleshooting data model performance issues where required
Cross‑Functional Collaboration
* Work closely with the data team and wider business teams to understand reporting and analytics requirements
* Build strong relationships with Finance, Operations, Network and other business functions
* Provide clear analysis and insights to support operational and strategic decision making
Continuous Improvement
* Lead AI initiatives within the nexfibre infrastructure, working alongside the Technical Lead to implement initiatives that will enhance organisational efficiency
* Identify and recommend improvements to data architecture, automation, governance and cost management
* Collaborate with the BI Manager to improve reporting processes, BI tooling usage and data accessibility
* Monitor developments in data technologies and assess their applicability to the organisation
#J-18808-Ljbffr