Salary: £55,000 - 62,000 per year Requirements: Expert-level SQL and Python (ideally PySpark). Strong understanding of DataSecOps; experience with PII handling, data obfuscation, and RBAC (Role-Based Access Control). Proven ability to design data systems (preferably Medallion architectures). Advanced knowledge of Power BI security and administration. Familiarity with git and gitflow version control processes. Knowledge of cloud cost and resource optimisation (FinOps principles). Awareness of agile delivery methodologies (Scrum or Kanban). Experience in building cloud-based data platforms, ideally on Azure. Delivered a Delta Lakehouse, Medallion Architecture, or similar curated data layering approach. Created end-to-end ELT/ETL pipelines using Databricks, Spark, Azure DataFactory, or equivalent tooling. Ensured data quality through validation, profiling, reconciliation, and automated tests. Provided guidance, reviewed code, coached junior team members, and influenced team practices. Desirable: Experience with DBT (Data Build Tool) or Prefect. Desirable: Knowledge of housing, asset management, or repairs systems (ideally Civica Cx and Total Mobile Service Connect). Responsibilities: Lead the design and implementation of a scalable and secure data platform using Azure Databricks, enabling the ingestion, transformation and governance of data from key business systems. Design and deploy secure, scalable ELT or ETL pipelines using Databricks (Unity Catalog), Delta Lake, and Azure Data Lake Storage (ADLS). Implement shift-left security principles within the data ingestion layer, including automated data masking and encryption. Establish and embed DataOps and DataSecOps practices, including CI/CD and automated security scanning of data pipelines. Finalise a governed Power BI architecture, including standardised semantic models and dataflows. Ensure robust Identity and Access Management (IAM) across Power BI workspaces. Proactively identify data and logic inconsistencies between systems and support stakeholders in resolving operational issues. Act as a technical lead, coaching a Junior Data Engineer and Analyst on modern engineering standards and secure coding practices. Work with the Software Engineering Manager to establish naming conventions and metadata standards. Constructively challenge stakeholders on scope and delivery to ensure deliverables remain on track. Support continuous improvement efforts through ongoing analysis and feedback, and implementation of best practices. Collaborate with housing and frontline teams to ensure system implementations improve service quality and accessibility for customers. Technologies: Azure CI/CD Cloud Databricks ETL Git IAM Support Kanban Mobile Power BI Python PySpark RBAC SQL Security Spark Unity dbt GameDev AI Architect Backbone Embedded LLM REST More: We are a not-for-profit housing association located in Bridgend, Wales, established in 2003 with a mission to provide safe, high-quality, and affordable homes across Bridgend and South Wales. Our team is rooted in the commitment to create thriving communities where people feel secure, supported, and proud to live. We offer hybrid working options with two days a week in the office and focus on fostering a collaborative and innovative work environment. last updated 13 week of 2026