Join to apply for the Data Engineer - Python & Azure role at TieTalent
About the Role
Data Engineer - Python & Azure
Contract type: Permanent
Hours: 37.5
Salary: Circa £61,000, depending on experience
Location: Leeds or Birmingham
WFH policy: Employees are required to attend the office 2 days/week
Travel: You will be required to travel to the London office once a month (expenses paid)
Flexible working: Various flexible work patterns, e.g., compressed 9-day fortnight, subject to line manager approval
Reports to: Data Engineer Manager
Role Summary
As a Data Engineer, you will manage LCCC’s data ecosystems, collaborating with developers, solution architects, BAs, analysts, data scientists, and SMEs to optimize the data platform. Your focus will be on building ETL/ELT pipelines for data ingestion, processing, and storage, ensuring data integrity and quality throughout the lifecycle. Special emphasis will be on developing inputs for the internal forecasting model of GB power markets, designing scalable frameworks for source data.
Key Responsibilities
* Build and maintain ETL/ELT pipelines for accurate and accessible data
* Ingest and transform data from APIs, web scraping, databases, and third-party sources
* Analyze data for patterns, anomalies, and structure for ETL processes
* Ensure efficient data flow and synchronization across platforms
* Improve data quality and reliability
* Promote a data-driven culture within the organization
* Enhance data governance through principles and documentation (Flow Diagram, Data Dictionary, Semantic Layers)
* Monitor data workflows, set SLIs, and configure alerts for data quality issues
Skills, Knowledge, and Experience
Essential
* At least 1 year of data engineering experience with data platforms and analytics support
* Hands-on experience with Azure Data ecosystem: Databricks, Data Factory, Data Lake, Synapse; certifications are a plus
* Proficiency in Python, with PySpark experience preferred
* Strong SQL skills
* Experience in building and maintaining data pipelines
* Managing DevOps pipelines
* Skills in process optimization, performance tuning, data modeling, and database design
Desirable
* Experience in data architecture
Employee Benefits
We offer a comprehensive benefits package, including:
* Performance bonus up to 10%
* 25 days annual leave plus bank holidays
* Up to 8% pension contribution
* Support for relevant training and professional memberships
* Referral and recognition schemes
* Family-friendly policies and enhanced maternity/shared parental leave
* Confidential employee assistance programs
* Paid volunteering days
* Transport schemes and discounts
About Low Carbon Contracts Company
The LCCC supports decarbonizing electricity generation and making energy more affordable, contributing to the UK’s Net Zero goal by 2050. We value diversity and inclusion; your anonymized diversity data helps us improve our outreach and inclusion efforts.
Nice-to-Have Skills
* Python, Azure, Data Factory, PySpark, SQL, DevOps
Work Experience & Languages
* Data Engineer, Data Infrastructure
* English
Seniorities and Job Details
* Entry level
* Contract
* IT & Internet industry
#J-18808-Ljbffr