The Green Recruitment Company is working with an Environmental and Sustainability Business that supports and empowers their customers' journey to net zero. To join their Data-Technology team, we have an opportunity for a Data Engineer to help support the wider business (cross-functional) to meet their reporting and data requirements.
About the role:
* The Data Engineer will work with the latest innovative technologies to design, build, and maintain data solutions, constructing processes to surface data both internally for reporting purposes and externally through the customer portal.
* The Data Engineer will be responsible for developing scalable data pipelines to integrate diverse data sources while ensuring data quality under the framework of a new Data Platform for real-time application integration and reporting. They will work closely with business stakeholders to support data-driven decision-making by delivering clean, well-structured datasets that can be utilized for reporting purposes in a performant, secure way.
Key responsibilities:
* Taking full ownership of assigned projects and BAU tasks.
* Maintaining current pipelines within Azure ADF and Synapse Analytics.
* Building a process to transform raw data from various CRM systems into a harmonized and curated layer.
* Developing the usage of event-driven topics for various subscribers.
* Investigating and documenting Architectural Spikes to foster best practices within the Data Team.
* Developing and creating data science tools to gain a deeper understanding of the customer base.
* Recording and updating work on the Project Management System (Azure DevOps).
* Owning and enhancing the BAU runbook for engineering operations.
* Developing instrumentation and monitoring of automated IT tasks.
* Taking a leadership role in the engineering functions of the data team.
Requirements:
* Qualifications: Bachelor’s degree or above in Computing, Software Development, or similar.
Experience required:
* 3-5 years' cloud-based data engineering experience.
* Experience with formal methodologies in data engineering.
* Experience leading or working within an engineering team or function.
* Experience with the Azure Stack.
* Experience working in a proactive analytics environment.
* Experience in the Utilities sector.
* Experience leading technical projects.
Skills & Technologies required:
* Proficiency in cloud-based data engineering tools (ADF, Synapse Analytics, S3, Lambda).
* Proficiency in using PySpark notebooks for ELT processes.
* Ability to foster and cultivate a culture of best practices.
* Strong analytical and problem-solving skills.
* Ability to work independently and within cross-functional teams.
* Excellent communication and documentation skills.
* Proven ability to evaluate and select engineering options.
* Formal data engineering qualification.
On offer: Salary £42,000 - £45,000 (depending on experience) with an attractive benefits package and career development opportunities.
#J-18808-Ljbffr