SENIOR DATA ENGINEER
Our Client, Aberdeen based Oil and Gas Operator is seeking a Senior Data Engineer to join their Aberdeen team on a Permanent staff basis. Azure Data factory/Data Lake, PySpark are essential skills for this role.
RESPONSIBILITIES
Supporting Data Platform Program: Collaborate with cross-functional teams to
maintain and enhance our modern data platform, leveraging your expertise in
Synapse and data engineering techniques.
Analyse, Model and Organise Data: Work with a range of stakeholders and
business users to understand the use and utility of datasets and systems to
then analyse, model and organise data from their respective source data
systems into the medallion data lake for further use in reporting.
Ensure data quality and data reliability: Drive improvements in data quality
assessments, and ensure that data is processed effectively, efficiently,
robustly and timely.
Maintaining Data Governance: Ensuring that data governance policies and
procedures are followed, and that data lineage and cataloguing is maintained
for data discoverability
Deliver Business Insights: Support and deliver business insight, intelligence
and predictive analytics reporting which creates real business value
Performance Management: Looking at wider trends across the data
processing infrastructure to identify improvements.
Project Scoping and Management: Defining project scopes and timelines for
delivery of a variety of projects, in collaboration with the Digital Technology
Partners and the Data and Analytics Lead.
Data Governance: Working with the Data and Analytics Lead to improve Data
Governance policies and procedures and its enforcement across the data
estate
QUALIFICATIONS & EXPERIENCE
Appropriate professional qualification or equivalent experience
Proven competency working with data warehousing, ETL/ELT, integration
tools and business intelligence solutions that will help to deliver the data and
analytics strategy.
Skills with Synapse (notebooks and data flows) is essential for Senior Data
Engineer.
Working knowledge of PySpark is essential for Senior Data Engineer
Capability working with Azure Data Lake Storage is essential for Senior Data
Engineer
Working knowledge of medallion data Lake house architecture is essential for
Senior Data Engineer
Strong background in data analytics, with a focus on data transformation and
modelling.
Competency of Master Data Management principles and implementations is
essential for Senior Data Engineer
Oil & Gas industry exposure is not required; however, a passion for working
with data is a must.
Familiarity with Power BI is desirable but not essential.
#J-18808-Ljbffr