If you are an experienced Data Engineer with excellent communication skills and a proven track record of working on large scale data enablement projects, we have a new contract we would like to discuss with you. Please note this role requires onsite attendance once a week and has been deemed inside IR35.
Requirements
* Experience in Azure Synapse, ETL, Pyspark, SQL, data modelling and Data Bricks.
* Design and develop Azure Pipelines including data transformation and data cleansing.
* Document source-to-target mappings.
* Re-engineer manual data flows to enable scaling and repeatable use.
* Build accessible datasets for distribution and analysis.
* Development of Azure Pipelines for transforming data.
* A scalable meta-data driven ingestion and transformation framework.
* Aligning transformation pipelines and datasets with Purview.
* Experience of working with Azure Data Lakes, Data warehousing, and pipelines and Storage accounts.
* Experience in building and managing Pipelines including: building data interfaces to source systems, combining and transforming data into appropriate storage formats.
* Experience identifying and resolving issues in databases, data processes, data products and services.
* Proficiency in T‑SQL and Python to develop automation.
#J-18808-Ljbffr