Job Title: Data Integration Lead
Location: Horsham/ London (Hybrid)
Duration: Contract inside IR 35
* Responsibilities:
i. Drive the change in data integration.
ii. Transform data into actionable insights.
iii. Operate within the sphere of data management and computer science.
iv. Offer expertise in crafting data strategies that align with business goals.
v. Ensure that data from disparate sources is coherently combined
* Must have skills:
i. Azure Data Factory and Databricks Expertise: Skilled in building, managing, and optimizing pipelines, workflows, and clusters.
ii. SQL Proficiency: Advanced skills in writing, troubleshooting, and optimizing queries for performance
iii. Ability to leverage various ingestion frameworks and methodologies.
iv. Proficiency in strengthening business strategies by leveraging data architecture and data modelling principles.
v. Knowledge of data extraction, transformation, and load (ETL) processes.
vi. Deep understanding of Azure, Databricks
vii. Experience with continuous integration and deployment pipelines.
viii. Ability to integrate AI development for streamlined delivery