Responsibilities:
* Drive the change in data integration.
* Transform data into actionable insights.
* Operate within the sphere of data management and computer science.
* Offer expertise in crafting data strategies that align with business goals.
* Ensure that data from disparate sources is coherently combined
Must have skills:
* Azure Data Factory and Databricks Expertise: Skilled in building, managing, and optimizing pipelines, workflows, and clusters.
* SQL Proficiency: Advanced skills in writing, troubleshooting, and optimizing queries for performance
* Ability to leverage various ingestion frameworks and methodologies.
* Proficiency in strengthening business strategies by leveraging data architecture and data modelling principles.
* Knowledge of data extraction, transformation, and load (ETL) processes.
* Deep understanding of Azure, Databricks
* Experience with continuous integration and deployment pipelines.
* Ability to integrate AI development for streamlined delivery