Job Title: Azure Data Lead
Location: London, UK (hybrid)
Type: FTE
Job Description-
Key Skills:
Solid Hands-on experience with Azure Databricks - Pyspark coding and Spark SQL coding - Must have
Solid Hands-on experience with Delta Lake House with Delta tables - Must have
Solid Hands-on experience with Data warehousing - Must have
Solid Hands-on experience with Azure Data Factory - Must have
CI/CD Pipelines Integrations - Must have
Lead all the technical conversation with client and team coordination.
10+ Years of experience with Data Project
London Insurance market data experience
Responsibilities:
• Hand-on experience in Azure data platform architecture and developing data engineering pipelines
• Experience in working with both SQL and NoSQL databases.
• Hand-on experience in developing data solutions using Azure Data platform tools( Azure data lake gen2,Azure Sql, Azure Data Factory, Mapping Dataflows, Azure Databricks, logic app, Azure Synapse ,Azure Analysis Services and Azure Functions).
• Strong knowledge and experience in data lake and delta lake-based data platform development using Azure Databricks and Azure Synapse Analytics .
• Strong experience with at least one of the programming languages: Python, PySpark, Scala, R.
• Able to develop CI/CD pipelines for automated build and deploy
• Should be able to contribute to technical solutions and must be able to translate functional/technical into code, unit test and deliver to customer
• Experience with different database technologies (e.g., SQL database(s), Azure SQL)
• Strong Analytical & problem-solving skills
• Development, code review, unit testing,
• Participation in Agile ceremonies
• Good communication skill
• Insurance knowledge will be added advantage