Responsibilities:
* Ingestion configuration for new workloads in to Microsoft fabric
* Lead execution of Fabric migration
* Lead and guide migration engineers and QA
* Wring Python/PySpark and Spark SQL code for validation/curation in notebook
* Implement or amend worker pipelines
* Convert logical and conceptual data models into detailed technical data mappings
* Data migration, implementation and execution
* Azure DevOps/GitHub configurations for Microsoft Fabric code
Key skills and experience:
* Strong experience in designing and delivering Azure based data platform solutions technologies including:
o Microsoft fabric, Power App, Azure SQL, Power BI
o Azure ADF, Azure Functions Service
o Spark processing and performance tuning
o File formats partitioning for e.g. Delta Lake, Parquet, JSON, XML, CSV
o Azure DevOps/GitHub
* Hands on Python experience
* Experience of synchronous and asynchronous interface approaches
* Knowledge in data modeling (3NF/Dimensional modeling/Data Vault2)
* Able to provide comprehensive documentation
* Able to set and manage realistic expectations for timescales, costs, benefits and measures for success
Nice to have:
* Experience with integration and implementation of data cataloging tools, like Azure Purview and Collabra
* Experience in implementing and integrating visualization tools, like Power BI, Tableau, etc.
#J-18808-Ljbffr