Are you passionate about solving complex data challenges and building innovative data solutions, especially with cutting-edge tools like Microsoft Fabric, Azure, Google, AWS? Do you thrive on logical problem-solving and are energized by using technology to drive impactful results? If you have hands-on experience as a Data Engineer and are eager to work with Copilot agents and AI tools, we want to hear from you.
We’re searching for a Data Engineer with practical expertise in designing, optimizing, and maintaining data pipelines and storage within Microsoft Fabric, Azure Synapse, Azure Data Factory, and Azure Fabric. Experience with Azure, Google, or AWS data tools is valuable, but a willingness to learn and a hunger for growth are just as important.
The Role:
1. Designing, building, and optimizing data pipelines using Microsoft Fabric, Azure Synapse, Azure Data Factory, and Azure Fabric.
2. Developing and fine-tuning PySpark notebooks to efficiently manage large-scale data workloads.
3. Implementing, troubleshooting, and enhancing ETL/ELT workflows in Azure Synapse and Microsoft Fabric.
4. Managing and organizing Data Lakes for seamless data access and high performance.
5. Integrating AI/LLM models, including Copilot agents into data pipelines to boost innovation and deliver actionable insights.
6. Collaborating with Business team, Data Experts, AI Engineers, Data Analysts, and business domain experts to create powerful, data-driven solutions.
7. Participating in and supporting data security, governance, and compliance initiatives within the Azure and Microsoft Fabric ecosystem.
8. Gathering data from multiple sources like APIs and handling large data volumes
9. Staying at the forefront of emerging cloud platforms, AI, and big data technologies, with a focus on practical, hands-on applications.