Azure Databricks Data Engineer - London
Reference Code: -en_GBContract Type: PermanentProfessional Communities: Data & AI
Get The Future You Want!
Choosing Capgemini means choosing a company where you will be empowered to shape yourcareer in the way you’d like, where you’ll be supported and inspired by a collaborativecommunity of colleagues around the world, and where you’ll be able to reimagine what’spossible. Join us and help the world’s leading organizations unlock the value of technology andbuild a more sustainable, more inclusive world.
Your Role:
* Design and implement robust ETL/ELT pipelines on Databricks.
* Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver high-quality solutions.
* Optimize data workflows for performance, scalability.
* Develop and maintain data lake and data warehouse architectures.
* Ensure data quality, governance, and security standards are met.
* Lead code reviews, mentor junior engineers, and contribute to best practices in data engineering.
* Integrate Databricks with other enterprise systems and tools (e.g., Delta Lake, MLflow, Power BI, etc.).
* Monitor and troubleshoot production data pipelines and jobs.
Your Profile:
* Lead the design, development, and optimization of scalable data pipelines using Databricks.
* Drive data modernization initiatives to support advanced analytics and machine learning.
* Collaborate with cross-functional teams to understand data requirements and deliver robust solutions.
* Implement best practices for data engineering, including performance tuning and cost optimization.
* Ensure data quality, reliability, and consistency across all data platforms.
* Leverage Databricks features such as Delta Lake, notebooks, and MLflow for end-to-end workflows.
* Apply knowledge of data governance frameworks and tools, including Unity Catalog.
* Maintain and enhance data security, access controls, and compliance standards.
* Mentor junior engineers and contribute to the development of engineering standards.
* Hold relevant Databricks certifications (e.g., Databricks Certified Data Engineer Professional).
About Capgemini
Capgemini is a global business and technology transformation partner, helping organizations toaccelerate their dual transition to a digital and sustainable world while creating tangible impact forenterprises and society. It is a responsible and diverse group of 350,000 team members in morethan 50 countries. With its strong over 55-year heritage, Capgemini is trusted by its clients to unlockthe value of technology to address the entire breadth of their business needs. It delivers end-to-endservices and solutions leveraging strengths from strategy and design to engineering, all fueled byits market-leading capabilities in AI, cloud, and data, combined with its deep industry expertise andpartner ecosystem. The Group reported 2023 global revenues of €22.5 billion.
Get The Future You Want