Overview
Helping MDs, CTOs, Software Development Managers and leaders of growing tech companies to find the most talented Microsoft Software Developers
We are seeking a Lead Data Engineer with significant Databricks experience and leadership responsibility to run an Agile engineering team and provide technical leadership through coaching and mentorship. The role involves leading client delivery, working with architects, creating automated tests, fostering a culture of continuous improvement and setting standards for the team.
The successful candidate will build a greenfield modern data platform using cutting-edge technologies, architect big data solutions and develop complex enterprise data ETL and ML pipelines and projections.
Responsibilities
* Lead client delivery, collaborate with architects, create automated tests, and instill a culture of continuous improvement; set standards for the engineering team.
* Build a greenfield modern data platform, architect big data solutions, and develop complex enterprise data ETL and ML pipelines and projections.
Qualifications
* Strong Python, PySpark and SQL experience; solid understanding of Databricks; interest in Data Science, ML and AI.
* Experience with SQL and No-SQL databases (e.g., Aurora, MS SQL Server, MySQL).
* Significant Agile and Scrum exposure; knowledge of SOLID principles; experience with CI/CD, Infrastructure as Code, and cloud platforms (ideally AWS).
Requirements & Skills
* Cloud experience and automation tooling; ability to lead a data engineering team and deliver high-quality solutions.
Employment details
* Seniority level: Mid-Senior level
* Employment type: Full-time
* Job function: Engineering and Information Technology
* Industries: IT Services and IT Consulting, Software Development, Data Infrastructure and Analytics
To apply, please send your CV to Nathan Warner at Noir Consulting.
#J-18808-Ljbffr