Data engineer

Job Description

The CompanyNW Tech are delighted to be working with a rapidly expanding professional services organisation in their search for a Data Engineer. The RoleKey responsibilities include: 

• Design, build and maintain scalable data pipelines to ingest, process and transform structured and unstructured data from diverse sources.
• Ensure the data platform is fully documented, maintaining up-to-date information requirements, data models, data dictionaries, and ETL mappings.
• Collaborate with cross-functional teams, including system administrators, developers / engineers, external partners, and business stakeholders, to understand requirements and deliver solutions.
• Optimise solutions for performance, reliability, and scalability, ensuring efficient data processing and storage.
• Implement and manage orchestration workflows to automate data pipeline scheduling monitoring and error handling.

The RequirementsAs a Data Engineer you will play a crucial role in transforming data into actionable insights and supporting the company's data infrastructure. Key requirements include: 

• Ideally experienced as a Data Engineer with hands-on experience designing and delivering data pipelines using industry-standard tools and cloud technologies.
• Knowledge of data engineering concepts, data pipeline development, ETL processes, data lake and data warehousing technologies.
• Proficiency in working with at least one major cloud data platform 
• Proficiency in Python for data engineering tasks (e.g. pipeline scripting, data transformation, automation)
• Good knowledge of relational database technologies and concepts