Senior Data Engineer
X2 days a month in office (Surrey)
Xcede are delighted to be working with an incredibly data-rich organisation with over 3 million customers in the UK using their products. The company have a very established Data division headed up by well-regarded CDO who comes from a ‘hands on’ Data Science background. The Data Unit is filled with experienced Data Scientists, Analyst, Machine Learning Engineers, LLM specialists, and Data Engineers.
We’re now actively recruiting for another Senior Data Engineer to join their team. The perfect Senior Data Engineer will love building great Software as much as they do exploring & managing data. The company adhere to Software Engineering best practices and will expect any new joiners to do the same.
Alongside the huge swathe of batch data that they work with, the team also have a clear business opportunity to work on real-time / streaming projects.
Responsibilities
* Manage ETL, build pipelines, and scale data infrastructure to support data science and analytics initiatives.
* Design, implement and improve tools and services for orchestration, observability, data governance and data quality to high engineering standards
* Deploy and manage products using CI/CD best practices
* Work in partnership with Analytical stakeholders from a huge variety of business projects and help to diagnose issues.
Requirements
* Ideally a strong degree in computer science or a relevant area.
* Excellent coding skills specifically in Python.
* Very desirable commercial technical experience with tools such as Spark, Databricks, Airflow, Docker etc
* Commercial Containerisation & Infrastructure as code experience
* Previous work in a CI/CD environment
* AWS is the preferred cloud platform - Azure and/or GCP will be considered.
If this role interests you and you would like to find out more, please apply here or contact us via niall.wharton@Xcede.com (feel free to include a CV for review).