Social network you want to login/join with:
We are seeking a skilled, motivated Data Engineer to join our dynamic and innovative team. As a Data Engineer in the Data & Insight Team, you will work as part of a team of data engineers to design, develop, test, and maintain data products and our data analytics platform.
This is a fantastic opportunity to join our team at a pivotal moment. As we upgrade our data platform to modernize our analytics and AI capabilities, you`ll play a crucial role in building the architecture and pipelines to deliver the data assets that will drive our future success. If you`re passionate about creating innovative and scalable data solutions and want to be part of a team that will help reshape how Unite Students leverages data, we want to hear from you.
What You`ll Be Doing
* Build, test, and maintain robust, scalable data architectures and pipelines that align with architectural standards and business objectives
* Collaborate with other data engineers to share knowledge and deliver solutions.
* Contribute to the culture of continuous improvement within the team and seek opportunities to automate processes
* Troubleshoot complex data issues and optimize existing systems for performance and reliability
* Implement data validation and quality checks and monitoring solutions to ensure data integrity and observability to meet data governance standards and requirements.
* Collaborate with cross-functional teams to help define requirements and ensure alignment with business needs
* Communicate complex technical concepts effectively to non-technical stakeholders
* Keep informed of new technologies and deliver proof-of-concept projects to drive innovation
* Contribute to Agile ceremonies and technical processes such as code reviews and Change Advisory Board meetings.
What We`re Looking for in You
* Experience of working as a Data Engineer
* Highly proficient in SQL, Python, and Spark (pyspark) for developing and testing data engineering pipelines and products to ingest and transform structured and semi-structured data.
* Understanding of data modelling techniques and data pipeline design patterns and behaviours
* Experience with pipeline management and orchestration tools such as Airflow
* Experience with low/no-code pipeline development tools such as Talend or SnapLogic.
* Experience developing data pipelines using cloud services (AWS preferred) like Lambda, S3, Redshift, Glue, Athena, Secrets Manager or equivalent services.
* Experience of working with APIs for data extraction and interacting with cloud resources via APIs/CLIs/SDKs (e.g., boto3).
* Experience building out a data warehouse on platforms such as Redshift, Snowflake, or Databricks.
* Comfortable working with Git for source control (in Azure DevOps repos or equivalent)
* Experience working in an Agile (Scrum) environment for product delivery using Azure DevOps or similar tools
* Strong problem-solving abilities with the capability to quickly analyze issues and locate performance bottlenecks in code and pipelines
* Excellent communication skills, including the ability to translate complex technical concepts for non-technical audiences and non-data experts.
Nice to Have
* AWS certification(s)
* Experience developing data pipelines with Databricks
* Experience building and deploying data models with dbt
* Infrastructure as Code experience (Terraform)
What You`ll Get in Return
* A discretionary annual bonus so you can share in the company`s success
* 25 days` paid holiday and an annual holiday buying scheme, with 5 additional days awarded for long service
* A generous pension scheme - employer contributions between 5% and 11% depending on how much you save
* Various benefits to support your health and wellbeing including a Healthcare Cash Plan, an Employee Assistance Programme, a Wellbeing platform, and a Gym benefit that you can share with your family and friends
* Enhanced Family Leave including 18 weeks full pay for birthing parents and 4 weeks for non-birthing parents
* Lots of other great benefits including an annual ShareSave scheme, Employee Life Assurance, a discounts portal, and more!
#J-18808-Ljbffr