Job Description
CompanyMy client are a fast-growing startup revolutionising the hospitality industry by connecting businesses with a flexible, student-powered workforce. The platform enables partnersfrom local pubs to multinational chainsto optimise staffing in real-time, enhancing efficiency and profitability.The RoleAs a Data Engineer, you'll play a pivotal role in shaping the data infrastructure. Your responsibilities will include:Building and Maintaining Data Pipelines: Design and implement scalable ETL processes to integrate data into our mobile and web applications, as well as internal dashboards.Data Architecture Design: Develop and optimise data storage, retrieval, and processing systems to ensure efficiency and scalability.Collaboration: Work closely with data scientists, software engineers, and internal stakeholders to understand data needs and deliver solutions that drive data-driven decisions.Monitoring and Troubleshooting: Oversee pipeline performance, address issues promptly, and maintain comprehensive data documentation.What Youll BringTechnical Expertise: Proficiency in Python and SQL; experience with data processing frameworks such as Airflow, Spark, or TensorFlow.Data Engineering Fundamentals: Strong understanding of data architecture, data modelling, and scalable data solutions.Backend Development: Willingness to develop proficiency in backend technologies (e.g., Python with Django) to support data pipeline integrations.Cloud Platforms: Familiarity with AWS or Azure, including services like Apache Airflow, Terraform, or SageMaker.Data Quality Management: Experience with data versioning and quality assurance practices.Automation and CI/CD: Knowledge of build and deployment automation processes.Experience within MLOpsA 1st class Data degree from one of the UKs top 15 UniversitiesNice to HaveProduction Experience: Experience building and maintaining data pipelines in a live environment.Data Storage Solutions: Familiarity with data lakes, warehousing, and other data storage patterns.Advanced Tools: Experience with tools like Kafka, Jenkins, Athena, or Spark.This role will require 4 days per week onsite in the office in Camden, this is not optional and you must be open to this in order to proceed with the role.TPBN1_UKTJ