Test Engineer (Data & Automation)
Overview
We are seeking an experienced Test Engineer to support the delivery of high-quality data and application solutions. This role focuses on automation, data validation, and production analysis within a modern cloud-based environment. You will play a key role in ensuring system reliability, improving testing frameworks, and driving best practices across engineering teams.
This is a collaborative position requiring strong technical expertise, analytical thinking, and the ability to mentor others while working across complex data platforms.
Key Responsibilities
* Design, develop, and maintain automated test frameworks to improve testing efficiency and coverage
* Analyse and interpret test results, identifying risks, issues, and areas for improvement
* Produce clear reports on testing activities, outcomes, and associated risks
* Automate data validation and application testing processes across distributed systems
* Investigate production issues using data analysis to identify root causes
* Work with orchestration tools (e.g., Apache Airflow) to monitor workflows and troubleshoot failures
* Validate data using tools such as Jupyter Notebooks and Amazon Athena
* Analyse data across multiple formats to ensure integrity and correctness of new functionality
* Support CI/CD practices using Git-based workflows and pipeline automation
* Participate in infrastructure and deployment activities, including containerisation and Infrastructure as Code
* Collaborate with cross-functional teams to translate business requirements into testable solutions
* Mentor and guide team members on testing methodologies and best practices
Key Skills & Experience
Technical Skills
* Proficiency in Python, SQL, and at least one additional programming language (e.g., Java)
* Experience with scripting languages such as Bash
* Strong understanding of automated testing frameworks and methodologies
* Hands-on experience with Apache Airflow and log analysis
* Familiarity with data processing tools such as Apache Spark
* Experience working with cloud platforms and services, including:
* Monitoring and logging tools
* Storage and data services
* Compute and container services
* Experience with CI/CD pipelines and version control systems (e.g., GitLab)
* Knowledge of Infrastructure as Code (e.g., Terraform)
* Familiarity with Docker and containerised environments
Data & Analytics
* Strong data analysis skills, including working with structured and semi-structured data
* Experience validating and querying data using tools such as Athena and notebooks
* Understanding of data modelling concepts, including dimensional models and slowly changing dimensions
* Ability to generate realistic test data for various scenarios
Additional Knowledge
* Understanding of distributed data platforms and big data environments (e.g., EMR)
* Knowledge of encryption principles (client-side and server-side)
* Awareness of production system monitoring and incident analysis
Soft Skills
* Strong analytical and problem-solving abilities
* Excellent communication skills, with the ability to present findings clearly
* Proactive approach to identifying and mitigating risks
* Ability to mentor and support less experienced team members
* Collaborative mindset with experience working in agile delivery environments
Working Arrangements
* UK-based role with flexible location
* Occasional travel required for team collaboration sessions and workshops