Job Description
ETL Test Engineer
The Test Engineer is accountable for the design and operational execution of the Data Quality framework, as well as well as coordination across all technical and business resources throughout the test. Responsibilities include creation and maintenance of quality assurance testing deliverables and assisting in delivery activities.
GENERAL RESPONSIBILITIES
* Analysing Business requirement for completeness and accuracy
* Analysing Business requirements against the technical specifications (data modelling)
* Creating high level test scenarios
* Creating manual test cases
* Developing validation scripts for automated execution, while creating actionable data quality reports that measure trends over time.
* Developing yaml code to create DevOps pipelines and maintain them
* Analysing test outputs and reporting defects
* Working closely with Business Analysts, Data Analysts/Scientists, Development, and Product Owners to ensure data housed in multiple source systems is valid and accurate.
* Participating in defect triage and sprint ceremonies
* Candidate will be involved in both automated and manual ETL testing across multiple scrum teams, although most of the testing will be automated
* Participation in architecting the logical design of data quality practices with the technical team, including DQ design and specifications, data modelling, and documentation of logical processing flows.
* Agile testing.
* Developing documents and implementing data quality standards.
* Regularly reviewing and interpreting QA results and findings with limited support from senior leadership.
Technical Skills
* Azure Data bricks
* Azure ADF
* Azure DevOps
* SQL
* DAX
* Javascript/Typescript
* Python/Pyspark
* YAML
* Powershell
Qualifications
Key Skills -
* Must have – Experience in test management tools – Devops, JIRA
* Must have – Experience in source control repositories – git (github and bitbucket)
* Nice to have – Experience in Azure Databricks, Python/Pyspark,YAML and SQL queries - ability to analyse data in a Data Warehouse environment.
* Nice to have – Experience in understanding and writing DAX queries.
* Nice to have - worked on testing reports (Power BI/ Tableau)
* Good understanding of the framework of ETL
* Experience working in a Scrum / Agile environment.
Minimum Requirements:
* At least 5+ years related experience or equivalent combination of education and Consulting experience.
* At least 5 years’ experience in large scale system implementation efforts following a standard software development lifecycle approach (scrum desired).
* Experience with ETL testing
* Ability to automated ETL tests using Pyspark/Python
* Ability to write manual test cases from business requirements and technical specifications.
* Ability to create data bricks notebooks to automate the manual tests.
* Ability to create and run Test pipelines and interpret the results.
* Ability to test complex reports and write queries to check each metrics.
* Strong oral and written communications skills.
Additional Information
We don’t believe hiring is a tick box exercise, so if you feel that you don’t match the job description 100%, but would still be a great fit for role, please get in touch.