3 days ago Be among the first 25 applicants
Get AI-powered advice on this job and more exclusive features.
Direct message the job poster from Valpak Limited
Overall purpose
As the Data Pipeline Manager (Qlik Talend Team Leader), you will lead a team responsible for building and maintaining scalable, reliable data pipelines that support enterprise reporting and analytics. You will oversee the development and optimisation of Talend-based data workflows, ensuring high data quality and availability across systems such as Qlik and our central databases. Collaborating with data stewards, analysts, and support teams, you will guide the implementation of best practices in data integration, transformation, and validation. This role is critical in ensuring the stability and performance of data operations that underpin business insights and application functionality.
Overall purpose
As the Data Pipeline Manager (Qlik Talend Team Leader), you will lead a team responsible for building and maintaining scalable, reliable data pipelines that support enterprise reporting and analytics. You will oversee the development and optimisation of Talend-based data workflows, ensuring high data quality and availability across systems such as Qlik and our central databases. Collaborating with data stewards, analysts, and support teams, you will guide the implementation of best practices in data integration, transformation, and validation. This role is critical in ensuring the stability and performance of data operations that underpin business insights and application functionality.
The Valpak Data Insights (VDI) department regularly receive data files from their customers systems with regards to Product and transactional data. This data is transformed and loaded into our database using an inhouse built application. VDI will be migrating to the Qlik Talend ETL software on the customer files to load data into our databases.
Key Accountabilities
Liaise with VDI and IT to allow the smooth transition of data through Qlik Talend
* Put a structure in place to create an environment for Qlik Talend and GitHub to allow easy development of pipelines
* Ensure that Qlik Talend Developers are allocated suitable well-defined requirements.
* Act as a point of escalation for any Qlik Talend questions.
* Make sure that the Qlik environment is running and that automated pipelines can be ran.
Generate and consistently improve Qlik Talend pipelines
* Create and maintain pipelines for each customer’s data.
* Create a reusable toolkit of code for validation and transformations that can be used by other customers
* Generate automated validation checks on the received data so that it can be handled more efficiently before loading into the database.
* Become an expert in using the Qlik Talend Studio software so that any data transformations requested by the business can be performed.
* Use Java code to perform advanced manipulation of the data
* Integrate Apil’s into the Talend Studio
* Keep up to date with improvements in the Qlik Talend Studio to improve data handling.
Ensure standards are maintained
* Make sure that data is handled correctly by Qlik Talend and that poor data is not loaded into the Database.
* Use GitHub to allow source control of the created pipelines.
* Implement Qlik Talend with Data Streams
Liaise with Account Managers to make sure that pipelines can process the data received from Customers
* Liaise with business to understand customer requirements, and to keep the business informed of pipeline progress.
* Provide feedback to users about the quality of the customers’ data.
* Establish and maintain a data stewardship model that works for the operational team
Requirements
Experience, skills
* Management experience
* Excellent written and verbal communication skills
* Great attention to detail
* Excellent organisational skills.
* Strong analytical and problem-solving abilities
* Experience using Microsoft packages, including Excel
* Experience of using ETL software
* Knowledge of Qlik Talend (or similar ETL tools), SQL, Java and GitHub is required
Qualifications
* Applicants should be educated to degree level or possess solid work experience in related field.
Benefits
* Hybrid working available, happy to talk flexible working
* Up to 10% bonus
* Enhanced holiday scheme (option to buy/sell up to 10 days) and long service awards
* Critical illness, Life assurance & disability income protection
* Option to join private medical insurance, subsidised gym membership, and bike to work scheme
* Contributory pension scheme
* Wellbeing initiatives and support including Wellbeing App access
* MyPerks discounts platform
Seniority level
* Seniority level
Associate
Employment type
* Employment type
Full-time
Job function
* Job function
Information Technology
Referrals increase your chances of interviewing at Valpak Limited by 2x
Birmingham, England, United Kingdom 5 days ago
Coventry, England, United Kingdom 1 week ago
Coventry, England, United Kingdom 1 week ago
Banbury, England, United Kingdom 2 days ago
West Midlands, England, United Kingdom 2 days ago
West Midlands, England, United Kingdom 2 weeks ago
Birmingham, England, United Kingdom 1 day ago
Assistant Manager - London Gatwick Airport - New Store Opening!
Horley, England, United Kingdom 1 week ago
Assistant Manager Up to A GBP 41,000 OTE Reading
Royal Leamington Spa, England, United Kingdom 3 weeks ago
Smethwick, England, United Kingdom 3 days ago
West Midlands, England, United Kingdom 6 days ago
We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr