SThree is excited to announce an opportunity for a talented AI Data Pipeline Engineer to join our dynamic team. You’ll be based in one of our fantastic office spaces in Glasgow or London, working in a collaborative environment where your expertise will make a real impact.
As an AI Data Pipeline Engineer, you will be responsible for building scalable, real-time data pipelines to connect various structured and unstructured data sources across Cosmos DB, Redis, PostgreSQL, and Dataverse. This is an opportunity to join a high functioning relaxed team that will significantly contribute to the digital transformation at SThree.
Who will you be working for?
SThree is the global STEM-workforce consultancy. We connect sought-after specialists with dynamic organisations around the world. We advise businesses, build expert teams, and deliver project solutions to drive innovation across STEM sectors, helping them to Outpace tomorrow, together.
What are the key expectations of this role?
* Be responsible for building scalable, real-time data pipelines to connect various structured and unstructured data sources across Cosmos DB, Redis, PostgreSQL, and Dataverse.
* You will also lead the design of embedding generation pipelines to feed Azure Cognitive Search indexes, powering semantic retrieval across the recruitment knowledge graph.
* You’ll work closely with AI engineers to ensure data compliance (GDPR, DSAR) and auditability, enabling secure AI workflows across multiple business domains and geographical regions.
* Advanced skills in Cosmos DB, Redis, PostgreSQL (query optimisation, schema design)
* Azure Cognitive Search integration and vector embedding pipelines
* Microsoft Dataverse and Microsoft Fabric familiarity
* Data compliance and governance controls (GDPR, DPA, DSAR)
Remote Working
* Expected to be in the office 1 to 2 days a week. With additional days depending on activity (e.g. a design workshop)
Benefits for our U.K. teams include:
* The choice to work flexibly from home and the office, in line with our hybrid working principles
* Bonus linked to company and personal performance
* Generous 28 days holiday allowance, plus public holidays
* Annual leave purchase scheme
* Five days paid Caregiver/Dependent leave per annum
* Five paid days off per year for volunteering
* Private healthcare, discounted dental insurance and health care cashback scheme
* Opportunity to participate in the company share scheme
* Access to a range of retail discounts and saving
What we stand for...
We’re committed to ensuring that all processes are equitable, and everyone is treated with fairness and dignity where everyone belongs, is valued and connected. If you need any assistance or reasonable adjustments in submitting your application please let us know, and we’ll be happy to help.
Seniority level
Mid-Senior level
Employment type
Full-time
Job function
Information Technology
Business Consulting and Services
Referrals increase your chances of interviewing at SThree by 2x
Get notified about new Pipeline Engineer jobs in London Area, United Kingdom.
#J-18808-Ljbffr