Data Integration Engineer – Permanent – Abingdon, Oxfordshire
Hybrid – 3 days on site 2 days remote
Data Integration Engineer required: - 5+ years’ experience working with databases & related tools. Strong proficiency with data virtualisation platforms & tools such as Teiid or similar. Solid understanding of SQL, relational databases, & data modelling. AWS & or Azure) & cloud-native data services. Familiarity with RESTful APIs, JSON, XML, OData, & message queues (Kafka). ETL/ELT. APIs. Knowledge of data governance, security, & compliance best practices. Understanding of data lifecycle management & SOC2 security standards. Familiarity with geoscience disciplines, geospatial data & GIS tools (e.g., ArcGIS, QGIS) is advantageous. Scripting & automation (e.g., PowerShell, Python, Java). Gitlab. Spotfire data visualization platform or alternative dashboard solutions. Agile
My client is seeking a skilled & proactive Data Integration Engineer to join their Technical Services team. Reporting to the Team Lead the Data Integration Engineer will be responsible for designing, building, & maintaining robust data pipelines & integration frameworks that connect diverse systems including LLMs & a proprietary Data Integration solution.
Data Integration Engineer key responsibilities:
* Design & implement scalable data integration solutions using ETL/ELT tools & APIs
* Develop & maintain data pipelines that include Large Language Models (LLMs)
* Build solutions that include cloud & on-premises environments
* Collaborate with data architects, analysts, & business stakeholders to understand data requirements
* Integrate data from various sources including databases, SaaS platforms, APIs, & flat files
* Monitor & optimize data flows for performance, reliability, & cost-efficiency
* Ensure data quality, consistency, & governance across integrated systems
* Automate data workflows & support real-time data streaming
* Document integration processes & maintain technical specification
#J-18808-Ljbffr