Data Engineer
Inside IR35
Remote with some attendance to client site in Surrey as required
Working for a market-leading insurance company, you will work in a team of data & AI Engineers, data scientists, developers, analysts, and architects. You will work on designing and building cutting-edge machine learning and AI services, supporting analytics and product iteration across various business areas.
Key tasks:
1. Build and support data products within their industry-leading platform
2. Collaborate with product managers, data & AI engineers to deliver technical solutions for pressing data problems, including GenAI applications
3. Design, build, and maintain components of the data and analytics platform to enable seamless data consumption, including orchestration, monitoring, and performance optimization
4. Integrate data from various sources, ensuring adherence to data quality and technical standards
5. Create frameworks and processes for data pipelines across the platform
6. Establish and enforce coding and data process standards, promoting best practices
Key skills:
* A passion for designing and building robust data platforms
* Strong hands-on experience with modern cloud data warehouses such as Databricks or Snowflake, ideally on AWS
* Proficiency in Python, including experience with Spark and Airflow
* Experience in all phases of data modeling, from conceptualization to optimization, supported by advanced SQL skills
* Experience with CI/CD pipelines using Git, Jenkins, or similar tools
* Hands-on experience with batch and real-time data integration, performance assessment, debugging, and tuning
* Ability to acquire, ingest, cleanse, integrate, and structure large volumes of data from multiple sources
* Experience with Infrastructure as Code tools like Terraform is a plus
* Experience with Docker and Kubernetes for containerization and orchestration is a plus
* Exposure to Generative AI in production is advantageous
GWV Talent Solutions Limited (trading as Gerrard White Consulting and Vermelo RPO) acts as an employment agency for permanent recruitment and an employment business for temporary and contract workers. By applying for this job, you accept the terms of our Privacy Policy and Terms of Service, available at www.gerrrardwhite.com.
#J-18808-Ljbffr