Overview
The Data Engineer will work with the product engineering team, focusing on enabling Business Intelligence and Data Science efforts, primarily on AWS-based data technologies. The engineer will also collaborate with the corporate technology team to build, manage, automate, and support AWS infrastructure.
Client
My client is a major global developer and operator of luxury casino resorts, known for iconic properties in Las Vegas, Macau, and Singapore.
Responsibilities
* Collaborate with data consumers, producers, and compliance specialists to identify data solution requirements for executive exposure.
* Design, build, operate, and support solutions for Business Intelligence and Data Science in AWS, including data ingestion, ETL/ELT processes, curated data products, and third-party integrations.
* Support and evolve data lake, catalog, warehouse, and processing infrastructure.
* Provision and maintain AWS services and infrastructure as code using Amazon CDK.
* Recommend product/vendor choices and design strategies.
* Identify opportunities to reduce waste and redundancy.
* Manage work requests to meet service objectives and KPIs.
* Handle incident, problem, and change management processes.
Skills & Experience
* Over 3 years experience with Spark for batch and stream processing; Ray experience is a plus.
* Over 3 years experience with cloud data warehousing tools like Snowflake, Redshift, BigQuery, or ClickHouse.
* Proficiency in SQL, especially HiveQL.
* Programming skills in Java, Scala, Python, and Typescript.
* Strong understanding of AWS security, especially related to S3, Kinesis, EMR, Glue, LakeFormation.
* Experience with GitHub, DataDog, and AWS tools.
Contract Details
* Duration: 6 months initially
* Rate: £600 per day
* Location: Remote (ad hoc London travel expensed)
* Outside IR35
* Start: ASAP
#J-18808-Ljbffr