I am working with a market leading Advertising client, who are currently hiring a Senior Data Engineer.
Data is a key component for this client, and this opportunity will allow you to shape and build there Data platform. You will be involved in the design and construction of new data capabilities from the ground up, and is a unique opportunity to influence key architectural decisions.
The role is split with up to 70% of your time being dedicated to designing and writing software, 30% managing infrastructure.
What you'll be working on
* Designing APIs around data-intensive services. Some of our services see loads of 5,000 RPS.
* Streaming pipelines and services to power near real-time reporting involving streaming joins.
* Building a high throughput service to push events to third parties.
* Managing key infrastructure such as Kafka, Aurora, DynamoDB, and owning the Data infrastructure. We see around 3 Billion kafka messages per day.
* Key infrastructure migration and upgrades.
* Write software using Java / Python / Scala.
You should have -
* Ability to design services with knowledge of distributed systems.
* Experience building REST APIs.
* Good knowledge of streaming technologies, preferably Kafka, both as a user of the service and its inner workings.
* Experience managing AWS or GCP.
* Experience in building or integrating Monitoring Tools (Datadog / Kibana / Grafana / Prometheus).
* Experience using Terraform / Docker / Kubernetes.
* Write software using either Java / Scala / Python.
This is a hybrid position, with 2-3 day split of remote and central London. A competitive salary is on offer with a banding of up to £90,000 PP