Job Description:
We are a Global Recruitment specialist that provides support to the clients across EMEA, APAC, US and Canada. We have an excellent job opportunity for you.
Job Title: Data Engineer
Location: Sheffield (Hybrid - 3 days per week onsite)
Duration: Contract until 30/11/2026
Pay Rate: £326 per day all inc. (PAYE through FCSA Umbrella)
CONTRACTOR MUST BE ELIGIBLE FOR BPSS
Role Description:
Key Responsibilities:
Design, implement, and maintain data pipelines to ingest and process OpenShift telemetry (metrics, logs, traces) at scale.
Stream OpenShift telemetry via Kafka (producers, topics, schemas) and build resilient consumer services for transformation and enrichment.
Engineer data models and routing for multi-tenant observability; ensure lineage, quality, and SLAs across the stream layer.
Integrate processed telemetry into Splunk for visualization, dashboards, alerting, and analytics to achieve Observability Level 4 (proactive insights).
Implement schema management (Avro/Protobuf), governance, and versioning for telemetry events.
Build automated validation, replay, and backfill mechanisms for data reliability and recovery.
Instrument services with OpenTelemetry; standardize tracing, metrics, and structured logging across platforms.
Use...