What you’ll be doing
As a Data Engineering Specialist, you will:
1. Design, code, test, and deploy robust data ingestion and transformation processes, ensuring data security and privacy.
2. Lead the development of architecture and design patterns for processing and storing high-volume datasets.
3. Drive complex projects, applying advanced technical knowledge to solve open-ended and ambiguous problems.
4. Champion Agile delivery practices, ensuring consistent quality and timely delivery.
5. Define and monitor key data quality indicators, enhancing visibility into pipeline and infrastructure health.
Essential Skills
6. Programming
7. Infrastructure Design
8. System Integration
9. Decision Making
10. Troubleshooting
What we'd like to see on your CV
We’re looking for expertise in:
11. Operating Systems: Linux
12. Big Data Technologies: Apache Spark, Kafka, NiFi, HBase, Airflow
13. Programming Languages: Python, Scala, C++
14. Data Platforms: AWS (S3, Glue, Redshift, EMR), On-premise Hadoop/K8s ecosystems
15. Databases & Query Languages: Hive, HBase, SQL, NoSQL
16. Data Formats: JSON, Parquet, Avro, CSV
17. Version Control & CI/CD: Git, Jenkins, Terraform, Artifactory
18. Monitoring & Logging: Prometheus, Grafana, ELK Stack
Benefits
19. Competitive salary
20. BT Pension scheme, minimum 5% Employee contribution, BT contribution 10%
21. On-call allowance (Depending on role requirements)
22. 25 days annual leave (not including bank holidays), increasing with service
23. Huge range of flexible benefits including cycle to work, healthcare, season ticket loan
24. World-class training and development opportunities
25. From January 2025, equal family leave: receive 18 weeks at full pay, 8 weeks at half pay and 26 weeks at the statutory rate. It’s for all parents, no matter how your family is made up.
26. Enhanced women’s health support: including help with menopause symptoms, cancer screenings, period care and more.
27. 24/7 private virtual GP appointments for UK colleagues
28. 2 weeks paid carer’s leave
29. World-class training and development opportunities
30. Option to join BT Shares Saving schemes.
31. Discounted broadband, mobile and TV packages
32. Access to 100’s of retail discounts including the BT shop
#LI-Onsite
Security is one of the fastest growing parts of our global organisation. We are protecting our networks from more than 6,500 cyber attacks each day, investing over £40m in research each year - and in employing nearly 3,000 people, we’re also the largest private cyber employer in the UK. With incredible opportunities to learn, develop and grow your skills, we’ll invest in you, nurture your potential and shape your future – whatever your background or experience.
In today’s world, safe and secure digital connections have never been more vital. You’ll be joining a global company operating at the forefront of the information age: BT employs 90,000 people in 180 countries. With huge scale, we’re capable of achieving great things, striving to be personal, simple, and brilliant for our customers whilst creating an inclusive working environment where people from all backgrounds can succeed. Play your part. Make a difference. We are the Protectors. A FEW POINTS TO NOTE: Although these roles are listed as full-time, if you’re a job share partnership, work reduced hours, or any other way of working flexibly, please still get in touch. We will also offer reasonable adjustments for the selection process if required, so please do not hesitate to inform us. DON'T MEET EVERY SINGLE REQUIREMENT? Studies have shown that women and people who are disabled, LGBTQ+, neurodiverse or from ethnic minority backgrounds are less likely to apply for jobs unless they meet every single qualification and criteria. We're committed to building a diverse, inclusive, and authentic workplace where everyone can be their best, so if you're excited about this role but your past experience doesn't align perfectly with every requirement on the Job Description, please apply anyway - you may just be the right candidate for this or other roles in our wider team.