The Data Engineering Principal leads the AWS design, building, and implementation of processes to capture, manage, store, and utilize structured and unstructured data from internal and external sources. This role involves both hands-on development and providing technical leadership to teams, ensuring the delivery of high-quality, scalable, and efficient data infrastructure.
Responsibilities:
1. Lead End-to-End Data Lifecycle: Own and manage the complete data lifecycle—from capturing learning interaction data to delivering consolidated insights—ensuring data is accurate, accessible, and actionable.
2. Architect Scalable Data Solutions: Design and implement enterprise-grade data pipelines and architectures using AWS services (e.g., S3, Glue, Lambda, Redshift, EMR, Kinesis), optimized for analytics and scalability.
3. Set Technical Direction: Define and guide technical decisions related to data conceptualization, modeling, and visualization within the organization’s analytics ecosystem.
4. Champion Data Governance and Access: Drive visibility into data usage and access, ensuring secure, compliant, and transparent data practices across the organization.
5. Communicate with Impact: Translate complex technical concepts into clear, non-technical language for business stakeholders and internal customers.
6. Act as a Subject Matter Expert: Serve as a go-to expert in data architecture, resolving complex issues and fostering thought leadership and technical excellence.
7. Drive Standards and Best Practices: Lead the implementation of architectural guidelines and frameworks, ensuring alignment with strategic objectives and consistency across solutions.
8. Monitor and Optimize Services: Define and oversee service metrics, collaborating with stakeholders to meet performance standards and client expectations.
9. Innovate and Evolve Architecture: Spearhead the development of innovative data services and products aligned with evolving business needs.
10. Mentor and Develop Talent: Coach and support professionals, building current and future capabilities within the data architecture team.
11. Lead Continuous Improvement: Identify and implement process enhancements to improve efficiency, quality, and agility of data practices.
12. Cloud Governance: Utilize tools such as IAM, resource tagging, and cost management to enforce AWS governance policies, and implement monitoring and alerting solutions.
Qualifications include a bachelor's degree in computer science, information technology, or a related field; a master's degree is preferred. AWS Solutions Architect certification (Associate or Professional) is highly valued. Candidates should have strong knowledge of cloud concepts, architecture patterns, and experience designing and maintaining AWS solutions, with proficiency in Python and Apache Spark, and hands-on experience with AWS data services like EMR, Glue, Lambda, Step Functions, API Gateway, and Athena. A proven track record in designing complex data pipelines, Lakehouse architectures, and distributed systems is essential, along with the ability to adapt quickly across diverse system designs.
BT Group is a leading telecommunications company in the UK, involved in major digital infrastructure projects, including full fiber broadband and 5G investments. The company is committed to innovation, customer service, and organizational transformation, offering an exciting environment for professionals eager to contribute to the future of connectivity.
#J-18808-Ljbffr