Description
We are seeking a highly skilled and experienced Senior Kafka Engineering Lead to join our dynamic team. The ideal candidate will possess a strong background in data engineering, with expertise in Java, Kafka Connect, Change Data Capture (CDC), and Apache Spark. This role involves leading the design, development, and implementation of robust data streaming solutions, ensuring seamless data integration and real-time processing capabilities.
Key Responsibilities:
1.Leadership and Strategy:
•Lead and mentor a team of Kafka engineers, fostering a collaborative and innovative environment.
•Develop and execute strategies for data streaming and integration solutions using Kafka and related technologies.
•Collaborate with cross-functional teams to align data engineering initiatives with business objectives.
2.Technical Expertise:
•Design, implement, and optimize Kafka-based data pipelines for real-time data processing.
•Utilize Java programming skills to develop efficient and scalable data solutions.
•Implement Kafka Connect for seamless integration with various data sources and sinks.
•Leverage CDC techniques to ensure accurate and timely data replication across systems.
•Utilize Apache Spark for data transformation and analytics, ensuring high performance and scalability.
3.Project Management:
•Oversee project timelines, deliverables, and resource allocation to ensure successful project execution.
•Conduct regular reviews and assessments of project progress, addressing any challenges or roadblocks.
4.Innovation and Continuous Improvement:
•Stay abreast of industry trends and emerging technologies in data engineering and streaming.
•Identify opportunities for process improvements and implement innovative solutions to enhance system performance.
5.Stakeholder Engagement:
•Collaborate with stakeholders to understand data requirements and translate them into technical specifications.
•Communicate complex technical concepts to non-technical stakeholders effectively.
Qualifications:
•Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field.
•Proven experience in data engineering, with a focus on Kafka, Java, Kafka Connect, CDC, and Spark.
•Strong leadership skills with experience in managing and mentoring technical teams.
•Excellent problem-solving abilities and a strategic mindset.
•Effective communication skills, both written and verbal.
Preferred Skills:
•Experience with cloud platforms such as AWS, Azure, or Google Cloud.
•Familiarity with containerization technologies like Docker and Kubernetes.
•Knowledge of data governance and security best practices.
Skills
1. kafka
2. spark
3. java
This is a hybrid role where you would go into the Leeds site 3 days a week
Job Title: Kafka Engineer
Location: Leeds, UK
Job Type: Contract
Trading as TEKsystems. Allegis Group Limited, Maxis 2, Western Road, Bracknell, RG12 1RT, United Kingdom. No. 2876353. Allegis Group Limited operates as an Employment Business and Employment Agency as set out in the Conduct of Employment Agencies and Employment Businesses Regulations 2003. TEKsystems is a company within the Allegis Group network of companies (collectively referred to as "Allegis Group"). Aerotek, Aston Carter, EASi, Talentis Solutions, TEKsystems, Stamford Consultants and The Stamford Group are Allegis Group brands.