Hi Professional,
Submit your CV and any additional required information after you have read this description by clicking on the application button.
Please take a look at the below role and let me know your interest.
Job: Open Source Kafka Real Time Architect
Location: Leeds (3 days onsite/ week)
Duration: 6 months (Inside IR35)
(No sponsorship available; profiles from UK only are required)
Role Purpose
A Kafka Real-Time Architect is responsible for designing and implementing scalable, real time data processing systems in Kafka. This role involves architecting Kafka cluster, ensuring high availability, and integrating with other data processing tools and platforms.
It is Mandatory for the candidate to work from Leeds 3 days/week. Pls do not share profiles if candidates are not willing to work from Leeds 3 days/week.
Rate as per market.
Key words when sourcing and talking to candidates mandatory –
* Only mention on-premise/cloudera open source kafka experience
* Spend a lot of time on Disaster Recovery aspects
* Read up and explain new features like KRAFT
* Kafka Resiliency
* Any Real time tech experience like Spark
* Confluence Kafka expertise, not acceptable – Do not submit profiles.
͏
As part of the CTO Data Ingestion Service, the incumbent will be required to:
* Designing and architecting scalable, real-time systems in Kafka.
* Configuring, deploying, and maintaining Kafka clusters to ensure high availability and scalability.
* Integrating Kafka with other data processing tools and platforms such as Kafka Streams, Kafka Connect, Spark Streaming Schema Registry, Flink and Beam.
* Collaborating with cross-functional teams to understand data requirements and design solutions that meet business needs.
* Implementing security measures to protect Kafka clusters and data streams.
* Monitoring Kafka performance and troubleshooting issues to ensure optimal performance.
* Providing technical guidance and support to development operations teams.
* Staying updated with the latest Kafka features, updates and industry practices.
͏
Required Skills Experience
* Extensive Experience with Apache Kafka and real-time architecture including event driven frameworks.
* Strong Knowledge of Kafka Streams, Kafka Connect, Spark Streaming, Schema Registry, Flink and Beam.
* Experience with cloud platform such as GCP Pub/Sub.
* Excellent problem-solving skills.
Knowledge & Experience / Qualifications
· Knowledge of Kafka data pipelines and messaging solutions to support critical business operations and enable real-time data processing.
· Monitoring Kafka performance, enhancing decision making and operational efficiency
· Collaborating with development teams to integrate Kafka applications and services.
· Maintain an architectural library for Kafka deployment models and patterns
· Helping developers to maintain Kafka connectors such as JDBC, MongoDB and S3 connectors, along with topics schemas, to streamline data ingestion from databases, NoSQL data stores and cloud storage, enabling faster data insight.
͏
4.Team Management
* Resourcing
* Anticipating new talent requirements as per the market/ industry trends or client requirements
* Hire adequate and right resources for the team
* Talent Management
* Ensure adequate onboarding and training for the team members to enhance capability & effectiveness
* Build an internal talent pool and ensure their career progression within the organization
* Manage team attrition
* Drive diversity in leadership positions
* Performance Management
* Set goals for the team, conduct timely performance reviews and provide constructive feedback to own direct reports
* Ensure that the Performance Nxt is followed for the entire team
* Employee Satisfaction and Engagement
* Lead and drive engagement initiatives for the team
* Track team satisfaction scores and identify initiatives to build engagement within the team