Salary: £60,000 - 90,000 per year Requirements: Strong AWS Data Engineering expertise. Proficiency in Kafka for real-time data streaming and integration. Proficiency with Databricks for data processing and analytics. Working knowledge of NodeJS (added advantage). Solid programming skills in Python, PySpark, and Spark. Adept at working with large-scale datasets, S3, Python, and data cataloguing tools. Familiar with data engineering best practices. Demonstrates commitment to high-performance, scalable, and resilient distributed systems. Strong knowledge of CI/CD pipelines and tools (e.g., Jenkins, GitHub Actions, GitLab CI). Awareness of secure coding standards and data protection principles. Strong understanding of unit testing, integration testing, and test automation frameworks (e.g., PyTest). Familiarity with cloud-native development and CI/CD practices. Agile mindset with a proactive approach to problem-solving. Responsibilities: Collaborate with cross-functional teams to architect, design, develop, and deliver PoCs related to fraud detection. Lead the ETL & Data manipulation/engineering work on AWS. Integrate Databricks-based back-testing into the fraud detection pipeline. Work closely with architects and other developers to ensure seamless integration with existing systems. Participate in weekly stand-up calls to demonstrate progress and align on deliverables. Take ownership of tasks from the backlog, ensuring timely and high-quality delivery. Technologies: AWS Architect CI/CD Cloud Databricks ETL GitHub GitLab Jenkins Kafka NodeJS Python PySpark Spark pytest More: We are seeking a Databricks SME and AWS Data Engineer for a 6-month project located in Northampton, UK, on a hybrid basis. This role involves migrating from Aerospike to Postgres and leveraging Databricks for back-testing fraud detection models. As part of our collaborative team, youll engage in cross-functional architecture and lead ETL efforts, focusing on high-quality delivery of Proof of Concepts (PoCs). We emphasize a supportive environment that values accountability and teamwork. last updated 8 week of 2026