Senior Data Engineer Inside IR35 Contract - Up to £850 per day 3 Days per Week in London 6-Month Initial Contract (2 Years Project Scope) Start Date : April 2026 We are working alongside a leading Commodities Trading Firm who are searching for a Senior Data Engineer to join the business. You'll be building pipelines to support their trading and analytics platforms! Project & Responsibilities Design and develop scalable Python-based data pipelines using Dagster to ingest, transform and integrate datasets into the enterprise data platform. Build ingestion frameworks to extract data from internal systems, trading platforms, APIs, and external providers, supporting both batch and real-time data flows. Implement streaming data integrations using Apache Kafka to enable event-driven processing and near real-time analytics. Land and manage curated datasets within AWS storage environments, ensuring data integrity, scalability and cost efficiency. Apply strong data governance practices including validation, lineage tracking, schema consistency and secure access controls across the data platform. Ensure production stability and operational reliability of data pipelines through monitoring, alerting, logging and proactive incident management. Break down complex data integration initiatives into structured technical deliverables, defining implementation strategies and mitigating delivery risks. Provide engineering leadership through code reviews, CI/CD best practices, mentoring engineers and promoting scalable, maintainable data platform solutions. Technical Skill Set Required Strong Python data engineering experience, including orchestration with Dagster, advanced SQL, and data modelling. Experience building streaming and event-driven pipelines using Apache Kafka and integrating heterogeneous data sources. Solid background operating cloud-native data platforms on Amazon Web Services, with CI/CD, version control and production operations experience.