Python Developer - Data Engineering & Orchestration
Remote in the UK (1 day a week in London)
Outside IR35
Rate negotiable
Must come from Financial Services
We are seeking a skilled Python Developer to join our data engineering team, focusing on data processing, automation, and orchestration workflows within a reference data platform.
This is a technically demanding role that involves building and maintaining robust data pipelines, ensuring seamless orchestration across systems, and integrating with modern data platforms.
Key Responsibilities:
1. Develop and maintain Python-based data processing solutions.
2. Design and implement orchestration workflows using tools such as Apache Airflow, Azure Data Factory (ADF), and Control-M.
3. Collaborate with cross-functional teams to optimize data integration and transformation processes.
4. Work with data platforms including Databricks, Snowflake, and Exadata to manage and manipulate large-scale datasets.
5. Integrate and manage event-driven architectures using Kafka and Event Hub.
6. Contribute to automation and efficiency improvements across the reference data platform.
7. Participate in code reviews, testing, and documentation.
Key Skills & Experience:
8. Very strong in Python, particularly for backend and data processing tasks.
9. Hands-on experience with orchestration tools such as Airflow, ADF, or Control-M.
10. Familiarity with data platforms such as Databricks, Snowflake, and Exadata.
11. Experience with event streaming technologies like Kafka and Event Hub.
12. Bonus: Exposure to Streamlit, Power Apps for lightweight UI development.
13. Bonus: Knowledge of banking and securities reference data.
14. Ideal Candidate Profile:
15. Technically curious with a passion for data-driven solutions.
16. Strong problem-solving and analytical skills.
17. Able to work both independently and as part of a collaborative team.
18. Experience in high-performance, regulated industries (e.g., financial services) is a plus.