Pyspark/SQL Developer – Automation/SQL/PySpark – sought by leading investment bank based in London – Hybrid – Contract
*inside IR35 – umbrella*
Key Responsibilities:
1. Develop, maintain, and optimize PySpark data processing pipelines.
2. Automate data extraction, transformation, and loading (ETL) processes.
3. Collaborate with data engineers and analysts to design and implement data solutions.
4. Perform data analysis and generate reports to support business decision-making.
5. Ensure data quality and integrity throughout the data lifecycle.
6. Troubleshoot and resolve data processing and reporting issues.
Qualifications:
7. Bachelor's degree in Computer Science, Engineering, or a related field.
8. Proven experience as a Python Developer, with a focus on data processing and automation.
9. Strong proficiency in PySpark and Apache Spark.
10. Solid understanding of SQL and relational databases.
11. Experience with version control systems (e.g., Git).
12. Excellent problem-solving skills and attention to detail.
13. Strong communication and teamwork abilities.