The Role: Join our client as a Lead PySpark Engineer to modernize legacy data workflows. You will lead the hands-on transition of complex SAS environments into scalable, AWS-native PySpark pipelines for a major financial services project.
What You'll Do
Modernize: Convert legacy SAS code into production-ready PySpark using automated tools and manual refactoring.
Build: Design and fix high-performance ETL/ELT pipelines and data marts on AWS.
Your Technical Profile
PySpark (Expert): 5+ years of hands-on experience. Deep knowledge of Spark optimization (partitioning, tuning) and Data Warehousing (SCDs, Facts/Dimensions).
AWS (Expert): Strong proficiency in S3, EMR, Glue, Athena, and IAM. Experience with Git-based CI/CD.
SAS (Working Knowledge): Ability to read and debug Base SAS/Macros to translate logic into Python.
Engineering: Strong Python skills with a focus on clean code, modular design, and exception handling.
Preferred Experience
Background in Banking or Financial Services .
How to Apply:
If you are ready to start a new contract please share your updated CV on yogeshwari. sen@ randstaddigital .com or click on 'apply'
Randstad Technologies is acting as an Employment Business in relation to this vacancy.
TPBN1_UKTJ