Required Core Skills:
Databricks, AWS, Python, Pyspark, data modelling
Minimum years of experience: 7 years
Job Description:
Must have hands-on experience in designing, developing, and maintaining data pipelines and data streams.
Must have a strong working knowledge of moving/transforming data across layers (Bronze, Silver, Gold) using ADF, Python, and PySpark.
Must have hands on experience to PySpark, Python,AWS,data modelling
Must have experience in ETL processes
Must have hands on experience in Databricks development
Good to have experience in developing and maintaining data integrity and accuracy, data governance, and data security policies and procedures.
Must have hands on experience in SQL development
Excellent Communication skills & Logical thinking