Job Description
Hello there,
Greetings from INFOPLUS TECHNOLOGIES!!!
We are looking for "Data Engineer".
Job Details:
Job Title: Data Engineer
Location: Glasgow
Mode : 3 days WFH
Relevant Experience Required: 5+ Years min
Job Description:
You will be responsible for:
• Collaborating with cross-functional teams to understand data requirements, and design efficient, scalable, and reliable ETL processes using Python and DataBricks
• Developing and deploying ETL jobs that extract data from various sources, transforming it to meet business needs.
• Taking ownership of the end-to-end engineering lifecycle, including data extraction, cleansing, transformation, and loading, ensuring accuracy and consistency.
• Creating and manage data pipelines, ensuring proper error handling, monitoring and performance optimizations
• Working in an agile environment, participating in sprint planning, daily stand-ups, and retrospectives.
• Conducting code reviews, provide constructive feedback, and enforce coding standards to maintain a high quality.
• Developing and maintain tooling and automation scripts to streamline repetitive tasks.
• Implementing unit, integration, and other testing methodologies to ensure the reliability of the ETL processes
• Utilizing REST APls and other integration techniques to connec...