Job Summary
We are seeking a skilled and motivated Data Engineer to join our dynamic team. The ideal candidate will be responsible for designing, developing, and maintaining robust data pipelines and architectures that support our data analytics and business intelligence initiatives. You will work closely with data scientists, analysts, and other stakeholders to ensure the availability and reliability of data across various platforms.
Duties
* Design and implement scalable data pipelines using technologies such as AWS, Hadoop, and Spark.
* Develop and maintain databases using Oracle and Microsoft SQL Server, ensuring optimal performance and reliability.
* Collaborate with cross-functional teams to gather requirements and translate them into technical specifications for data solutions.
* Perform database design, optimisation, and management to support data warehousing initiatives.
* Utilise programming languages such as Java and Python to build efficient data processing applications.
* Conduct data analysis to identify trends, patterns, and insights that drive business decisions.
* Implement ETL processes using tools like Informatica to ensure seamless data integration from various sources.
* Write complex SQL queries for data extraction, transformation, and loading tasks.
* Maintain documentation of data architecture, processes, and workflows for future reference.
* Employ shell scripting (Bash) for automation of routine tasks related to data management.
Experience
* Proven experience in a Data Engineering role or similar position with a strong understanding of big data technologies.
* Proficiency in AWS services related to data storage and processing is highly desirable.
* Familiarity with Apache Hive for querying large datasets is a plus.
* Strong analytical skills with the ability to troubleshoot issues effectively.
* Experience in database design principles and best practices is essential.
* Knowledge of VBA or other scripting languages is advantageous.
* Excellent communication skills with the ability to work collaboratively in a team environment. If you are passionate about leveraging data to drive insights and have the necessary skills to excel in this role, we encourage you to apply
Job Types: Full-time, Permanent
Pay: £42,000.00-£50,000.00 per year
Benefits:
* Casual dress
* Company pension
* Cycle to work scheme
* Employee discount
* Free flu jabs
* Free parking
* Health & wellbeing programme
* Referral programme
Work Location: In person