Overview
Expleois a trusted partner for end-to-end, integrated engineering, quality services and management consulting for digital transformation. We help businesses harness unrelenting technological change to successfully deliver innovations that will help them gain a competitive advantage and improve the everyday lives of people around the globe.
We are seeking a talented Data Engineer to join our team. As a Data Engineer, you will work with a variety of technologies including Python, Py-Spark, Pandas, SQL and Azure DevOps. You will be responsible for modeling and implementing predictive maintenance solutions for our products, specifically focusing on jet engines.
Responsibilities
* Collaborate with stakeholders to understand data migration requirements
* Work with diverse data formats and source/target databases
* Design, develop, test, and maintain data migration modules
* Analyse and address data quality issues at both the source and destination
* Participate in peer reviews, design discussions, and knowledge sharing
* Prioritize and resolve issues reported in live systems to ensure minimal downtime
* Document migration processes and provide regular progress updates
Essential skills
* Strong experience with Databricks
* Proficient in SQL for data querying and transformation
* Solid understanding of Azure Services including:
o Azure Data Factory
o Azure Storage Containers
o Lakehouse architecture
* Expertise in PySpark for big data processing
* In-depth knowledge of data migration processes, including ETL and data mapping
* Excellent verbal and written communication skills
Experience
* Experience with CI/CD pipelines for deployment automation
* Familiarity with COSMOS DB
* Proficiency in Python beyond PySpark
* Working knowledge of Azure DevOps tools and practices
Benefits
* Collaborative working environment – we stand shoulder to shoulder with our clients and ourpeers through good times and challenges
* We empower all passionate technology loving professionals by allowing them to expand their skills and take part in inspiring projects
* ExpleoAcademy - enables you to acquire and develop the right skills by delivering a suite of accredited training courses
* Competitive company benefits
* Always working as one team, our people are not afraid to think big and challenge the status quo
* As a Disability Confident Committed Employer we have committed to:
o Ensure our recruitment process is inclusive and accessible
o Communicating and promoting vacancies
o Offering an interview to disabled people who meet the minimum criteria for the job
o Anticipating and providing reasonable adjustments as required
o Supporting any existing employee who acquires a disability or long term health condition, enabling them to stay in work at least one activity that will make a difference for disabled people
“We are an equal opportunities employer and welcome applications from all suitably qualified persons regardless of their race, sex, disability, religion/belief, sexual orientation or age”.
We treat everyone fairly and equitably across the organisation, including providing any additional support and adjustments needed for everyone to thrive
#LI-DS1
#J-18808-Ljbffr