Job Description
Our client, a leading global IT service provider,is recruiting for a Data Engineering Consultant- AbInitio and MS Azure to join their business in the UK.
Qualifications:
1. Should have Telecom Domain and Smart Metering expert
2. Accountable for Designing and Developing Cloud Solution for Smart
3. Metering – Strategic Data Reporting which provides the Network
4. Performance Measure reports of service provider's network to Data and
5. Communication Company (DCC) and Smart Metering service users (Energy Suppliers).
6. Understanding and knowledge of Reporting Data Store (RDS) which is required to support the reporting of Data and Communication Company (DCC)
7. Should be able to work in the SCRUM team which delivers the ETL, Report and Dashboard solution using MS Azure
8. Closely work with Product owner, Business Analyst to create user stories required for the sprint.
9. Create design data flows/pseudo code to enable developers to develop Azure ETL/Power BI Reports based on that
10. Provide required design input and artifacts to the Data Engineers and Data Scientist
11. Responsible for the data model and defining Raw, Bronze, Silver and Gold storage layers
12. Developing code using Azure functions, Spark and SQL Stored procedures in Azure SQL Pool
13. Doing code review of ETL code developed using Azure Function
14. Capacity planning to understand how and when to scale up and scale down
15. Developing complex Abinitio graphs for the Smart Metering Reporting
16. Performance tuning of poorly performing Ab Initio graphs/graphs handling huge volume of data
17. Doing high level/low level impact assessment for new change requests
18. Designing/Developing ETL solution considering recovery, stability, reliability, scalability and performance
19. Translating the reporting requirements to Detailed Design
20. Creating Source to Target mapping for various source feeds to target Dimensional Model
21. Producing document/prototype graphs with complex file transformations and handing over to developers to complete development
22. Conducting Design Walkthrough meetings/ Requirement Clarification meetings with all the stakeholders
23. Providing inputs such as capacity requirement, GDPR compliance related information required for networking, IT Platform, DBA and security teams
24. Coordinating regularly with offshore teams and ensuring they make progress on the tasks given to them
25. Doing Ab Initio code review to check if the code follows best practices and meets required standards and provides performance improvement suggestions.
26. Expertise in ETL tool Ab initio
27. Should be Expert in MS Azure
28. o Azure Analytics
29. o Azure Function
30. o Power BI
31. Data Factory
32. Data Brick
33. Expertise in Business intelligence
34. Knowledge of Shop For Data
35. Knowledge of Data Profiler 3.1.4
36. Knowledge of XML Manipulation
37. Software development
38. Analysis and design
39. Unix/Linux/Windows
40. Team Leading capabilities
41. Fluent English language required