Role: Sr. Cloud Data Architect
Location: UK
6 months+
Hands on Experience on design & architecture of the Data Platform, Technical components and Data Engg. related activities for supporting the key capabilities
o Technical Data Architecture
o Data Ingestion framework (Batch/ Micro Batch processing)
o Data Contract & Data management (including DQ, metadata & lineage)
o Delivery, Scaling & Op Model
· Discovery/ assessment along with the Data platform requirements
o Identify and document the relevant data sources to be used for collection & ingestion, cataloging, defining Data management. This includes assessing data quality, accessibility, data contract and lineage including any other potential capability evaluation
o Analyze existing Data pipeline and data workflows to determine the integration points and any design considerations/ framework and patterns for the data factory as per the need for TSA and Non-TSA batch business/ technical requirements for both batch and micro-batch processing.
· Define the E2E Data architecture framework
· Define Solution patterns for Data collection & ingestion, Data transformation and curation and
Data consumption layer using native GCP data services, e.g Cloud Datafusion, Dataproc, Dataflow, Dataplex, Data streams and BQ
· Define the Solution design to support Self-service ingestion capability of the CSV files for the business users including any ad hoc demand for Data Processing.
· Support the Automation Code samples and examples produced during MVP phase to address Data pipeline build including Data Platform capabilities