Location : Milton Keynes. 100 % onsite
Telecom domain - must have
Inside IR35 contract
Job Description:
Perform end-to-end testing of data ingestion, parsing, aggregation, and schema validation processes in AWS.
Conduct stress testing to evaluate the performance of the entire data pipeline built on AWS.
Develop and execute test plans, test cases, and test scripts to ensure data quality and integrity.
Collaborate with data engineers and developers to identify and resolve data quality issues.
Monitor data quality metrics and implement improvements to enhance data reliability.
Validate data transformations and ensure consistency across various data sources.
Document test results and provide detailed reports on data quality findings.
Required Skills and Experience:
Proven experience with AWS services such as EMR, Lambda, Redshift, Firehose, S3, Iceberg, Athena, and DynamoDB.
Strong understanding of data ingestion, parsing, aggregation, and schema validation processes.
Proficiency in SQL for data querying and validation.
Experience with Python for scripting and automation.
Familiarity with data quality tools and frameworks.
Excellent analytical and problem-solving skills.
Strong attention to detail and commitment to da...