Job Description
Data DevOps Engineer
Are you passionate about building scalable, reliable data infrastructure in the cloud? Join our innovative team as a Data DevOps Engineer and play a pivotal role in transforming how data powers decision-making and operational excellence. This is your chance to work at the forefront of cloud-native data architecture, ensuring seamless deployment, management, and optimization of large-scale analytics solutions that drive impactful insights and business growth.
Compensation: £85,000 p/a
Work Model: 3 days on site per week in Watford
What You'll Do:
* Design, implement, and maintain AWS-based data infrastructure leveraging Redshift, S3, EMR, and other cloud services.
* Develop and oversee CI/CD pipelines for ETL processes and Power BI deployments, ensuring rapid, error-free code releases.
* Automate environment provisioning and data workflows using Terraform, Docker, Kubernetes, Python, and other automation tools.
* Manage data provisioning workflows, environment freshness, and synchronization across development, testing, and production stages.
* Optimize data pipelines for performance, resource utilization, and cost efficiency while ensuring high reliability and scalability.
* Establish observability frameworks with CloudWatch, Grafana, or Datadog for proactive monitoring and troubleshooting.
* Collaborate with cross-functional teams to enhance deployment strategies, resolve technical issues, and implement best practices in security, compliance, and governance.
* Continuously explore innovative cloud services and tools to improve deployment speed, operational efficiency, and developer experience.
Required Skills:
* Extensive experience with AWS cloud services (Redshift, S3, Lambda, EMR, CloudFormation/Terraform).
* Proficiency in CI/CD tools such as Jenkins, GitHub Actions, or similar.
* Strong scripting skills in Python for automation, logging, and observability integrations.
* Expertise in SQL, especially Redshift, and in managing large-scale data processing frameworks like Spark and EMR.
* Hands-on experience with containerization (Docker, Kubernetes).
* Professional certifications such as AWS Certified Solutions Architect and AWS Certified DevOps Engineer are highly desirable.
* Deep understanding of environment management, code promotion, deployment pipelines, and release management.
* Familiarity with Jira integrations and data provisioning automation.
Nice to Have Skills:
* Experience with Power BI, DAX, and data modeling for optimized reporting.
* Knowledge of big data orchestration tools like Apache Airflow.
* Previous exposure to regulated environments such as finance, healthcare, or gaming.
* Experience in a lottery or similar domain is a plus.
Preferred Education & Experience:
* Bachelor’s or Master’s degree in Computer Science, Data Analytics, or related field.
* Several years of professional experience in cloud data engineering, DevOps, or related roles.
Other Requirements:
* Ability to work within an agile team, managing multiple deliverables simultaneously.
* Strong troubleshooting skills and the ability to diagnose complex cloud-based issues.
* Commitment to security, compliance, and best practices in data governance.
Take the next step in your career—apply now and be part of a transformative journey to create a more innovative, reliable, and impactful data environment that makes a real difference!