DevOps Data Engineer - HIRING ASAP
Start date: ASAP
Duration: 3 months initially with a view to extend
Location: 1 day per week in Birmingham & 4 days per week remote working.
Rate: £375 - £393 per day inside ir35
Key Skills
* Strong DevOps engineering background with experience in CI/CD pipelines
* Git / GitHub
* Jenkins
* SonarQube
* Linux, e.g., Red Hat
* Groovy / Bash / Python scripting
* Good understanding of Python libraries and application development
o Dependency and package management, e.g., Poetry, pip
o Pandas and NumPy
o API development, e.g., Flask, Dash
o IDE tools (PyCharm, VSCode) and remote development
* Solid understanding of Data Engineering concepts
o ETL / ELT pipelines
o Apache Spark
o Apache Airflow
o SQL / NoSQL databases
o Delta Lake, Parquet, Avro formats
o Partitioning strategies
o Starburst, S3 buckets, Postgres
o MLFlow for machine learning lifecycle management
* Experience with Cloud platforms and Containerization
o GCP / Internal cloud environments
o Docker / Kubernetes
o Argo CD
o Monitoring tools, e.g., ELK Stack
o Service Mesh, e.g., Istio
o Secrets management, e.g., Vault
* Good understanding of networking, security, and operating systems
o TCP/IP, DNS, SSH, SSL/TLS
o Encryption, tokenization
o CPU and memory management
* Support experience with Big Data infrastructure
o Hadoop and Spark clusters
o JDK/JVM, Cloudera
* Strong problem-solving and troubleshooting skills
* Ability to take ownership and work independently
* Ability to work under pressure in a fast-paced environment
* Good documentation and knowledge sharing skills
* Effective communication with multi-region/multi-cultural teams
#J-18808-Ljbffr