1. Design and automate the deployment of Cloudera CDP components (Data Lake, Data Hubs, Data Services) using Terraform.
2. Build and maintain CI/CD pipelines using GitHub Actions for infrastructure and data pipeline automation
3. Collaborate with data engineering teams to integrate CDP with existing Big Data workflows.
4. Write and maintain automation scripts using Shell and Python.
5. Manage infrastructure and configuration using YAML and JSON.
6. Configuring and tuning Cloudera services for performance and security.
7. Ensure secure, scalable, and cost-effective deployments on cloud platforms (AWS, Azure, or GCP).
8. An understanding of all the Hadoop daemons along with their roles and responsibilities in the cluster.
9. Should be able to troubleshoot issues in Cloudera services and fix those.
10. Adding and removing nodes in the cluster.
11. Rebalancing nodes in the cluster.
12. Employ security using an authentication and authorization system such as Kerberos.
13. Knowledge of changes required for migrating to Cloudera cloud version CDP
14. Knowledge of Cloudera data services (CDW, CDE, CDF, CAI)
15. Design Native Cloud Application Architectures and optimize applications for AWS
16. Network connectivity, Direct Connect, VPN, VPC, Security gro...