Overview
Job Description:
Primary skills - Databricks Admin with GCP / AWS, Databricks, KAFKA Data Architect
Responsibilities
* Design, implement, and maintain the Databricks platform, and provide operational support. Operational support includes platform setup and configuration, workspace administration, resource monitoring, and providing technical support to data engineering, data science/ML, and application/integration teams.
* Perform restores/recoveries, troubleshoot service issues, determine root causes, and resolve issues.
* Manage security and changes.
* Collaborate closely with the Team Lead, other Databricks Administrators, System Administrators, and Data Engineers/Scientists/Architects/Modelers/Analysts.
* Administer, configure, and optimize the Databricks platform to enable data analytics, machine learning, and data engineering activities within the organization.
* Collaborate with the data engineering team to ingest, transform, and orchestrate data.
* Manage privileges at the Databricks account level, workspace level, Unity Catalog level, and SQL warehouse level.
* Create workspaces, configure cloud resources, view usage data, and manage account identities, settings, and subscriptions.
* Install, configure, and maintain Databricks clusters and workspaces.
* Maintain the platform with security, compliance, and patching best practices.
* Monitor and manage cluster performance, resource utilization, platform costs, and troubleshoot issues to ensure optimal performance.
* Implement and manage access controls and security policies to protect sensitive data.
* Manage schema data with Unity Catalog – create, configure, catalog, external storage, and access permissions.
* Administer interfaces with Google Cloud Platform.
Required Skills
* 3+ years of production support of the Databricks platform
Preferred
* 2+ years of experience with AWS/Azure/GCP PaaS admin
* 2+ years of experience in automation frameworks such as Terraform
Seniority level
* Mid-Senior level
Employment type
* Contract
Job function
* Information Technology
Industries
* IT Services and IT Consulting
Leeds, England, United Kingdom
#J-18808-Ljbffr