Job Title: Platform Engineer AWS, Databricks, Unity Catalog and Palantir Foundry
Job Type: Contract Inside IR35
Location: Leeds - Hybrid
Duration: 6 Months
Job Description Platform Engineer AWS, Databricks, Unity Catalog and Palantir Foundry SC Eligible | Foundry experience: Required | Core skills: Foundry, Databricks Connector, AWS, Unity Catalog, Terraform
Role Overview
Configure and support secure integration between Palantir Foundry, Databricks on AWS and AWS-hosted data sources. The role covers data held in S3, registered through Databricks Hive Metastore, governed or exposed through Unity Catalog, and consumed by Foundry using the Databricks connector or approved ingestion patterns.
Key Responsibilities
Configure and support Palantir Foundry integration with Databricks on AWS. Set up and validate the Foundry Databricks connector for approved SQL Warehouses, tables, views and Unity Catalog-governed objects. Support end-to-end access from AWS S3 sources through Hive Metastore and Unity Catalog into Foundry datasets or products. Configure Foundry Data Connection, datasets, syncs, projects, permissions and lineage as required. Work with AWS teams to define IAM roles, S3 bucket policies, KMS permissions and approved cross-account access patterns. Troubleshoot Foundry connector failures, Databricks authentication issues, Unity Catalog grants,...