DXC Technology is committed to building diverse, inclusive teams. We welcome applications from all backgrounds and particularly encourage interest from women, underrepresented groups, and neurodivergent candidates. We offer reasonable adjustments throughout the hiring process and are dedicated to creating a supportive, accessible environment for everyone.
Databricks Engineer
Location – Erskine, Newcastle, Farnborough or London.
Candidates are required to be eligible for clearance.
We’re on a mission to harness the power of data to drive innovation and deliver transformative solutions. We’re looking for a talented Data Engineer with deep expertise in Databricks to join our growing team and help shape the future of our data projects. This is a fantastic opportunity to work on cutting‑edge AI and data engineering projects using the latest tools and technologies in a collaborative and innovative environment.
Key Responsibilities
* Build and maintain scalable data pipelines using Databricks.
* Manage and optimize Databricks Workspace, Clusters, Jobs, Repos, and Delta Live Tables.
* Develop modular ETL workflows using dbt and orchestrate them with Apache Airflow.
* Write advanced PySpark code, including UDFs and Pandas UDFs, for efficient data processing.
* Ensure data quality, reliability, and performance across all systems.
* Collaborate with data scientists, analysts, and engineers to deliver data solutions that support business goals.
* Contribute to the mentoring and development of junior team members.
* Support senior team members in identifying and addressing data science opportunities.
Required Skills & Experience
* Proven experience with Databricks and its ecosystem.
* Strong proficiency in PySpark, especially with UDFs and Pandas UDFs.
* Hands‑on experience with dbt and Airflow.
* Databricks Certified Data Engineer Associate certification or willingness to achieve one.
* Excellent problem‑solving skills and a passion for data and AI.
* Bachelor’s degree in a relevant field or equivalent combination of education and experience.
* Relevant work experience in industry within a similar role.
* Proficiencies in data cleansing, exploratory data analysis, and data visualisation.
* Continuous learner that stays abreast with industry knowledge and technology.
Why Join Us?
* Work with a forward‑thinking team on impactful AI projects.
* Access to continuous learning and development opportunities.
* Flexible working arrangements.
* Inclusive and supportive company culture.
#J-18808-Ljbffr