Role Description
We are seeking a skilled and experienced Senior Data Engineer with a strong focus on Databricks to join our team. The ideal candidate will have expertise in Python/Pyspark, CI/CD pipelines, and hands‑on experience with Databricks to design, implement, and optimise scalable data solutions.
This role will be based in our Guildford office with office attendance expected fortnightly on a Wednesday.
Salary Information
Pay: Circa £74,000 per year. Pay is based on relevant experience, skills for the role, and location. Salary is only one part of our total reward package.
About You
* Lead solution design activities, collaborating with peers and mentoring junior colleagues to define and execute the team backlog.
* Develop, implement, test and document scalable ETL (Extract, Transform, Load) data pipelines and workflows using Databricks / Synapse to efficiently ingest and transform data from various sources.
* Work collaboratively with testers to ensure automated test plans are in place and agree on test packs for UAT.
* Ensure solution designs align with the Allianz Data Technology Strategy, maintaining and enhancing Allianz standards and Service Excellence.
* Implement robust data security measures and ensure compliance with data privacy regulations.
* Peer‑review the work of colleagues and take accountability for the quality of deliverables within the squad.
* Identify and address performance bottlenecks and data quality issues to ensure data accuracy and reliability.
* Collaborate with stakeholders and analysts to understand data requirements and deliver clean, reliable, and accessible data.
* Stay up to date with industry trends and best practices in data engineering, driving continuous improvement and innovation.
Essential Skills
* Databricks expertise: Proven hands‑on experience with Databricks, including building and optimising data pipelines, managing Delta Lake, and leveraging Databricks features for scalable data solutions.
* Python proficiency: Strong programming skills in Python / Pyspark for data engineering tasks, including data processing, automation and scripting.
* CI/CD knowledge: Experience designing and implementing CI/CD pipelines for data engineering using tools such as Azure DevOps, GitHub Actions or similar platforms.
* Cloud‑native data engineering: Experience with data modelling and ETL/ELT frameworks in a cloud‑native environment, particularly on Azure.
* Big data file formats: Hands‑on experience with big data file formats such as Parquet and Delta Lake.
Desirable Skills
* Responsible Artificial Intelligence usage.
* Familiarity with event‑driven architectures (e.g., Kafka).
* Knowledge of AI tools and their application in data engineering.
* Knowledge of the UK Insurance Market.
* Strong analytical and data interpretation skills, with the ability to communicate findings effectively to both technical and non‑technical audiences.
* Excellent problem‑solving skills and attention to detail, with a focus on delivering high‑quality solutions.
What We Will Offer You
Recognised and rewarded for a job well done, we have a range of flexible benefits for you to choose from – so you can pick a package that’s perfect for you. We also offer flexible working options, global career opportunities across the wider Allianz Group, and fantastic career development and training. That’s on top of enjoying all the benefits you’d expect from the world’s number one insurance brand, including:
* Flexible buy/sell holiday options
* Hybrid working
* Annual performance‑related bonus
* Contributory pension scheme
* Development days
* A discount up to 50% on a range of insurance products including car, home and pet
* Retail discounts
* Volunteering days
Our Ways of Working
Do you need flexibility with the hours you work? Let us know as part of your application and if it’s right for our customers, our business and for you, then we’ll do everything we can to make it happen. Here at Allianz, we are signatories of the ABIs flexible working charter. We believe in supporting hybrid work patterns, which balance the needs of our customers with your personal circumstances and our business requirements. Our aim with this is to help innovation, creativity, and you to thrive – your work‑life balance is important to us.
Integrity, Fairness, Inclusion & Trust
At Allianz, we believe in fostering an inclusive workforce and are proud to be an equal‑opportunity employer. Our commitment to equal opportunities, gender equity and balanced gender representation is demonstrated by our numerous accreditations: EDGE certified for gender inclusion, Women in Finance Charter members, Disability Confident employer, Stonewall Diversity Champion, Business in the Community’s Race at Work Charter signatories, and Armed Forces Covenant gold standard employer. We embrace neurodiversity and welcome applications from neuro‑divergent and disabled candidates, offering tailored adjustments to ensure your success. We encourage our employees to advocate for their needs, whether it’s assistive technology, ergonomic equipment, mentoring, coaching or flexible work arrangements.
Accessible Application for All
As part of the Disability Confident Scheme, we support candidates with disabilities or long‑term health conditions through the Offer an Interview Scheme, for those meeting the essential skills for the role. Contact our Resourcing team to opt into this scheme or for assistance with your application, including larger text, hard copies, or spoken applications.
Contact & Closing
Reserve the job until the closing date: 11/6/2026. We reserve the right to close the advert early if we reach enough applications.
#J-18808-Ljbffr