Senior Data Engineer – Search and AI Platform
About the role:
The Search and AI Platform supports core products such as Scopus, ScienceDirect, and AI‑driven research solutions. As a Senior Data Engineer, you will help design, build, and run reliable data pipelines and services that support large‑scale search and analytics use cases. You will work hands‑on while also supporting and guiding other engineers.
About the team:
The Search and AI Platform is Elsevier's agentic data platform, which powers products such as Scopus, ScienceDirect, and our next-generation LLM-powered research systems. The platform utilises agentic services to interrogate our rich knowledge graphs, search and recommendation systems, and our unparalleled collection of research data, delivering insights to the scientific community that enable them to collaborate more effectively, work smarter, and produce high-quality research more efficiently.
Responsibilities:
Design, build, and maintain scalable data pipelines and services
Develop batch and ELT/ETL data workflows for ingesting and processing large datasets
Work with technologies such as Python, Java, Spark, SQL, and Airflow
Apply good software engineering practices, including testing, documentation, and CI/CD
Contribute to cloud‑based systems (AWS), focusing on reliability, monitoring, and automation
Collaborate with product, platform, and data science partners to deliver meaningful outcomes
Support team learning through code reviews and knowledge sharing
Requirements:
Experience working as a data or software engineer on production systems
Strong skills in Python and experience with at least one backend language (such as Java)
Understanding of data engineering concepts such as data lakes, batch processing, and distributed systems
Experience building or operating data pipelines using tools like Spark and Airflow
Familiarity with cloud platforms (AWS preferred) and production monitoring
Clear communication skills and a collaborative approach to problem‑solving
Why join us?
Join our team and contribute to a culture of innovation, collaboration, and excellence. If you are ready to advance your career and make a significant impact, we encourage you to apply.
Work in a way that works for you
We promote a healthy work/life balance across the organization. We offer an appealing working prospect for our people. With numerous wellbeing initiatives, shared parental leave, study assistance and sabbaticals, we will help you meet your immediate responsibilities and your long-term goals.
Working flexible hours - flexing the times when you work in the day to help you fit everything in and work when you are the most productive.
Working for you
We know that your well-being and happiness are key to a long and successful career. These are some of the benefits we are delighted to offer:
Comprehensive Pension Plan
Home, office, or commuting allowance.
Generous vacation entitlement and option for sabbatical leave
Maternity, Paternity, Adoption and Family Care leave
Flexible working hours
Personal Choice budget
Internal communities and networks
Various employee discounts
Recruitment introduction reward
Employee Assistance Program (global)
About the business
A global leader in information and analytics, we help researchers and healthcare professionals advance science and improve health outcomes for the benefit of society. Building on our publishing heritage, we combine quality information and vast data sets with analytics to support visionary science and research, health education, and interactive learning, as well as exceptional healthcare and clinical practice. At Elsevier, your work contributes to the world's grand challenges and a more sustainable future. We harness innovative technologies to support science and healthcare to partner for a better world.