The Senior Software Engineer designs and builds highly scalable systems that compute complex research metrics using distributed processing, search indexing, and graph-based data structures. This role focuses on implementing large-scale metric computation pipelines using Scala/Spark and developing Java-based backend services that expose these metrics. The engineer contributes to architecture decisions, collaborates with stakeholders to refine metric definitions into technical implementations, and mentors junior engineers across the big data and backend domains.
Responsibilities
* Implementing distributed metric computation pipelines using Scala + Spark/Databricks running on AWS EMR or related environments.
* Use Elasticsearch and Neo4j specifically for metric computation, including search-driven aggregations and graph algorithms. Develop Java-based backend services and APIs that expose metric results, orchestrate computation, or support downstream applications.
* Collaborating with architects, product managers, and data SMEs to refine metric definitions and ensure technical feasibility and performance.
* Writing and reviewing detailed design specifications for complex system components across Spark pipelines and backend services.
* Performing advanced debugging and optimization across Spark jobs, graph queries, search indexes, and AWS resources.
* Driving and maintaining high engineering standards through code reviews, testing, automation, and observability practices.
* Mentoring and guiding junior team members on distributed data systems, Spark optimization, Java backend fundamentals, and search/graph usage.
* Stay current with big data, graph, and search trends; propose improvements in architecture, performance, and tooling.
* Participating in Agile development workflows and collaborating effectively with distributed teams.
Qualifications
* The candidate should demonstrate strong expertise in big data and distributed systems, with hands‑on experience building and optimizing large-scale metric computation pipelines using Scala and Apache Spark.
* They should be proficient in Elasticsearch for high-volume search, aggregation, and analytical workloads, and have practical experience with graph databases such as Neo4j for graph modelling and graph-based metric computation.
* The candidate should also bring solid Java backend engineering skills, including the design and development of RESTful APIs and microservices that orchestrate data and computation workflows.
* Experience with AWS (S3, EMR, RDS), strong data modelling skills, and the ability to translate complex metric definitions into scalable, production‑ready solutions are essential.
About the Team
The SciVal Development Team is a cross‑functional group made up of Frontend, Backend, and Quality Engineers working closely together. The team collaborates closely with UX and Product to design, build, and deliver high‑quality features efficiently and reliably.
A global leader in information and analytics, we help researchers and healthcare professionals advance science and improve health outcomes for the benefit of society. Building on our publishing heritage, we combine quality information and vast data sets with analytics to support visionary science and research, health education and interactive learning, as well as exceptional healthcare and clinical practice. At Elsevier, your work contributes to the world’s grand challenges and a more sustainable future. We harness innovative technologies to support science and healthcare to partner for a better world.
Join our team and contribute to a culture of innovation, collaboration, and excellence. If you are ready to advance your career and make a significant impact, we encourage you to apply.
Benefits
Work in a way that works for you. We promote a healthy work/life balance across the organization. We offer an appealing working prospect for our people. With numerous wellbeing initiatives, shared parental leave, study assistance, and sabbaticals, we will help you meet your immediate responsibilities and your long‑term goals.
* Working flexible hours - flexing the times when you work in the day to help you fit everything in and work when you are the most productive.
* Comprehensive Pension Plan
* Home, office, or commuting allowance.
* Generous vacation entitlement and option for sabbatical leave
* Maternity, Paternity, Adoption, and Family Care leave
* Flexible working hours
* Personal Choice budget
* Internal communities and networks
* Various employee discounts
* Recruitment introduction reward
* Employee Assistance Program (global)
#J-18808-Ljbffr