Location: Edinburgh, Scotland, United Kingdom
Contract: Permanent, Hybrid
Data Engineer
Job Description
As a Data Engineer, you will design, develop, deploy, and maintain data architecture which employs various methods to transform raw data into processed data. You will own the data operations infrastructure, manage and optimise performance, reliability, and scalability of the system to meet growing demands on ingestion and processing pipelines.
Responsibilities
* Orchestrate ingestion and storage of raw data into structured or unstructured solutions.
* Design, develop, deploy, and support data infrastructure, pipelines and architecture.
* Implement reliable, scalable, and tested solutions to automate data ingestion.
* Develop systems to manage batch processing and real-time streaming of data.
* Evaluate business needs and objectives.
* Support implementation of data governance requirements.
* Facilitate pipelines that prepare data for prescriptive and predictive modelling.
* Work with domain teams to scale the processing of data.
* Identify opportunities for data acquisition.
* Combine raw information from different sources.
* Manage and maintain automated tools for data quality and reliability.
* Explore ways to enhance data quality and reliability.
* Collaborate with data scientists, IT and architects on several projects.
Qualifications
* Technical expertise in designing, building, and maintaining data pipelines, data warehouses, and leveraging data services.
* Proficient in DataOps methodologies and tools, including CI/CD pipelines, containerisation, and workflow orchestration.
* Experience with ETL/ELT frameworks, and Big Data Processing Tools (e.g., Spark, Airflow, Hive).
* Knowledge of programming languages (e.g., Java, Python, SQL).
* Hands‑on experience with SQL/NoSQL database design.
* Degree in STEM or similar field; a Master’s is a plus.
* Data engineering certification (e.g., IBM Certified Data Engineer) is a plus.
Security Clearance
This role is subject to pre‑employment screening in line with the UK Government’s Baseline Personnel Security Standard (BPSS). All successful applicants must be eligible for full security clearance and access to UK‑controlled and ITAR‑controlled information. For more information and guidance, please visit https://www.gov.uk/government/publications/united-kingdom-security-vetting-clearance-levels.
Benefits
* Enjoy generous leave with the opportunity to accrue up to 12 additional flexi‑days each year.
* Benefit from our award‑winning pension scheme with up to 15% employer contribution.
* Free access to mental health support, financial advice, and employee‑led networks championing inclusion and diversity.
* All employees at management level and below are eligible for our bonus scheme.
* Free access to 4,000+ online courses via Coursera and LinkedIn Learning.
* Receive a financial reward through our referral programme.
* Spend up to £500 annually on flexible benefits including private healthcare, dental, family cover, tech & lifestyle discounts, gym memberships and more.
* Flexible hours with hybrid working options (part‑time possibilities achievable with discussion).
#J-18808-Ljbffr