ROLE SUMMARY
We are currently looking for a talented and experienced Data Engineer with a strong background in Microsoft technologies to join our IT Operations team in Dunfermline. In this key role, you will be responsible for designing, developing, and maintaining scalable data solutions that support our business objectives.
ESSENTIAL DUTIES AND RESPONSIBILITIES
1. Design, develop, and maintain data pipelines and ETL processes using Microsoft technologies (e.g., SQL Server Integration Services, Azure Data Factory).
2. Build and optimise data models and data warehouses on SQL Server and/or Azure Synapse Analytics.
3. Develop and deploy data solutions in Azure, including Azure Data Lake, Azure SQL Database, and related services.
4. Collaborate with data analysts, data scientists, and business stakeholders to understand data requirements and deliver reliable solutions.
5. Ensure data quality, integrity, and security across all data platforms.
6. Write efficient T-SQL queries, stored procedures, and scripts for data extraction, transformation, and loading.
7. Monitor, troubleshoot, and optimize performance of data solutions.
8. Implement data governance and best practices for data management.
9. Stay up to date with emerging Microsoft data technologies and recommend improvements.
MINIMUM QUALIFICATIONS
10. Bachelor’s degree in Computer Science, Information Systems, Engineering, or equivalent professional experience.
11. 2+ years of experience as a Data Engineer, or similar role.
12. Strong experience with Microsoft SQL Server, T-SQL, and SSIS.
13. Hands-on experience with Azure data services (Azure Data Factory, Azure Data Lake, Azure SQL Database, Azure Synapse Analytics).
14. Proficiency in data modelling, data warehousing, and ETL processes.
15. Knowledge of Power BI or other Microsoft BI tools.
16. Familiarity with scripting languages such as Python or PowerShell is desirable.
17. Solid understanding of data governance, security, and compliance.
18. Excellent problem-solving skills and attention to detail.
19. Proven ability to communicate effectively and work well in team environments.
BENEFITS
At Optos, we offer a highly competitive compensation and benefits package.