We are seeking a highly skilled Chief Data Platform Engineer to join our Data Platform team and play a critical role in building and maintaining our data infrastructure.
The ideal candidate will have experience designing and implementing complex data solutions, be an expert in data modeling and have a deep understanding of database technologies.
This is a hands-on position where you will be working with cross-functional teams to develop and deliver data-driven solutions that support business objectives.
About the role
We are seeking a highly skilled Senior Data Engineer to join our team and play a critical role in building and maintaining our data infrastructure. The ideal candidate will have experience designing and implementing complex data solutions, be an expert in data modeling and have a deep understanding of database technologies. This is a hands-on position where you will be working with cross-functional teams to develop and deliver data-driven solutions that support business objectives.
What you’ll do
1. Collaborate with data scientists, analysts and other teams to understand data needs and provide solutions that support business objectives
2. Identify and analyze source data to understand structure, content and interrelationships.
3. Implement data ingestion pipelines from various sources, such as API calls, databases, and flat files
4. Design and develop data architecture and models to ensure data consistency, accuracy and integrity
5. Develop and optimize data pipelines and data sets into an analysis-ready format to ensure efficient data retrieval and processing
6. Attain and sustain high data quality through comprehensive data validation
7. Implement data security and privacy controls to protect sensitive information
8. Monitor performance and tune the data infrastructure to ensure optimal performance
9. Stay up-to-date with the latest data engineering and data warehousing technologies and apply them to enhance the data infrastructure
10. Mentor and lead junior team members and provide technical guidance as needed
What you’ll bring
11. You have advanced SQL skills and hands-on experience with SQL databases
12. Strong knowledge of data warehousing concepts and dimensional modeling
13. You have transformed complex business logic into ETL processes with SQL and Python.
14. You have conducted comprehensive data testing to achieve high data quality and reliability.
15. You have the ability to ask and answer meaningful questions by collecting, analyzing and making sense of data in a given business context.
16. You have excellent analytical and problem-solving skills.
You'll have hands on experience with
17. Database and API-based ingestion tools such as HVR and FiveTran
18. Cloud computing-based data warehouse solutions, preferably Snowflake
19. Big data technologies, such as Apache Hive and Apache Spark
20. Data transformation tools such as dbt
21. CI/CD pipelines and GIT, preferably in Azure DevOps
22. Data Vault data architecture and transformation tools is a plus