Are you passionate about leveraging cutting-edge data technologies to drive business success? Do you thrive in dynamic environments where innovation and collaboration are valued? If so, we have an exciting opportunity for you!
Position: Lead Data Engineer
Responsibilities:
* Lead Data Management and Architecture: Spearhead the design and implementation of robust data solutions across the organization, ensuring scalability and efficiency.
* Next Gen Data Platform Leadership: Act as the primary data engineer supporting the development of our next-generation data platform, collaborating closely with third-party vendors to build a highly scalable and robust data hub.
* Develop and Optimize Data Pipelines: Design, construct, install, test, and maintain highly scalable data management systems, ensuring they meet business requirements and industry best practices.
* Data Integration and Storage Solutions: Implement data storage solutions and manage large-scale processing systems, overseeing the integration of new technologies into existing structures.
* Collaborate on Infrastructure Projects: Work closely with the infrastructure team to integrate advanced cloud solutions and ensure successful deployment of data services.
* Enhance Data Security and Compliance: Identify vulnerabilities, enhance security protocols, and ensure compliance with regulatory standards through regular audits.
* Technical Leadership and Support: Provide guidance and leadership to technical teams, developing comprehensive documentation and training materials for knowledge sharing.
* Stakeholder Engagement: Manage relationships with internal stakeholders and external vendors to design and deliver effective data solutions.
* Continuous Improvement: Proactively seek to improve processes for data intake, validation, mining, and engineering, implementing innovations to enhance data reliability, efficiency, and quality.
* Problem Resolution: Tackle significant technical issues, ensuring minimal disruption to operations and maintaining service continuity.
Skills and Experience:
* Proficiency in Microsoft Azure Data Services, including Azure SQL Database, Azure Data Factory, Azure Data Lake Storage, and Azure HDInsight.
* Advanced skills in SQL programming, with the ability to design, optimize, and maintain complex queries and databases.
* Strong experience in designing, implementing, and managing ETL processes using Azure Data Factory and other relevant tools.
* Proficiency in building and managing data warehouses using Azure Synapse Analytics and other data warehousing solutions.
* Ability to create effective data models supporting business processes, including knowledge of dimensional modeling and normalization.
* Familiarity with big data technologies on Azure, such as Azure Databricks and Azure Stream Analytics.
* Knowledge of data security practices, cloud architecture principles, scripting languages for automation, data visualization tools, DevOps practices, machine learning frameworks, performance tuning, and data governance tools.
* Technical proficiency in Microsoft Azure SQL (PaaS & IaaS), CosmosDB, Snowflake Data Warehouse, Power Apps, Reporting Services, Tableau, T-SQL, Python Programming, and Azure Purview.
If you're ready to join a dynamic team and drive innovation in data engineering, apply now! We offer competitive compensation and benefits packages, along with opportunities for professional growth and development.