We are looking for a strong Data Engineer who can work with a large amount of data and can prepare it for the ML pipelines, provide data analysis and visualization, and continuously do storage optimization tasks.
Experience with a different type of SQL databases(MySQL/PostgreSQL/MSSQL), knowledge of JOINS, inner selects and index specification/creation to speed up requests.
Tasks
* Design, develop, and maintain robust ETL processes to effectively extract, transform, and load data from various sources into the data warehouse.
* Collaborate with data analysts and data scientists to understand business requirements and deliver optimized data solutions to support data-driven decision-making.
* Ensure the integrity and accuracy of data by performing regular data validation and troubleshooting any data-related issues that arise.
* Optimize SQL queries and database performance to handle large volumes of data efficiently and improve system responsiveness.
* Develop and maintain detailed documentation of ETL processes, data models, and data architecture to ensure clarity and continuity within the team.
Requirements
Proficiency in SQL with the ability to write efficient, optimized queries for complex datasets.
Strong analytical skills with experience working with large-scale data environments (e.g., data warehouses, relational databases).
Programming experience in Python, R, or another data-focused language.
Familiarity with ETL tools and frameworks (e.g., Airflow, dbt, Apache NiFi).
Experience with BI platforms such as Tableau, Power BI, Looker, or similar.
Solid understanding of data modeling, data warehousing concepts, and database design.
Experience working with cloud-based data platforms (e.g., AWS Redshift, Google BigQuery, Snowflake).
Strong problem-solving abilities and attention to detail.
Excellent communication skills with the ability to translate technical findings into business insights.
Bachelor's degree in Computer Science, Data Science, Statistics, Engineering, or a related field (or equivalent work experience).
#J-18808-Ljbffr