Senior Data Engineer (AWS)
Wroclaw Metropolitan Area, Wrocław, Dolnośląskie
About project
Provectus helps companies adopt ML/AI to transform the ways they operate, compete, and drive value. The focus of the company is on building ML Infrastructure to drive end-to-end AI transformations, assisting businesses in adopting the right AI use cases, and scaling their AI initiatives organization-wide in such industries as Healthcare & Life Sciences, Retail & CPG, Media & Entertainment, Manufacturing, and Internet businesses.We are seeking a talented and experienced Data Engineer to join our team at Provectus. As part of our diverse practices, including Data, Machine Learning, DevOps, Application Development, and QA, you will collaborate with a multidisciplinary team of data engineers, machine learning engineers, and application developers. You will encounter numerous technical challenges and will have the opportunity to contribute to the internal solutions, engage in R&D activities, providing an excellent environment for professional growth.
Requirements:
1. 5+ years of experience in data engineering;
2. Experience in AWS;
3. Experience handling real-time and batch data flow and data warehousing with tools and technologies like Airflow, Dagster, Kafka, Apache Druid, Spark, dbt, etc.;
4. Proficiency in programming languages relevant to data engineering, such as Python and SQL;
5. Proficiency with Infrastructure as Code (IaC) technologies like Terraform or AWS CloudFormation;
6. Experience in building scalable APIs;
7. Familiarity with Data Governance aspects like Quality, Discovery, Lineage, Security, Business Glossary, Modeling, Master Data, and Cost Optimization;
8. Upper-Intermediate or higher English skills;
9. Ability to take ownership, solve problems proactively, and collaborate effectively in dynamic settings.
Nice to Have:
10. Experience with Cloud Data Platforms (e.g., Snowflake, Databricks);
11. Experience in building Generative AI Applications (e.g., chatbots, RAG systems);
12. Relevant AWS, GCP, Azure, Databricks certifications;
13. Knowledge of BI Tools (Power BI, QuickSight, Looker, Tableau, etc.);
14. Experience in building Data Solutions in a Data Mesh architecture.
Responsibilities:
15. Collaborate closely with clients to deeply understand their existing IT environments, applications, business requirements, and digital transformation goals;
16. Collect and manage large volumes of varied data sets;
17. Work directly with ML Engineers to create robust and resilient data pipelines that feed Data Products;
18. Define data models that integrate disparate data across the organization;
19. Design, implement, and maintain ETL/ELT data pipelines;
20. Perform data transformations using tools such as Spark, Trino, and AWS Athena to handle large volumes of data efficiently;
21. Develop, continuously test, and deploy Data API Products with Python and frameworks like Flask or FastAPI.
What you'll get:
22. Long-term B2B collaboration;
23. Hybrid setup with access to our Wroclaw office;
24. Paid vacations and sick leaves;
25. Public holidays;
26. Medical insurance or sports coverage;
27. External and Internal educational opportunities and AWS certifications;
28. A collaborative local team and international project exposure.