Social network you want to login/join with:
We are seeking a skilled and detail-oriented Data Engineer to design, develop, and maintain scalable data pipelines and architectures. The ideal candidate will be responsible for ensuring efficient data flow, storage, and transformation processes to support business analytics and decision-making. This role requires strong technical expertise in data integration, database management, and cloud-based data solutions.
Key Responsibilities:
Design, build, and maintain reliable, scalable, and secure data pipelines.
Develop ETL/ELT processes for data ingestion, transformation, and integration from multiple sources.
Collaborate with data scientists, analysts, and business teams to ensure data availability and quality.
Implement best practices for data governance, security, and compliance.
Optimize database queries and ensure efficient data storage solutions.
Monitor and troubleshoot data pipelines to ensure high availability and performance.
Work with big data tools and cloud-based platforms to handle large-scale datasets.
Prepare and maintain documentation of data architecture, flows, and processes.
Essential Qualifications:
Bachelor’s degree in Computer Science, Information Technology, Data Engineering, or a related field.
Proven experience as a Data Engineer, Data Integration Specialist, or in a similar role.
Strong understanding of database systems (SQL, NoSQL).
Hands-on experience with ETL tools and data pipeline frameworks.
Experience working with cloud platforms such as AWS, Azure, or Google Cloud.
Skills Required:
Proficiency in SQL and data modelling techniques.
Programming experience with Python, Java, or Scala.
Familiarity with big data technologies (Shadoof, Spark, Kafka).
Knowledge of APIs, data streaming, and real-time data processing.
Strong problem-solving skills and attention to detail.
Good understanding of data governance, privacy, and security standards.
Ability to work collaboratively in cross-functional teams.
#J-18808-Ljbffr