About the role:
As a Data Engineer, you will be instrumental in managing our extensive soil carbon dataset and creating robust data systems. You are expected to be involved in the full project lifecycle, from planning and design, through development, and onto maintenance including pipelines and dashboards. You’ll interact with Product Managers, Project Managers, Business Development and Operations teams to understand business demands and translate them into technical solutions. Your goal is to provide an organisation wide source of truth for various downstream activities while also work towards improving and modernising our
current platform.
Key responsibilities:
* Design, develop, and maintain scalable data pipelines to process soil carbon
and agricultural data
* Create and optimise database schemas and queries
* Implement data quality controls and validation processes
* Adapt existing data flows and schemas to new products and services under
development
Required qualifications:
* BS/B. Tech in Computer Science or equivalent practical experience, with 5-7
years as Data Engineer or similar role.
* Strong SQL skills and experience optimizing complex queries
* Proficiency with relational databases, preferably MySQL
* Experience building data pipelines, transformations, and dashboards
* Ability to troubleshoot and fix performance and data issues across the
database
* Experience with AWS services (especially Glue, S3, RDS)
* Exposure to big data eco-system – Snowflake/Redshift/Tableau/Looker
* Python programming skills
* Excellent written and verbal communication skills in English
An ideal candidate would also have:
* High degree of attention to detail to uncover data discrepancies and fix them
* Familiarity with geospatial data
* Experience with scientific or environmental datasets
* Some understanding of agritech or environmental sustainability sectors
#J-18808-Ljbffr