Junior Data Engineer
We're looking for a great candidate to join our Platform team to help deliver data engineering and technical pipeline solutions that support our growing 3D design/GIS product portfolio. This will include orchestration of complex pipelines that bridge 3D software products, GIS transformation frameworks and our own data lake infrastructure:
* Working within the Platform Team to architect, build and maintain pipeline/data engineering solutions for geospatial and non-spatial datasets
* Integrate and consume data from WFS/WMS services
* Support the deployment and maintenance of Geoserver instances
* Collaborate with analysts, developers, and stakeholders to define data requirements
* Ensure data integrity, quality, and security across all sources
* Liaise with other team members, including within the Platform team and wider Make/Sell teams in order to determine their requirements and identify further opportunities for automation.
* Supporting product/project management cycles by helping the product team to prioritise requirements.
* Develop novel solutions to match data transformation requirements, following best practices, prioritising maintainability and performance
* Keep software, datasets and systems up to date
* Assist in data and server migrations
* Automation of processes and systems that are not yet properly implemented
* Keeping up-to-date with current and emerging automation technologies and trends
* Manage and optimise PostgreSQL databases for performance and scalability
* Supporting team delivery, including attendance at all relevant team planning sessions, and keeping team members briefed on changes to agreed plans / strategies
* Continually learning and sharing what you've learned to improve code quality
* Identifying, defining and deploying tactics, tools and solutions that achieve business objectives
What you'll need to succeed:
* Experience in building third and first party software pipelines and ETL solutions
* Experience in working across common database implementations and cloud technologies
* Experience of using, managing and maintaining version control solutions
* A good understanding of:
- Integrations with external systems
- Data structures
- Software architecture, design patterns and algorithms
- Agile principles
* Keen interest in applying code best practices and delivering readable code
* An affinity for prioritising complex product requirements and reducing them to manageable tasks
* Be an excellent problem solver and effective communicator, with a positive can-do attitude
* Be self motivated with a passion for continual professional development
* Be personal, adaptable and flexible with the ability to work successfully in a fast-paced changing environment
* Demonstrates both strong teamwork skills and ability to work independently
* Must be available to attend quarterly company meetings held in the office in person
* Be human and ready to have fun
Nice to haves:
* Experience working with game engines such as Unity or Unreal
* Experience working with GIS
* Experience working with 3D modelling software such as Revit, AutoCAD, 3ds Max or Blender
* Experience with AWS data systems such as Lake Formation, RDS, DynamoDB, or ElastiCache
* Experience programming in at least one scripting language
#J-18808-Ljbffr