Are you an experienced Data Developer who enjoys greenfield development and likes technical ownership? As a senior Data Engineer, have you enjoyed working in rapid scale-up environments where you've had direct access to senior leadership, significant influence on technical strategy alongside fostering a culture of best practice and technical innovation within your teams?
Our client, profitable, well-funded and growing at 30% YoY, is looking for a Lead Data Developer to run their Data Engineering team. Having found product / market fit, this hire is now a key inflection point as they embark on a major re-engineering effort to position themselves for scale and to support the large backlog of clients ready to onboard to their platform.
As an established Senior / Lead Data Engineer, you'll have experience of the following:
* At least 10+ years commercial software engineering experience, with a strong focus on data-engineering at scale
* Strong experience building robust & scalable data pipelines using Python and PySpark
* A deep knowledge of Schema Design, SQL and database optimizations
* Experience of being a bar-raiser and helping improve engineering best practices
* Experience of orchestration tools like Databricks or Airflow
* Experience with cloud data warehouses like Snowflake or BigQuery
* Coaching, mentoring and growing an established mid-level team who are eager to learn from you
* Working in a start-up / scale-up environment where you enjoyed having a broad impact, close proximity to leadership and seeing first-hand the impact of your efforts
* Seeing the value being on-site 3 days a week has in building culture, fostering innovation, and supporting effective communication.
Nice to have
* Experience with Kafka or other streaming platforms
* Experience with data quality frameworks like Great Expectations
* Experience with Delta Lake or modern data lake architectures
If you're an experienced Senior / Lead Data Engineer who is excited by greenfield development within a rapid-scale and growing a team around you, we'd love to hear from you.
Strong data engineers are promised a response within 24 hours of application.
The Difference Engine is a recruitment company working on behalf of its client.