You will be responsible for:
* Joining each and every one of your colleagues in creating an inclusive workspace;
* Owning, maintaining, and supporting the reliability, architecture, and evolution of our production machine learning and delivery platform;
* Designing, operating, and improving large scale Databricks/Spark pipelines and workflows
* Partner with our data scientists to productionize new data and ML-powered products;
* Leading improvements on the software integration layers between data pipelines and product workflows;
* Growing the team via mentorship and leadership, reviewing technical documents, improving code quality, and improving team performance and processes;
* Acting as a senior technical owner in debugging complex production issues and improving system observability;
* Collaborating with cross-functional teams to support their data infrastructure needs.
Must-have qualifications:
* Extensive hands-on software engineering experience, with a strong track record of delivering production data pipelines or platforms in a mission critical environment
* Strong experience with Python in production systems
* Experience integrating ML models into reliable production data pipelines, including batch inference and model serving patterns
* Experience building and operating Databricks (or Spark) based pipelines
* Experience with SQL
* Experience with at least one major cloud infrastructure provider (GCP, AWS, Azure)
* Experience with supporting business-critical systems with on-call ownership
* Passion, energy, and excitement for progressive and philanthropic causes and all things digital.
Nice-to-have qualifications:
* 5+ years of professional experience;
* Experience building data-intensive applications and warehouses with Databricks;
* Experience with integrating production level applications with AWS;
* Experience supporting ML training or inference pipelines;
* Experience working with cross-functional teams in a dynamic environment.
#J-18808-Ljbffr