Fimador is currently recruiting for a Principal Data Engineer to join a team developing cutting-edge data-driven products. This role is helping the firm pioneer AI and ML in the global environment. This role is central to designing and maintaining scalable pipelines, data platforms, and integrations, while ensuring solutions meet regulatory standards and align with architectural best practices.
Key Responsibilities:
* Build and optimise scalable data pipelines using Databricks and Apache Spark (PySpark).
* Ensure performance, scalability, and compliance (GxP and other standards).
* Collaborate on requirements, design, and backlog refinement.
* Promote engineering best practices including CI/CD, code reviews, and testing.
* Research and introduce new tools, technologies, and methodologies.
Ideal experience:
* Experience with efficient, reliable data pipelines that improve time-to-insight.
* Knowledge of secure, auditable, and compliant data workflows.
* Know how on optimising performance and reducing costs through Spark and Databricks tuning.
* Be able to create reusable, well-documented tools enabling collaboration across teams.
* A culture of engineering excellence driven by mentoring and high-quality practices.
Preferred Experience
* Databricks in a SaaS environment, Spark, Python, and database technologies.
* Event-driven and distributed systems (Kafka, AWS SNS/SQS, Java, Python).
* Data Governance, Data Lakehouse/Data Intelligence platforms.
* AI software delivery and AI data preparation.