Join to apply for the Data Architect (Azure Databricks) role at Quantiphi
Employment type: Full time
About Quantiphi
Quantiphi is an award‑winning Applied AI and Big Data software and services company, driven by a deep desire to solve transformational problems at the heart of businesses. Our signature approach combines groundbreaking machine‑learning research with disciplined cloud and data‑engineering practices to create breakthrough impact at unprecedented speed.
Quantiphi has seen 2.5x growth YoY since its inception in 2013; we don’t just innovate – we lead. Headquartered in Boston, with 4,000+ professionals across the globe, Quantiphi leverages Applied AI technologies across multiple industry verticals (Telco, BFSI, HCLS, etc.). We are an established Elite/Premier Partner of NVIDIA, Google Cloud, AWS, Snowflake, and others.
Recognitions
* 3x AWS AI/ML award wins
* 3x NVIDIA Partner of the Year titles
* Recognized Leaders by Gartner, Forrester, IDC, ISG, Everest Group and other leading analyst and independent research firms
* We offer first‑in‑class industry solutions across Healthcare, Financial Services, Consumer Goods, Manufacturing, and more, powered by cutting‑edge Generative AI and Agentic AI accelerators
* We have been certified as a Great Place to Work for the third year in a row – 2021, 2022, 2023
Description
We are looking for an experienced Azure & Databricks Data Architect with a strong background in data migration and modernization, particularly in transitioning workloads from on‑premises or other cloud platforms to Microsoft Azure and Databricks. As a key member of our technology consulting team, you will play a pivotal role in designing, planning, and implementing scalable, secure, and high‑performance data solutions for our clients.
Must Have Skills
* Strong hands‑on expertise with Databricks Lakehouse, including Delta Lake, Unity Catalog, Medallion architecture, Spark optimization, notebook development, and CI/CD integration.
* Strong skills in data modeling, data warehousing, dimensional modeling, and designing scalable data architectures.
* Proficiency in ETL/ELT pipeline development using ADF, Synapse, Databricks, or similar Azure‑native services.
* In‑depth understanding of data governance, cataloging, lineage, data security, and compliance frameworks (Azure Purview / Unity Catalog).
* Experience with relational and NoSQL database systems and the ability to choose appropriate storage solutions.
* Proficiency in SQL and working knowledge of NoSQL systems.
* Strong programming experience in Python, PySpark, Java, or C# for automation and data manipulation.
* Extensive experience in data migration, including movement from on‑premises and/or other cloud platforms into Azure and Databricks.
* Strong understanding of data quality frameworks, validation techniques, and pipeline reliability.
* Excellent documentation skills for architectural artifacts, migration playbooks, and solution guides.
* Excellent communication skills for conveying complex technical concepts to non‑technical stakeholders.
* Ability to manage data‑related projects, collaborate with cross‑functional teams, and deliver within defined timelines.
Good to Have Skills
* AWS implementation experience – Glue, Redshift, S3, DMS – considered a strong plus but not mandatory.
* Relevant Microsoft Azure certifications such as DP‑203, AZ‑305, or Azure Solutions Architect Expert.
* Relevant Databricks certifications such as Databricks Certified Data Engineer Associate, Databricks Certified Data Engineer Professional.
* Knowledge of big data technologies like Hadoop, Spark, Kafka, and other distributed systems.
* Experience with DevOps practices and CI/CD pipelines (Azure DevOps, GitHub Actions, Databricks Release Pipelines).
* Familiarity with Azure Machine Learning, MLOps concepts, and implementing data‑driven models.
* Experience with real‑time streaming using Azure Stream Analytics, Event Hub, or Kafka.
* Skills in advanced analytics, data mining, and statistical analysis.
* Experience with PowerApps and broader Power Platform components.
* Experience with multi‑cloud migrations, including migrating workloads from AWS to Azure.
* Knowledge of Lakehouse patterns and formats: Delta Lake, Iceberg, Parquet.
* Understanding of Azure infrastructure – Networking, Security, Virtual Networks, Key Vault, Monitoring.
Role & Responsibilities
* Design and implement scalable data architecture on Azure and Databricks based on business and technical requirements.
* Develop data integration solutions to ingest data from various structured/unstructured sources into Azure/Databricks, ensuring quality and consistency.
* Choose and implement appropriate data storage solutions (ADLS, Synapse, Databricks Delta Lake) optimized for performance and cost.
* Implement and optimize data processing pipelines using ADF, Databricks, Synapse, or other Azure‑native services.
* Plan, execute, and oversee data migration projects, including migrations from on‑premises and other cloud environments to Azure.
* Establish and enforce data governance and security policies, ensuring compliance with regulatory and industry standards.
* Monitor and fine‑tune data pipelines for performance, cost optimization, and scalability.
* Create data models aligned to client solution requirements.
* Prepare detailed architecture documents, solution blueprints, and provide training/knowledge transfer to team members.
* Collaborate with cross‑functional teams – data engineers, architects, analysts, SMEs – to ensure alignment with business needs.
* Manage project scoping, planning, execution, risk tracking, and ensure on‑time delivery of data initiatives.
* Communicate effectively with non‑technical stakeholders, explaining migration strategies, architectural decisions, and business benefits.
What is in it for you
* Make an impact at one of the world’s fastest‑growing AI‑first digital engineering companies.
* Upskill and discover your potential as you solve complex challenges in cutting‑edge areas of technology alongside passionate, talented colleagues.
* Work where innovation happens – work with disruptive innovators in a research‑focused organization with 60+ patents filed across various disciplines.
* Stay ahead of the curve – immerse yourself in breakthrough AI, ML, data, and cloud technologies and gain exposure working with Fortune 500 companies.
Seniority level
Mid‑Senior level
Employment type
Full time
Job function
IT Services and IT Consulting
Referrals increase your chances of interviewing at Quantiphi by 2x
#J-18808-Ljbffr