Job Title: Azure Databricks Data Architect
Remote
About the Role
We are seeking a senior Azure Databricks Data Architect to design and implement scalable, high‑performance data platforms on Microsoft Azure. This role focuses on end‑to‑end architecture of the Databricks Lakehouse, ensuring data governance, security, and optimization for advanced analytics and AI workloads. You will serve as a technical leader, guiding teams in modernizing data ecosystems and integrating with enterprise tools.
Core Responsibilities
- Platform Architecture: Design and oversee Databricks Lakehouse architecture using Delta Lake and Apache Spark.
- Data Strategy: Define requirements and reusable frameworks for ingestion, quality, transformation, and modeling to support real‑time and batch processing.
- Unified Governance: Implement Unity Catalog for lineage, security, and fine‑grained access controls.
- Pipeline Optimization: Guide teams in building complex pipelines and tuning Spark jobs for performance.
- Modernization & Integration: Advise on migrating legacy systems to Azure and integrate Databricks with Microsoft Purview, Power BI, and other enterprise tools.
Required Skills & Qualifications
- Technical Proficiency: Expert knowledge of PySpark, Python, Scala, and SQL.
- Cloud Ecosystems: Deep experience with Azure services (ADLS, ADF, Azure SQL).
- Professional Experience: 7–12+ years in data engineering/architecture, with 5+ years leading technical teams and providing architecture consulting.
- Certifications: Preferred credentials include Databricks Certified Data Engineer Professional or Azure Solutions Architect Expert.
—
Thanks & Regards,
RahulÂ
Talent Acquisition Specialist
Lightning Minds Inc.
Office  :   Â
Email  :    rahul@lightningminds.com