Databricks Architect

Job Title: Databricks Architect

Location: Raleigh, NC

Experience: 10+ Years

Employment Type: Contract

Job Summary
We are seeking an experienced Databricks Architect to design, develop, and implement scalable data platforms using Databricks, Apache Spark, and cloud technologies. The ideal candidate will have strong expertise in data architecture, data engineering, cloud platforms, and modern data lakehouse solutions.
Key Responsibilities
Design and implement enterprise-scale data platforms using Databricks Lakehouse Architecture.
Architect and optimize ETL/ELT pipelines using Apache Spark and Databricks.
Develop data models, data governance frameworks, and data quality standards.
Collaborate with business stakeholders to gather requirements and translate them into technical solutions.
Lead migration of on-premises data platforms to cloud-based Databricks environments.
Implement CI/CD, automation, monitoring, and performance tuning strategies.
Ensure security, compliance, and best practices for data management.
Mentor data engineers and provide technical leadership across projects.
Required Skills
8+ years of experience in Data Engineering and Data Architecture.
3+ years of hands-on experience with Databricks.
Strong expertise in Apache Spark, PySpark, Spark SQL, and Delta Lake.
Experience with cloud platforms such as Amazon Web Services (AWS), Microsoft Azure, or Google Cloud Platform (GCP).
Proficiency in Python, SQL, and data warehousing concepts.
Experience with data lake, lakehouse, and big data architectures.
Knowledge of data governance, security, and performance optimization.
Strong stakeholder management and solution design skills.
Preferred Skills
Databricks Certified Professional/Architect certification.
Experience with streaming technologies such as Apache Kafka.
Knowledge of DevOps, CI/CD, Terraform, and Infrastructure as Code.
Experience with Unity Catalog, Delta Live Tables, and Databricks Workflows.
Exposure to AI/ML workloads on Databricks.
Education
Bachelor’s or Master’s degree in Computer Science, Information Technology, Engineering, or a related field.
Nice-to-Have
Experience leading large-scale cloud transformation programs.
Experience in Financial Services, Healthcare, Retail, or Insurance domains.
Keywords: Databricks, Spark, PySpark, Delta Lake, Lakehouse, Data Engineering, Data Architecture, AWS, Azure, GCP, ETL, ELT, Data Governance, Unity Catalog, Data Migration, Cloud Architecture.