Data Bricks Developer

Job Title: Databricks Developer

Experience:10+ Years

Location: Onsite

Duration: Long term contract

Job Summary
We are seeking a skilled Databricks Developer to design, develop, and maintain scalable data pipelines and analytics solutions using Databricks, PySpark, SQL, and cloud platforms such as Azure, AWS, or GCP. The ideal candidate will have strong experience in data engineering, ETL/ELT development, performance optimization, and Lakehouse architecture.
Key Responsibilities
Design, develop, and optimize data pipelines using Databricks and PySpark.
Build and maintain scalable ETL/ELT workflows for structured and unstructured data.
Develop data transformation logic using Python, PySpark, and SQL.
Implement and manage Delta Lake tables and Lakehouse architectures.
Optimize Spark jobs for performance, scalability, and cost efficiency.
Ensure data quality, governance, security, and reliability.
Configure and manage Databricks Workflows, Clusters, and Unity Catalog.
Collaborate with data engineers, architects, analysts, and business stakeholders.
Troubleshoot production issues and perform root cause analysis.
Support CI/CD processes and deployment of data solutions.
Required Skills
Strong hands-on experience with Databricks.
Proficiency in Python, PySpark, and SQL.
Experience with Apache Spark and distributed data processing.
Knowledge of Delta Lake, Unity Catalog, and Databricks Workflows.
Experience building ETL/ELT pipelines and data integration solutions.
Understanding of data modeling, data warehousing, and Lakehouse concepts.
Experience with cloud platforms (Azure, AWS, or GCP).
Familiarity with Git, CI/CD, and DevOps practices.
Strong analytical and problem-solving skills.
Preferred Qualifications
Databricks Certification.
Experience with Azure Data Factory, AWS Glue, or Airflow.
Knowledge of Kafka, streaming data pipelines, and real-time processing.
Experience with Power BI, Tableau, or other BI tools.
Exposure to AI/ML workloads on Databricks.
Nice-to-Have Technologies
Delta Lake
Unity Catalog
Azure Data Factory
AWS S3, Glue, Lambda
Kafka
Airflow
Scala
Power BI/Tableau
GitHub/Jenkins/Azure DevOps
Keywords
Databricks, PySpark, Spark, Python, SQL, Delta Lake, Unity Catalog, ETL, ELT, Data Engineering, Azure Databricks, AWS Databricks, Lakehouse, Data Warehouse, Data Pipeline, Cloud Data Engineering.