Senior Databrick Developer c2c jobs Albany, NY (Onsite)

Job Title: Sr Databricks Developer

Role: Senior Databrick Developer/Support Engineer

Experience: 15 Years

Location: Albany, NY (Onsite)

Duration: C2H (6months)

 

Core Technical Skills:

 

Databricks Skill Level – Expert

 

• Solid experience in PySpark for data ingestion, transformation, and cleansing.
• Expertise in Delta Lake, job scheduling, and optimizing Spark jobs.
• Implement New Enhancements and new plant onboarding.
• Experience integrating Databricks with ADF pipelines and Azure Data Lake.
• Knowledge of data validation, logging, and exception handling frameworks.

ADF – Expert Level:

• End-to-end pipeline development, data movement, and orchestration experience.

ADLS – Expert Level:

• Deep knowledge of file structures, partitioning strategies, and access control.

Azure – Medium Level:

• Working experience with Azure Monitor, Key Vault, and automation scripts.
• Power BI – Medium Level:
• Experience in data model validation and troubleshooting refresh failures.

Responsibilities

• Design, develop, and maintain ETL/ELT workflows across Databricks and ADF.
• Handle production support issues, ensuring minimal downtime and quick turnaround.
• Work closely with onshore leads for change requests, enhancements, and deployments.
• Automate recurring support activities through scripting and alerts.

 

Mandatory Skills

PySpark, Delta Lake, ADF, ADLS, Azure DevOps, Data Modeling Concepts, SQL.

 

Regards,

santhosh.s@sightspectrum.com