Azure Databricks Engineer c2c job opportunities Chicago, Il

JOB TITLE:  Azure Databricks Engineer

LOCATION: Chicago, Il (Day 1 onsite)

Job Description:

The ideal candidate will have expertise in Terraform, Azure AD, Azure Databricks, Azure Data Factory ETL, and Azure Data.
This hybrid role requires excellent English language skills and offers a day shift with no travel required.
The candidate will play a crucial role in driving our data initiatives and ensuring seamless integration across platforms.
 

Years of Experience:       12.00 Years of Experience

Roles and Responsibilities:

Required Skills: Azure Data Factory, Azure AD, Terraform, Azure Databricks, Azure Data, Azure Data Factory ETL

Nice to have skills: SQL, ETL Datastage, Unix and Control M

Technology: -Azure Stack

Responsibilities: –

Design and implement scalable data solutions using Terraform, Azure AD, Azure Databricks, and Azure Data Factory ETL.
Develop and maintain data pipelines and workflows to support data integration and transformation processes.
Collaborate with cross-functional teams to gather requirements and ensure data solutions meet business needs.
Optimize data storage and retrieval processes to enhance performance and efficiency.
Provide technical guidance and support to team members on best practices for data management and integration.
Monitor and troubleshoot data pipelines to ensure data quality and reliability.
Implement security measures to protect sensitive data and ensure compliance with industry standards.
Conduct regular reviews and updates of data solutions to ensure they remain current and effective.
Work closely with stakeholders to understand their data needs and provide actionable insights.
Develop and maintain documentation for data solutions, including design specifications and user guides.
Participate in code reviews and provide constructive feedback to improve code quality.
Stay up-to-date with the latest trends and technologies in data management and integration.
Contribute to the continuous improvement of data processes and methodologies.
Qualifications

Possess strong experience in Terraform, Azure AD, Azure Databricks, and Azure Data Factory ETL.
Demonstrate proficiency in developing and maintaining data pipelines and workflows.
Exhibit excellent problem-solving skills and the ability to troubleshoot complex data issues.
Show strong communication skills and the ability to collaborate effectively with cross-functional teams.
Have a solid understanding of data security and compliance requirements.
Display a proactive approach to staying current with industry trends and technologies.
Possess the ability to provide technical guidance and support to team members.
Demonstrate strong organizational skills and attention to detail.