Job Description
Title: Lead Azure Data Engineer
Location: Chicago, IL
USC/GC-EAD/H4-EAD
Need LinkedIn, VISA DL
Locals
Signed RTR
Candidate agrees to drive to “meet and greet” with CapGemini employee to verify Drivers License in person (Must be Yes):
Candidate agrees to only represent themselves as being with MPower Consulting Group and no other companies (Must be Yes):
Confirm the candidate’s LinkedIn Profile shows the required skills listed on job description (Must be Yes):
Include copy of DL and VISA (Confirm attached):
Role Summary
We are seeking a Lead Data Engineer with deep Azure data engineering and production operations experience to provide onsite technical leadership and operational governance for enterprise data platforms. This role will lead solution design, guide offshore delivery teams, and own end‑to‑end operational stability across data pipelines, analytics platforms, and governance tooling.
The ideal candidate is local to Chicago, highly experienced in ETL, Azure Data Factory, Azure Synapse, and has a strong background in Incident, Problem, and Change Management within the data engineering space.
Key Responsibilities
Technical Leadership & Architecture
- Provide technical design direction and oversight to offshore data engineering teams.
- Review and consult on the design, development, and deployment of all data products.
- Design and validate Azure-based data architectures that meet performance, availability, scalability, security, and compliance requirements.
- Review architectural diagrams, design documents, and technical specifications; provide clear, actionable recommendations to stakeholders.
- Ensure adherence to Azure best practices and enterprise architecture standards.
Azure Data Engineering
- Lead solutioning and technical reviews across:
- Azure Data Factory (ADF)
- Azure Synapse Analytics
- Enterprise ETL / ELT pipelines
- Azure Data Lakes and data warehouses
- Establish patterns for ingestion, transformation, orchestration, and analytics workloads.
- Ensure production-grade reliability, scalability, and performance of data pipelines.
Operations, Support & ITSM (Critical Focus)
- Provide continuous operational monitoring of ETL pipelines, analytics platforms, and data governance tools.
- Own end-to-end Incident, Problem, and Change Management, including:
- Triage and resolution
- Root Cause Analysis (RCA)
- Long-term remediation and stabilization
- Act as the escalation point for production data platform issues.
- Drive operational excellence through runbooks, monitoring improvements, and automation.
Application Maintenance & Lifecycle Management
- Manage application lifecycle activities, including:
- Patching and vulnerability remediation (based on monthly vulnerability reports)
- Platform and integration upgrades
- Release planning and backlog / story grooming
- Support application vulnerability tracking, remediation, and compliance.
- Execute and support Disaster Recovery (DR) activities, including incident-driven recovery and annual DR drills.
DevOps & Environment Management
- Support code promotions and deployments across SIT, UAT, and PROD using Azure DevOps.
- Manage source code repositories, CI/CD pipelines, and deployment automation.
- Execute UAT data refreshes from production data warehouses/data lakes while ensuring governance and security.
- Support non-production environments for testing and validation cycles.
Testing & Release Management
- Define and execute unit and system testing.
- Support and troubleshoot QA and UAT test cycles.
- Own and execute production releases in compliance with Client ITSM policies, including:
- Change management compliance
- Release scheduling and coordination
- Deployment execution and rollback procedures
- Post-release validation and stabilization
Data Governance, Observability & Transformation
- Support implementation and operationalization of Data Governance and Observability platforms, including Ataccama.
- Design and support data observability pipelines.
- Drive continuous improvement initiatives such as:
- Operational trend analysis
- DevOps and automation opportunities
- Establishment of a Power BI Analytics Center of Excellence (CoE).
Required Qualifications
Mandatory
- Local to Chicago, IL with ability to work onsite.
- 10+ years of experience in data engineering, with lead or architect-level responsibility.
- Very strong hands-on experience with:
- Azure Data Factory (ADF)
- Azure Synapse Analytics
- Enterprise ETL / ELT frameworks
- Proven experience running production data platforms with strong ownership of Incident, Problem, and Change Management.
- Strong Azure cloud architecture and engineering background.
- Experience leading and governing offshore delivery teams.
- Hands-on experience with Azure DevOps (CI/CD, releases, environment management).
- Strong communication skills with the ability to engage technical and business stakeholders.
Preferred / Nice-to-Have
- Experience with Ataccama or other data governance / data quality tools.
- Familiarity with data security and compliance in enterprise environments.
- Power BI administration or CoE setup experience.
Kind Regards,
Deep Patel
Sr. Technical Recruiter
ZealHire Inc.
Direct: (609) 418-7092
14 Wall Street 20th Floor | New York, NY 10005
—
