Technical Program Manager Data Lake Migration Azure Databricks to AWS Databricks
Location Raritan NJ
Â
Based on your ongoing Azure Databricks AWS Databricks migration initiatives including largescale multilake modernization programs referenced in internal planning documents such as CDLDATAVANTAGESTARLTMRESOURCEONBOARDINGxlsxhttpsltimindtreesharepointcomsitesBICCDIAJJlayouts15Docaspxsourcedoc7B4DA815B007A24393A3F340FA57BD44AF7DfileCDLDATAVANTAGESTARLTMRESOURCEONBOARDINGxlsxactiondefaultmobileredirecttrueDefaultItemOpen1EntityRepresentationIdb805e21f773246028cb7b8c1bdaf6430 which includes migration Databricks modernization AWS Redshift Medallion Architecture and multilake delivery requirements the following JD is tailored for a Technical Program Manager role CDLDATAVAONBOARDING ExcelhttpsltimindtreesharepointcomsitesBICCDIAJJlayouts15Docaspxsourcedoc7B4DA815B007A24393A3F340FA57BD44AF7DfileCDLDATAVANTAGESTARLTMRESOURCEONBOARDINGxlsxactiondefaultmobileredirecttrueDefaultItemOpen1
Job Summary
We are seeking an experienced Technical Program Manager TPM to lead largescale enterprise data lake migration programs from Azure Databricks to AWS Databricks The ideal candidate will have strong experience managing complex cloud transformation initiatives coordinating global teams driving execution across multiple workstreams and ensuring successful delivery with minimal business disruption
The TPM will be accountable for endtoend program governance planning risk management stakeholder communication and delivery of multiple data lake migration tracks
Key Responsibilities
Lead endtoend migration of enterprise data lakes from Azure to AWS Databricks
Manage multiple workstreams including
  Data Engineering
  Data Migration
  Platform Engineering
  Testing Validation
  Security Compliance
  Business Readiness
Develop and maintain integrated program plans milestones dependencies and release schedules
Coordinate global onsite offshore and nearshore teams
Drive governance forums steering committee meetings and executive status reporting
Manage program scope budget risks issues assumptions and dependencies
Ensure successful migration of
  Databricks Workspaces
  Delta Lake assets
  Unity Catalog
  ADF Pipelines
  Notebooks and Jobs
  Data Products
  Reporting and Analytics workloads
Work closely with AWS Databricks Infrastructure Security and Business stakeholders
Establish migration playbooks cutover plans rollback strategies and hypercare support models
Ensure compliance with enterprise architecture security ISRM and regulatory requirements
Drive Agile delivery practices and CICD adoption
Required Skills Experience
Program Management
12 years of IT experience with 5 years managing large transformation programs
Proven experience managing programs involving 50 resources and multiple vendors
Strong expertise in Agile Scrum Waterfall and Hybrid delivery models
Experience managing multimilliondollar transformation initiatives
Technical Expertise
Strong understanding of
  Azure Databricks
  AWS Databricks
  Delta Lake
  Unity Catalog
  Medallion Architecture
  Data Lakehouse concepts
  Data Governance
Knowledge of
  Azure Data Factory ADF
  AWS Glue
  AWS S3
  Redshift
  Airflow
  Terraform
  CICD pipelines
Migration Experience
Cloudtocloud migration experience Azure AWS preferred
Data warehousedata lake modernization experience
Largescale platform migration rehosting replatforming and modernization programs
Experience handling cutover planning and production golive management
Leadership Expectations
Exceptional stakeholder management and executive communication skills
Ability to influence senior leadership and business sponsors
Strong problemsolving and conflictresolution abilities
Proven success in managing geographically distributed teams
Selfdriven highly motivated leader with strong ownership mindset
Preferred Qualifications
Databricks Certification
AWS Certification
PMPÂ PgMP Certification
SAFe Agilist Certification
Experience in Healthcare Life Sciences Consumer Products or Supply Chain domains
Success Metrics
Ontime migration delivery
Zero critical production incidents during cutover
Successful business signoff
Data reconciliation accuracy 999
Minimal downtime during migration
Budget and schedule adherence
Stakeholder satisfaction
This role is ideal for a seasoned program leader capable of orchestrating largescale enterprise data lake migrations across multiple platforms teams and geographies while ensuring
Â
Â
Â
|
Neha Chaudhary
Survey Link:Â The survey is anonymous, and the information collected will be analysed in aggregate to support initiatives that improve the total experience across Compunnel.
|
Â
—