AWS Databricks Lead || Indianapolis, IN (Hybrid)

AWS Databricks Lead

Indianapolis, IN (Hybrid)

 

 

 

Job Requirements Must Have (Required)1. Databricks on AWS Enterprise Architectureo Led multiple Databricks implementations on AWS.o Experience operating in a large, regulated enterprise environment.o Deep expertise working in an enterprise environment containing multipleDatabricks workspaces.2. Databricks Platform Foundation Experienceo Established governance, security, workspace, catalog, and data-sharingstandards.o Built reusable platform accelerators, patterns/reference architectures, andengineering guardrails.o Strong Unity Catalog, Delta Lake, and enterprise governance expertise.3. Migration Experienceo Proven delivery of migrations from:? AWS Glue ? Databricks? Aurora PostgreSQL ? Databricks? AWS data lake platforms ? Databricks Lakehouseo Experience modernizing ETL frameworks, pipelines, and operationalprocesses during migration.4. Hands-On Technical Skillso Databricks Workflowso Spark/PySpark/Declarative Pipelineso Delta Lakeo SQL Warehouseso CI/CD and Infrastructure as Codeo AWS S3, IAM, networking, and security controlsStrongly Preferred5. Governance & Complianceo Experience implementing RBAC/ABAC and data governance controls.o Background supporting audit, privacy, security, or compliancerequirements in regulated industries.6. Pharmaceutical / Life Sciences Experienceo Experience working in Pharma, Biotech, Healthcare, or similarly regulatedindustries.o Familiarity with GxP and validated systems.Nice to Have7. Veeva Vault Experienceo Veeva Safetyo Veeva RIMo Veeva Clinicalo Veeva QMSo Veeva QualityDocs8. Additional Skillso CDC architectureso Terraformo GitHub-based deployment frameworkso Data observability solutionso Data mesh / domain-oriented architecturesVendor Qualification QuestionPlease provide examples of projects where the candidate:1. Implemented Databricks on AWS.2. Led migration from AWS Glue to Databricks.3. Led migration from Aurora PostgreSQL and Glue to Databricks.4. Worked in a regulated industry (Pharma preferred).5. Implemented or integrated with Veeva Vault Safety, RIM, Clinical, QMS, orQualityDocs.6. Served as the lead architect responsible for platform standards, governance, andmigration strategy.Target profile: Senior/Lead Databricks Architect who has already solved the exactAWS Glue + PostgreSQL ? Databricks migration challenges at enterprise scale, ratherthan a general-purpose Databricks developer or data engineer.Work Experience 10-15years

 

 

Neha Chaudhary Team Lead – Recruitment e: neha.chaudhary@compunnel.com  o: (+1) 609-606-9010 ext.2469 m: (+1) 732-743-9949  HQ: 4390 Route 1 North, Suite 302, Princeton, NJ 08540, USA. Survey Link: The survey is anonymous, and the information collected will be analysed in aggregate to support initiatives that improve the total experience across Compunnel.