C2C contract Hiring – AWS Databricks Architect – Charlotte, NC

Role:                               AWS Databricks Architect
Location:                     Charlotte, NC / ONSITE
Duration:                     Long Term Project
Experience:               12+

Job Role and Responsibilities:
Proficiency in AWS services such as CFT EC2 S3 Lambda and RDS along with the AWS SDK and CLI and Terraform
Familiarity with AWS infrastructure as code tools like CloudFormation for automating cloud deployments
Understanding of serverless architecture and microservices with handson experience in implementing scalable AWS solutions
Should have grasp of security best practices within AWS including IAM roles VPCs and encryption mechanisms
Strong analytical and problem-solving skills essential for debugging and optimizing AWS resource utilization
Good communication skills enabling clear and effective interaction with both technical and nontechnical team members and stakeholders

Environment Provisioning Configuration:
o Set up Databricks workspaces in designated AWS regions
o Configure networking VPC subnets security groups and establish secure connectivity
o Implement storage and credential configurations including KMS encryption keys for data security

Access Management Security:
o Address WIZ Violations
o Define and implement role based access controls RAC using Unity Catalog
o Integrate Databricks with Vanguards Identity Provider SSO and manage authentication flows
o Ensure compliance with security standards and governance controls

Platform Integration Data Access:
o Validate external data access strategies and configure connectors for S3 and other data sources
o Enable ingestion frameworks and orchestration of notebooks for data pipelines

Operational Enablement:
o Support CICD deployment pipelines for Databricks notebooks and jobs
o Implement monitoring for cluster lifecycle cost optimization and performance tuning
o Assist with troubleshooting and error handling during execution

Compliance Governance:
o Apply data governance and ML GenAl governance controls as per enterprise standards
o Ensure audit logging and lineage tracking for all data assets
Collaboration Documentation
o Work with internal teams EADP CTO ESF to align with architecture strategy and best practices
o Document configurations processes and operational runbooks for future reference