Location : St. Louis, MO (Hybrid)
Duration : 12 months
Job Description :
Roles and Responsibilities:
· Strong communication skills with the ability to engage confidently with client stakeholders
· Customer management and relationship skills
· Experience leading and mentoring onsite/offshore teams
· Ability to balance technical depth with leadership and decision‑making
· Experience working in Agile delivery models
· Capability to articulate system designs, architectural patterns, and platform strategies to varied audiences, including senior leadership
· Collaborate closely with cross‑functional teams (data scientists, ML engineers, product teams) to deploy and operate data pipelines and services on Databricks
· Document platform architecture, best practices, and troubleshooting guides, and mentor junior engineers on platform usage and optimization.
Platform & Team Management Responsibilities
· Design, implement, and manage scalable, secure, and reliable Databricks platforms
· Create and manage Databricks workspaces and clusters, including right‑sizing and lifecycle management
· Automate infrastructure provisioning and deployments using Infrastructure‑as‑Code (Terraform, GitLab CI/CD, Python/Bash/PowerShell)
· Monitor platform health, performance, and cost through dashboards and integrated monitoring tools
· Troubleshoot and resolve cluster, job, and performance issues across Databricks environments
· Implement security and governance policies, including user management, access controls, and compliance using Unity Catalog and Databricks security features
· Optimize compute and storage costs while maintaining performance, leveraging Delta Lake, Photon, and other platform capabilities
· Stay current with Databricks feature releases and coordinate with product teams to evaluate and adopt new capabilities
· Own documentation, operational runbooks, and knowledge transfer for platform sustainability
Thanks & Regards
Bhavanesh Eamani
Lead Technical Recruiter
Agile Enterprise Solutions Inc.
2591 Dallas Parkway Suite 300 Frisco, TX 75034
