Databricks Engineer
Remote
Long Term
Contract
• Responsible for the administration, configuration, and optimization of the Databricks platform to enable data analytics, machine learning, and data engineering activities within the organization.
• Collaborate with data engineering team to ingest, transform, and orchestrate data.
• Manage privileges over the entire Databricks account, as well as at workspace level, Unity Catalog level and SQL warehouse level.
• Create workspaces, configure cloud resources, view usage data, and manage account identities, settings, and subscriptions.
• Install, configure, and maintain Databricks clusters and workspaces.
• Maintain Platform currency with security, compliance, and patching best practices.
• Monitor and manage cluster performance, resource utilization, platform costs, and troubleshoot issues to ensure optimal performance.
• Implement and manage access controls and security policies to protect sensitive data.
• Manage schema data with Unity Catalog – create, configure, catalog, external storage, and access permissions.
• Administer interfaces with Azure AD and Amazon AWS.
• Hadoop admin skills are preferred
• Knowledge about Apache Kafka is desirable
Munesh
770-838-3829,
CYBER SPHERE LLC