Databrick Engineers
Reston VA
Job Description
This role focuses on designing, building, and maintaining Databricks pipelines and infrastructure.
Designing, building, and deploying data pipelines and workflows using Databricks.
Developing and optimizing Apache Spark applications for data processing and analytics.
Strong proficiency in Python programming language.
Experience with Apache Spark and big data processing frameworks.
Experience on AWS cloud platform using S3 / EMR / Lambda / SQS / SNS / PostgreSQL
Integrating Databricks with various data sources and platforms.
Implementing data quality checks and monitoring processes.
Managing and configuring the Databricks environment, including clusters and notebooks.
Troubleshooting and resolving issues related to Databricks performance and functionality.
Collaborating with data scientists and analysts to implement machine learning models.
Staying up to date with the latest Databricks features and best practices.
Familiarity with data warehousing and ETL processes.
Understanding of machine learning concepts and algorithms.
Strong problem-solving and analytical skills.
Contact Information
Email: mohammad.saqib@tmvus.com
Click the email address to contact the job poster directly.