Databricks QA Engineer
Remote
Core Responsibilities
- Test Case Development ā Create clear, repeatable test cases covering functional, negative, edge, and regression scenarios.
- Manual Execution ā Perform UI, functional, integration, and exploratory testing across environments.
- Bug Identification & Reporting ā Log defects with detailed steps, environment info, severity, priority, and supporting evidence.
- Regression Testing ā Re-validate existing functionality after code changes to ensure stability.
Technical Expectations
- Automation Awareness ā Understand automation coverage, identify automation candidates, and collaborate with automation engineers.
- Data Validation ā Verify backend data, database entries, and system states for accuracy and consistency.
- Data Engineering Background
Project-Specific Technical Skills
- Deep understanding of Medallion architecture
- Experienced in testing data ingestion, 3-layer data lake, Delta Lake, and ELT-based applications
- Extensive test automation experience using Python and PySpark
- Expert-level knowledge of SQL
Key Deliverables
- Test Plans ā Documented scope, strategy, risks, and coverage.
- Test Cases & Checklists ā Structured, traceable test documentation.
- Defect Reports ā Clear, actionable bug tickets with supporting evidence.
- Release Sign-off ā Final validation ensuring readiness for deployment.
Modernization Addendum
- Modern QA practices: The client needs a modernized QA approach built on contract-based validation standards (e.g. ODCS), automation and AI-assisted testing; we are sourcing QA profiles with this expertise.
- Databricks data engineering background: hands-on with Unity Catalog, Lakeflow pipelines and Asset Bundles, beyond test execution.
- Automation-first: automated suites in Python/PySpark (pytest); manual testing only for exploratory testing and UAT.
- CI quality gates: tests run in Azure DevOps pipelines and block merge or promotion when they fail.
- Data quality as code: quality rules (Lakeflow expectations / DQX) that extend the existing validation framework.
- AI/MCP-enabled QA: hands-on use of LLM agents connected via MCP to Azure DevOps and Databricks to run validations, triage failures and draft defects.
- PHI-safe practices: synthetic or masked test data only when working with LLMs.
|
|
Thanks and Regards
|
The content of this email is confidential and intended for recipient specified in message only. It is strictly forbidden to share any part of this message with any third party, without the written consent of the sender. If
