Senior Data DevOps Engineer – Microsoft Fabric & Azure Data –100% Remote

 

Senior Data DevOps Engineer – Microsoft Fabric & Azure Data

100% remote

12+ month contract

Role Overview

You will own the end-to-end CI/CD lifecycle for Microsoft Fabric artifacts—e.g., Lakehouses, Notebooks, Dataflows Gen2, Pipelines, Semantic Models and Power BI reports—using Azure DevOps Git repos, YAML pipelines, and Fabric deployment pipelines. You’ll establish standards, automate deployments across environments (Dev → Test → Prod), and enable versioning, branching, and release governance for the Fabric analytics platform.

 

Key Responsibilities

• Version Control & Repo Strategy
• Implement Git integration for Fabric workspaces; define mono-repo or multi-repo strategy.
• Establish branching model (e.g., trunk-based or GitFlow) and PR workflows with mandatory code reviews.
• Create repository templates (folder structure, sample YAML, policies).
• CI/CD & Automation
• Build Azure DevOps YAML pipelines to validate, package, and deploy Fabric items via deployment pipelines and/or Fabric APIs.
• Automate environment promotions with approvals, gates, and artifacts (e.g., datasets/semantic models refresh post-deploy).
• Implement build/test quality gates—linting notebooks, validating JSON definitions, verifying data pipeline configs.
• Environment & Release Management
• Design Dev/Test/Prod environment topology in Fabric; manage workspace mapping to deployment stages.
• Configure service connections, secrets management (Key Vault), and role assignments.
• Define and enforce release governance (manual approval steps, rollback strategy, change logs).
• Security, Compliance & Observability
• Apply least-privilege access, branch policies, protected branches, and required reviewers.
• Integrate pipeline logging/monitoring (Azure Monitor/App Insights), set alerts for failures.
• Maintain audit trails, align with data governance and tenant policies.
• Developer Experience & Standards
• Provide templates and reusable YAML for common Fabric assets (notebooks, dataflows, Power BI).
• Write documentation and run enablement sessions; champion best practices.
• Collaborate with Data Engineers/BI Developers on structure and release cadence.
• Performance & Cost Awareness
• Optimize pipelines for speed and reliability; track DORA metrics (Lead Time, Deployment Frequency, Change Failure Rate, MTTR).
• Partner with platform owners to minimize compute costs and avoid inefficient refresh patterns.

Required Qualifications

• 5–8+ years in DevOps/Platform Engineering, with 2+ years in Azure DevOps (Repos, Pipelines).
• Hands-on with Microsoft Fabric (workspaces, deployment pipelines) or strong experience in Power BI / Azure Synapse with CI/CD.
• Strong YAML pipelines, Git branching, pull request policies, and service connections.
• Experience with Azure Key Vault, Service Principals/Managed Identities, RBAC, and governance.
• Scripting skills (PowerShell, Python) for validation/packaging tasks.
• Familiarity with data/BI artifacts lifecycle (datasets, semantic models, notebooks, pipelines).

Nice-to-Have

• Experience with Power BI CI/CD and REST APIs, dataset refresh automation.
• Knowledge of Infrastructure as Code (Bicep/Terraform) for Fabric-adjacent Azure resources.
• Exposure to Salesforce integrations and Customer Data Analytics platforms (per your team’s context).
• Experience enabling GitHub or Azure DevOps integrations directly within Fabric Git integration features.

Soft Skills

• Excellent communication; can translate platform constraints into developer-friendly standards.
• Strong collaboration across Data Engineering, BI, Security, and Architecture.
• Ownership mindset; bias for automation and documentation.

Success Metrics (KPIs)

• Lead Time for Changes: Reduce end-to-end time from commit → production.
• Deployment Frequency: Weekly or better, with safe modular releases.
• Change Failure Rate: <10% failed deployments; <5% rollbacks.
• MTTR: Recovery within hours, not days.
• Compliance: 100% of Fabric repos with branch protection & mandatory PR reviews.
• Adoption: % of teams using standardized templates/pipelines.

Example Responsibilities in the First 90 Days

1. Foundation: Stand up Azure DevOps project, service connections, Key Vault; define repo standards and branching policy.
2. Pilot: Integrate one Fabric workspace with Git; implement CI pipeline validating notebooks/JSONs; build deployment pipeline with manual approvals.
3. Scale: Publish templates, onboarding guides, and reusable YAML; bring 10+ team members onto the model; instrument DORA metrics.

 

 

 

 

Warm Regards

Naga Raju | Talent Acquisition Partner-Lead

Tech Rakers Inc | nagarajup@techrakers.com

Tel: +1(337) 999-0568 | Fax: 337.205.6136

1602 W Pin hook Rd, Suite 202-B, Lafayette, LA  70508