Data Engineer
Job Title: Data Engineer
Location: Remote
Type: Contract
Note: Healthcare and life sciences applications experience is must.
Need minimum 12 years of experience
Job Description:
We are seeking an experienced Data Engineer to design, develop, and optimize data pipelines, ensuring seamless integration of commercial healthcare and life sciences data. This role involves implementing CI/CD deployments and leveraging Azure, Microsoft Fabric, Databricks, and SQL to drive data-driven decision-making.
The ideal candidate will have a strong foundation in CI/CD processes and Git, along with prior experience in the healthcare and life sciences commercial data space. Given the sensitivity of the data, we prefer US-based candidates.
Key Responsibilities
Design, build, and maintain data pipelines using Azure, Microsoft Fabric, Databricks, and SQL.
Implement CI/CD workflows for automated deployment and version control of data solutions.
Develop and optimize ETL/ELT processes to ingest, clean, and transform large healthcare datasets.
Work with structured and unstructured data
Ensure compliance with healthcare data security and governance standards.
Collaborate with cross-functional teams, including data scientists, analysts, and software engineers.
Utilize Git for source control, collaboration, and versioning of data engineering workflows.
Required Qualifications
Experience in data engineering, with expertise in Azure, Microsoft Fabric, Databricks, and SQL.
Hands-on experience with CI/CD deployments in a data engineering environment.
Strong understanding of data warehousing, ETL/ELT processes, and data pipeline orchestration.
Proficiency in Git for version control and collaboration.
Experience working with healthcare/life sciences commercial data (e.g., Patient 360, claims data, EHR, clinical datasets).
Knowledge of data security and compliance regulations (e.g., HIPAA, GDPR) in healthcare settings.
To apply for this job email your details to lakkumanan.s@datacaliper.com