We are seeking an experienced Data Engineer to design, develop, optimize, and maintain enterprise data pipelines using Snowflake and Informatica.
The selected candidate will support the Statewide Longitudinal Data System (SLDS/COdata), integrating education and workforce data from multiple state agencies into a centralized analytics platform.
The role involves hands-on ETL/ELT development, data transformation, data quality, identity matching, production support, and collaboration with the Data Architect and third-party implementation team.
Required Qualifications
- Snowflake (5+ Years): Strong hands-on experience developing, orchestrating, and optimizing complex ETL/ELT pipelines and SQL transformations within Snowflake.
- Informatica CDGC (1+ Year): Experience with Informatica Cloud Data Governance and Catalog for metadata management, data profiling, cataloging, and automated data quality validation.
- Terraform (1+ Year): Experience with Infrastructure as Code (IaC), provisioning, configuration, and cloud resource management.
- Azure DevOps: Experience implementing automated CI/CD pipelines for builds, testing, and deployments.
- Git: Strong expertise in version control, branching, pull requests, merge checks, and code reviews.
- Location: Candidates must currently reside in Colorado and remain in the state throughout the engagement.
Key Responsibilities
- Design, develop, test, and deploy automated ETL/ELT pipelines using Snowflake and Informatica.
- Ingest and integrate education and workforce data from multiple state agencies into the SLDS common data model.
- Develop SQL transformations, data cleansing processes, and analytics-ready data models.
- Implement data quality checks covering structural validation, completeness, deduplication, referential integrity, and business logic.
- Support record linkage, identity matching, and reconciliation across multiple agency datasets.
- Monitor scheduled data pipelines, troubleshoot failures, resolve data discrepancies, and support production operations.
- Optimize Snowflake queries, warehouse utilization, compute costs, and pipeline performance.
- Maintain data lineage, mapping specifications, operational runbooks, and technical documentation.
- Support testing, code reviews, defect resolution, and deployments across Development, Test, UAT, and Production using Azure DevOps and Azure Test Plans.
- Collaborate with Data Architects, Data Scientists, Operations Engineers, and third-party implementation teams.
- Participate in knowledge transfer, shadowing, and co-running of production feeds, progressing toward independent operational ownership.
- Ensure compliance with data privacy, governance, and security requirements, including FERPA, COPPA, ADA, and applicable state regulations.
Preferred Qualifications
- Experience with public-sector education or workforce data systems, including CDE, CDHE, CDLE, CDEC, or the National Student Clearinghouse.
- Experience with longitudinal data systems, entity resolution, and deterministic/probabilistic identity matching.
- Knowledge of student/workforce privacy regulations, data de-identification, and cell suppression requirements.
- Experience with Azure Test Plans and structured testing practices.
- Experience supporting Tableau analytics and reporting data models.
Important: This is a remote position, but candidates must currently reside within Colorado. Preference will be given to candidates in the Denver Metro area.
—