Remote
Contract
Snowflake Certification is mandatory.
We are seeking a Data Engineer with strong experience in Airbyte and Snowflake on AWS, along with a working knowledge of data visualization tools. This role will focus on building scalable and secure data pipelines in a cloud-native environment, enabling analytics teams to make data-driven decisions.
Key Responsibilities:
- Design, deploy, and maintain Airbyte-based data pipelines on AWS infrastructure (e.g., EC2, ECS, EKS, Lambda).
- Develop ETL/ELT workflows to ingest and transform data into Snowflake for analytics consumption.
- Leverage AWS services such as S3, Secrets Manager, CloudWatch, IAM for orchestration, storage, and monitoring.
- Optimize Snowflake usage (clustering, warehousing, costs) and ensure data models support downstream visualization tools.
- Collaborate with business and analytics teams to ensure the data is analytics-ready and conforms to governance standards.
- Document pipeline architecture, lineage, and dependencies.
Required Skills:
- Airbyte: Source/destination connector setup, Docker-based deployment, error handling, and log analysis.
- Snowflake on AWS: SQL, data modeling, role-based access control (RBAC), performance tuning, tasks/streams/pipes.
- AWS Services: S3, IAM, Lambda, Secrets Manager, CloudWatch.
- Visualization Readiness: Ability to structure data for use in Tableau, Power BI, Amazon QuickSight, or similar.
- Version Control: Git, CI/CD familiarity (GitHub Actions, CodePipeline, or similar).
Neha Chaudhary |
