Location – San Francisco, CA (Onsite)
Job Type – C2C/W2
Job Description:
- Minimum 14+ years of experience.
- Design and manage AWS-based data infrastructure using services such as S3, Glue, EMR, Redshift, Athena, Lambda, Kinesis, and RDS
- Build and maintain scalable, fault-tolerant data pipelines (batch and streaming)
- Implement Infrastructure as Code (IaC) using Terraform / CloudFormation
- Optimize data storage, compute, and query performance for cost and efficiency
- Ensure data security, governance, and compliance (IAM, encryption, VPC, logging)
- Design and implement monitoring, alerting, and observability for data platforms and pipelines
- Integrate and manage monitoring tools such as Datadog, Prometheus, Grafana, CloudWatch
- Create dashboards, alerts, and SLIs/SLOs to ensure pipeline reliability and performance
- Collaborate with data engineers, analysts, and platform teams to support analytics use cases
- Automate deployments, scaling, and operational tasks via CI/CD pipelines
- Participate in architecture reviews and recommend best practices for AWS data platforms
- Proficiency in Python / SQL (Scala optional)
- Solid understanding of data modeling, ETL/ELT, and distributed systems
- Experience with Apache Spark, EMR, Kafka
- Experience with Data Lake
- Familiarity with Airflow, Step Functions, or other orchestration tools
Vishnu Gautam | Technical Recruiter
Tel: +1 630 536 8202 Ext. 5576 Dir: +1 630 937 0276
