Role: Technical Lead – Data Engineering (Streaming & Batch) | AWS
Location: 100% Remote
Duration: Long Term Contract
Descriptions:
“Lead Data Platform (Streaming + Batch)
• Own end-to-end architecture for real-time (Kafka + Flink) and batch (PySpark, Batch/MQ) data pipelines on AWS, ensuring scalability, resilience, and high performance.
– Drive Engineering Standards & Technical Strategy
• Define and enforce best practices, reusable frameworks, and standards for Python, Spark, Flink, Kafka, and cloud-native development across teams.
– Lead Implementation of Data Processing Solutions
• Oversee development of Flink streaming jobs, PySpark batch pipelines, and event-driven AWS solutions (S3, Lambda, EMR, EC2), ensuring optimized, secure, and cost-efficient delivery. – Data Storage, Integration & Performance Optimization • Architect and optimize AWS Aurora DB solutions along with Batch/MQ and Kafka-based integrations, ensuring efficient data modeling, query performance, and reliable ingestion patterns.
– Operational Excellence & Technical Leadership
• Ensure production readiness through CI/CD, observability, and reliability practices; lead teams via design reviews, mentoring, stakeholder collaboration, and ownership of delivery outcomes.
Nice to Have:
• P&C Insurance experience
• Communication & Influence Skills
• Leadership & Soft Skills
• Coaching & Facilitation”
AWS Aurora DB, Python/PySpark, Kafka, Apache Flink, Batch/MQ, AWS (S3, Lambda, EC2, EMR)
Skills: Digital : Python~AWS DevOps and Automation
|
Thanks & regards, Sonu Chauhan Sr. Technical Recruiter |
|
571-678-0927 |
