Location : Chicago IL ( onsite)
Experience: 10
Job Description:
We are seeking an onsite resource to lead Kafka-based initiatives from architecture and design through delivery and production rollout. The role requires deep hands-on expertise in Confluent Flink and the broader Kafka ecosystem. The candidate will act as the technical lead for streaming projects.
Key Responsibilities & Skills:
– Expert-level experience designing and implementing Flink applications on Confluent Platform for high-volume, low-latency stream processing.
– Strong experience architecting, implementing, and administering Confluent Cloud Kafka and Flink in production environments.
– Advanced understanding of Apache Flink concepts including:
– State management (Keyed/Operator State)
– RocksDB
– Exactly-once semantics
– Checkpointing and savepoints
– Deep knowledge of event-time processing, watermarks (bounded out-of-orderness), and windowing (tumbling, sliding, session).
– Strong experience with KSQL DB and KStreams for real-time stream processing.
– Proven experience with Kafka Connect, including CDC, from configuration to end-to-end cloud integration.
– Hands-on experience applying Flink and Kafka in retail use cases such as real-time inventory, dynamic pricing, fraud detection, and clickstream analytics.
Additional Requirements:
– Experience designing and managing CI/CD pipelines (Harness or similar) for Flink job deployment.
– Strong knowledge of GCP networking including Private Service Connect (PSC), DNS, firewalls, and enterprise security.
– Experience with cloud-native monitoring, observability, troubleshooting, performance tuning, and incident response.
– Strong experience with Disaster Recovery (DR), High Availability (HA), backup/restore, and multi-region architecture.
– Experience with cost optimization, resource monitoring, and right-sizing in Confluent Cloud.
– Strong skills in schema management, version compatibility, and data governance.
– Experience in capacity planning, partitioning, and scaling high-throughput streaming systems.
– Experience working in Agile/DevOps environments.
– Hands-on production support experience for mission-critical streaming platforms.
Thanks & Regards
Colin Isaac
—
