Minimum Experience: 8-9+ Years
Hi Professional(s),
Hope you are doing well!
This is Ankit from Sumeru Inc. I am looking for a Lead Data Engineer. For more details, please reach on. +1 229 518 1137.
Role: Lead Data Engineer
Location: Onsite – 07086, New Jersey
Duration: 6+ Months.
Client: PWC
End Client: UBS Bank
Job Description:
• Demonstrates thought leader-level abilities with, and/or a proven record of success directing efforts in Cloud Platforms (Azure), Architecture, and Design
• Expected to be able to function in a fast-paced environment driving innovation through rapid prototyping and iterative development ensuring quality is built into all solutions leveraging TDD.
• Utilize the expertise in developing enterprise-level metadata-driven data pipeline applications, with demonstrable production-scale experience.
• Experience in Data Quality, Data Governance, and Data management designs.
• Design, develop, code, and test complex technical solutions collaborating with senior engineers.
• Working knowledge of Microservice and Event-Driven Architecture.
• Lead code/design reviews to ensure smooth daily operations and accurate planning at a team level.
• Mentor and coach junior / experienced engineers.
• Work with the architecture team to help define directions for cross-functional or highly complex key technologies within a specific domain.
Preferred:
• Experience with designing and building metadata-driven data pipelines using pyspark, data bricks, or other ETL frameworks.
• Ability to design and implement data services using configurations and metadata.
• Working experience with Gradle, GIT, GitHub, GitLab, etc. around continuous integration and continuous delivery infrastructure
• Experience of
• 12+ years of software engineering/development experience utilizing python and pyspark
• 10+ Years of large-scale Enterprise Software Development.
• 4+ Years of experience in Docker or cloud-based applications
• 4+ years in Data Processing frameworks with a focus on metadata-driven services development using Pyspark.
• 3+ years in AGILE methodology (Scrum, Lean, SAFe, etc.)
• 8+ years of experience integrating with backend services like JMS, J2C, ORM frameworks (Hibernate, JPA, JDO, etc), and JDBC.
• 8+ Years leading development teams or mentoring junior developers.
Technology Stack/Requirements:
• Java//J2EE, Spring, Spring Boot
• Kafka
• PySpark, Python
• Azure SQL, Cosmos Db, MongoDB
• Azure Data Lake
• Databricks, HDInsight
• Event Hub, Azure Functions, Azure Data Lake.
Regards,
Ankit Tiwari | Technical Recruiter | Sumeru Inc.
948 W Adams Blvd., Suite #100, Los Angeles, CA 90007
Direct: +1 229 518 1137 | Alternate: +1 209-260-9224
Let’s Connect: https://www.linkedin.com/in/binaryankit/
To Schedule 10 Min Quick Connect: https://calendly.com/ankit-sumeru/10minute
________________________________________