This is Tejaswini Senior Lead Recruiter from Metasis Information Systems
This is in reference to the following position
Data Engineer
Job Location:-Pittsburgh, PA
Level | ||
- Databricks Minimum of 8-10 years professional IT experience
- Experience in Databricks, Data/Delta Lake, Oracle, or AWS Redshift type relational databases.
- Extensive experience in Databricks/Spark-based Data Engineering Pipeline development 8+ years working experience in Python-based data integration and pipeline development.
- Data lake and Delta Lake experience with AWS Glue and Athena.
- 5+ years of Experience with AWS Cloud on data integration with Apache Spark, Glue, Kafka, Elastic Search, Lambda, S3, Redshift, RDS, MongoDB/DynamoDB ecosystems.
- Strong real-life experience in python development especially in pySpark in AWS Cloud environment Design, develop test, deploy, maintain, and improve data integration pipeline.
- Experience in Python and common python libraries.
- Lead engineering team to drive the project initiatives and flexible to work on onsite and offshore model with India & China teams.
- Strong analytical experience with database in writing complex queries, query optimization, debugging, user defined functions, views, indexes etc.
- Strong experience with source control systems such as Git and Jenkins build and continuous integration tools.
- Highly self-driven, execution-focused, with a willingness to do “what it takes” to deliver results as you will be expected to rapidly cover a considerable amount of demands on data integration Understanding of development methodology and actual experience writing functional and technical design specifications.
- Excellent verbal and written communication skills, in person, by telephone, and with large teams.
- Strong prior technical, development background in either data Services or Engineering Demonstrated experience resolving complex data integration problems.
- Must be able to work cross-functionally.
- Above all else, must be equal parts data-driven and results-driven.
- Scrum and Agile experience and need to participate and run scrum team as tech lead. Require having background of the informatica or any other ETL took experience
Disclaimer:: We respect your online privacy. This is not an unsolicited mail. Under bill 1618 title III passed by the 105th us congress this mail cannot be considered Spam as long as we include contact information and a method to be removed from our mailing list. If you are not interested in receiving our e-mails, please reply with a “REMOVE” in the subject line. We apologize for any inconvenience caused by this mail
To unsubscribe from future emails or to update your email preferences click here
