gcp data engineer
Role: Lead GCP Data Engineer
Duration: Long Term Contract
Location: Minneapolis, MN – Onsite
Must Have: BigQuery, GCP, Python, SQL, Control-M, Datastage
Required Past Experience:
Experience in architecting, developing, testing & implementing Data Platform projects using GCP Components (e.g. BigQuery, Dataflow, Dataproc,DLP,BigTable,Pub/Sub,Compos etc..). OR AWS OR Azure
Good Understanding of Data Structures.
Worked with large datasets and solving difficult analytical problems.
Experience working with GIT for Source Code Management
Worked with Structured and Unstructured data
E2E Data Engineering and Lifecycle (including non-functional requirements and operations) management.
Worked with client teams to design and implement modern, scalable data solutions using a range of new and emerging technologies from the Google Cloud Platform
Automating manual processes to speed up delivery.
Good Understanding of Data Pipeline (Batch and Streaming) and Data Governance
Experience in code deployment from lower environment to production.
Good communication skills to understand business requirements.
Required Skills:
Mandatory Skills – AWS/ Azure OR BigQuery ,Composer, Dataflow, Python/ Shell scripting, GCP Fundamentals, SQL, Control-M and DataStage.
Secondary Skills – Oracle to BQ migration, IBM DS, Dataproc, DLP, Pub/Sub, , Security(Platform & Data) concepts.
Knowledge of ETL Migration from On-Premises to GCP Cloud
SQL Performance Tuning,
Batch/Streaming Data Processing
Fundamentals of Kafka,Pub/Sub to handle real-time data feeds.
Good To Have – Certifications in any of the following: GCP Professional Cloud Architect, GCP Professional Data Engineer
Ability to communicate with customers, developers, and other stakeholders.
Mentor and guide team members
Good Presentation skills
Strong Team Player
To apply for this job email your details to Alok@nytpinc.com