Data engineers Location: Houston, TX

Need OIL & GAS EXP MUST BE USC, GC, GC-EAD, OR H4EAD

Data engineers (Azure) will work

Location: Houston, TX (Onsite from Day 1) Local

Duration: 6 months

End Client: IBM-Shell

Must-have:

Designing and implementing highly performant data ingestion pipelines from multiple sources using Azure Data Factory and Azure Databricks
Developing scalable and re-usable frameworks for ingesting of geospatial data sets
Experience with Azure: ADF, ADLS, Databricks, SQL DW, Analysis Services
Experience with relational SQL and Spark SQL, DevOps/GIT
Experience with Spark related programming, Scala, Pyspark and Spark
Experience building and optimizing ‘big data’ data pipelines, architectures and data sets
Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement
Strong analytic skills related to working with unstructured datasets
Build processes supporting data transformation, data structures, metadata, dependency and workload management
A successful history of manipulating, processing and extracting value from large disconnected datasets
Strong project management and organizational skills
Experience supporting and working with cross-functional teams in a dynamic environment