data engineer

Please find the JD

Data Engineer

Irving, TX

Chandler, AZ

New Jersey, NJ

Charlotte, NC

San Leandro, CA

Last round F2F at client location              

Key responsibilities for the Data Engineer:

· Optimize data pipelines that read from Kinesis and Write into Oracle improve exception handling for schema/data type mismatches and implement alerting for data quality issues.

· Build services to read/write data to NetApp object store using the S3 API.

· Create analytical datasets in Parquet or Iceberg format.

· Develop housekeeping scripts for cleanup, archiving, and compression of logs, Object store files, etc.