Immediate need of ML Engineer Big Data & Azure in Dallas, TX



Immediate need of ML Engineer Big Data & Azure in Dallas, TX


ML Engineer (Big Data & Azure)

Dallas, TX

Long Term



Job Description:

Competent ML engineer, who is independent, results driven and is capable of taking business requirements and building out the technologies to take it to production.

Big Data ML Engineer with expert level experience in Hadoop ecosystem and real-time analytics tools including PySpark/Scala-Spark/Hive/Hadoop CLI/MapReduce/ Storm/Kafka/Lambda Architecture/Mongo.

expert with using the larger Hadoop eco system.

Familiar with job scheduling challenges in Hadoop.

Experienced in creating and submitting Spark jobs.

Experience in high performance tuning and scalability.

Experience in working on real time stream processing technologies like Spark structured streaming, Kafka, FLink + rocksDB.

Expertise in Python/Spark and their related libraries and frameworks.

Experienced with Spring Framework and Spring Boot.

Experience in building training ML pipeline and efforts involved in ML Model deployment.

Experience in other ML concepts – Real time distributed model inferencing pipeline, Champion/Challenger framework, A/B Testing, Model performance Scorecard and assessment, Retraining framework, etc.

Unix/Linux expertise; comfortable with Linux operating system and Shell Scripting.

Working Experience in Redis DB – Writing to and from redis– very critcal Also exp Azure cache.

Experience in creating Kubernetes open-source container-orchestration system for automating application deployment, scaling, and management; (Experience in Azure is preferable).

Experience in tweaking/using Jenkins, deployment orchestration and/or Kubernetes for CI/CD pipeline.

Creating/modifying Dockers, microservices and deploying them via Kubernetes.

PL/SQL, RDBMS background with Oracle/MySQL.

Familiarity with Cassandra, Mongo preferred.

Design, Development, Unit and Integration testing of complex data pipelines and to handle data volumes to derive insights.

Ability to optimize code to be able to run efficiently with stipulated SLA.

Excellent problem-solving skills, with attention to detail, focus on quality and timely delivery of assigned tasks.


Emmanuel – IT Recruiter || IT Brainiac, Inc.

Princeton Forrestal Village -116 Village Blvd. Suite # 200| Princeton NJ – 08540

Direct: 609-357-9475 Office: 609-357-9406 Ext: 108 





Disclaimer: This email contains confidential or proprietary information which may be legally privileged. It is intended only for the named recipient (s). If an addressing or transmission error has misdirected the email, please notify the author by replying to this message by “REMOVE”



Leave a Reply