Lead Agentic Data Engineer

Lead Agentic Data Engineer

Qualifications:

Need 12+ Years of Excellent candidate,
Strong Data engineering fundamentals
Utilize Big data frameworks like Spark/Databricks
Training LLMs with structed and unstructured data sets.
Understanding of Graph DB
Experience with Azure Blob Storage, Azure Data Lakes, Azure Databricks
Experience implementing Azure Machine Learning, Azure Computer Vision, Azure Video Indexer, Azure OpenAI models, Azure Media Services, Azure AI Search
Determine effective data partitioning criteria
Utilize data storage system spark to implement partition schemes
Understanding core machine learning concepts and algorithms
Familiarity with Cloud computing skills
Strong programming skills in Python and experience with AI/ML frameworks.
Proficiency in vector databases and embedding models for retrieval tasks.
Expertise in integrating with AI agent frameworks.
Experience with cloud AI services (Azure AI).
Experience with GIS spatial data
Strong leadership, excellent problem-solving and communication skills
Proven experience in leading projects and teams, including the mentorship of AI engineers
The ability to engage in critical evaluation of information, hypothesis testing, and scenario analysis.
Flexibility in learning and adopting new technologies, methodologies, and tools to stay at the forefront of AI trends.
Experience with Department of Transportation Data Domains developing an AI Composite Agentic Solution designed to identify and analyze data models, connect & correlate information to validate hypotheses, forecast, predict and recommend potential strategies and conduct What-if analysis.
Bachelor’s or master’s degree in computer science, AI, Data Science, or a related field.

Vipul Kumar
Senior Technical Recruiter
M: +1 (408-451-1991)
W: www.e-solutionsinc.com
E: vipul.k@e-solutionsinc.com