Gen AI Architect

Position: Gen AI Architect

Work Location: New York, NY (Onsite)

Duration: Long Term Contract

Primary Skills: Python, Azure AI, Docker

Responsibilities:

Writing evaluations to agentic systems (Metric based and LLM as judge).
Lead end-to-end solutioning of AI agents and agentic workflows, including design, development, testing, and deployment.
Build business cases, conduct process reviews, perform data analysis, and document business requirements.
Apply prompt and context engineering techniques to optimize AI model performance.
Work with cutting edge Generative AI models such as OpenAI (ChatGPT), Anthropic, Microsoft, and Meta (LLaMA).
Develop and deploy AI solutions using Python, Java, and frameworks like FastAPI, integrating with APIs and App Engine.
Implement and manage CI/CD pipelines for efficient and secure deployment.
Ensure secure handling of API keys, passwords, and tokens across environments.
Use Docker for containerization and GitHub for version control and collaborative development.
Conduct testing of AI agents and workflows to ensure reliability, accuracy, and performance.
Collaborate with cross-functional teams to identify business problems and apply AI-driven solutions.
Mentor Operations staff on AI solutioning, prompt design, and best practices.
Drive AI adoption across the Operations Practice through enablement sessions, bootcamps, and strategic initiatives.
Execute rapid response AI projects with a focus on delivery and measurable business impact.
Act as a subject matter expert and internal champion for AI capabilities.
 

Requirements:

Hands on experience in LangChain & LangGraph 1.2.x.
Hands on experience in MCP servers and MCP clients.
Multi-threading in Python: nice to have AsyncIO, Non-blocking programming.
Azure AI foundry stack: nice to have Azure AI search: semantic, keyword & hybrid search, Azure document intelligence.
Good understanding on agentic design patterns (workflows and multi agentic patterns – supervisor, sub agents and swarm)
OpenAI (ChatGPT), Anthropic, Microsoft, and Meta (LLaMA).
Docker, GitHub, Ansible, and Terraform.