Looking for Gen AI Tester at Bellevue, WA (Onsite)

Job Title : Gen AI Tester

Location : Bellevue, WA (Onsite)

Duration : 12 Months

 

Job Description :

Roles and Responsibilities:   

• Design and build end-to-end AI testing frameworks covering unit, functional, integration, and regression testing including automated test case generation and model output validation against defined quality benchmarks.
• Develop load and performance testing simulating high-concurrency scenarios to validate scalability, latency SLAs, and platform stability under peak load.
• Build LLM evaluation pipelines covering relevance, groundedness, and hallucination metrics integrated into CI/CD workflows to enforce automated quality gates before every model or agent deployment.
• Own regression testing strategy across the AI platform maintaining automated suites that validate agent behavior, RAG pipeline accuracy, and API contracts after every release to prevent quality degradation.

Must Have Skills:

·         Experience with LLM Evaluation frameworks like Promptfoo, DeepEval, Ragas etc

·         Handon experience with AI Automation frameworks using Python PyTest, Unittest

·         Experience with Load and performance testing using Locust, Jmeter etc.

Experience

• Overall IT experience: Minimum 12 years
• AI Experience- 4+ Years

Soft Skills

• Ability to work in fast-paced, multi-disciplinary, data-driven environments.
• Work closely with offshore teams with some overlap with IST.
• Excellent stakeholder management

 

 

Thanks & Regards

Bhavanesh Eamani

Lead Technical Recruiter

PH : 9724400073

Agile Enterprise Solutions Inc.

2591 Dallas Parkway Suite 300 Frisco, TX 75034

Email:  bhavanesh@aesincus.com  Website:  www.aesincus.com