Spiceorb
🚨 Hiring: AI Engineer – AI Evaluation & Model Risk Lead (FAANG)
📍 Location: Bellevue, WA – Need Local
💼 Experience: 2+ Years Relevant AI/ML Experience
🏢 FAANG Experience Mandatory
🔥 Primary Skill Set – Mandatory
🔹 Machine Learning Models / AI Tools – 2+ Years
🔹 Python – 2+ Years
🔹 Cloud Computing – 2+ Years
🔹 Data Analysis – 2+ Years
🔹 Data Modeling – 2+ Years
🔹 Model Evaluation & Risk Assessment
🔹 Model Tuning & Prompt Engineering
🔹 Model Cards & Documentation
🎯 Key Responsibilities
Own initial model-risk clearance and approved-use ratings that determine whether a model can be deployed
Lead ongoing model evaluation and re-clearance for model/version changes
Evaluate models against production or live-traffic scenarios and identify performance or behavioral drift
Author and maintain Model Cards documenting testing, approved use cases, limitations, and identified risks
Build and maintain AI model evaluation harnesses and test suites
Establish evaluation methodologies aligned with organizational AI Safety Standards
Partner with Cybersecurity teams, with Cyber owning security-focused red teaming
Evaluate AI models across Claude, OpenAI, Glean, Bedrock, cloud model platforms, and SaaS solutions
Analyze model behavior, performance, reliability, and risk across different use cases
Collaborate with Responsible AI and cross-functional teams to ensure effective AI integration
Support model tuning, prompt engineering, data analysis, and evaluation activities
Document evaluation outcomes and maintain an auditable record of model approvals
Identify additional opportunities to improve AI model evaluation and governance
Support other AI/ML initiatives and projects as assigned
🛠️ Technology / AI Ecosystem
Python | Machine Learning | AI/GenAI | Model Evaluation | Model Risk | Model Cards | Prompt Engineering | Model Tuning | Claude | OpenAI | Glean | Amazon Bedrock | Cloud Computing | Data Modeling | Data Analysis | Responsible AI
📩 Interested candidates: Please send your updated resume to rahul.singh@spiceorb.com
To apply for this job email your details to rahul.singh@spiceorb.com