E-commerce domain exp. is mandatory.Job Description: The
AI/ML Test Lead will own
endtoend quality assurance for AIdriven solutions across Ulta's Enterprise AI.This role is responsible for defining and executing an
Enterprise AI testing strategy, ensuring
functional correctness, data accuracy, AI output quality, robustness, performance, and Responsible AI compliance.
The role blends
handson testing leadership,
AI/MLspecific validation, and
onsite stakeholder collaboration, working closely with Product Owners, AI Engineering Leads and Data teams.
Required Skills & Experience-Core QA & Testing Experience- 10+ years of experience in QA / Testing roles, with leadership responsibility
- Strong experience defining test strategy, test plans, and execution ownership
- Experience testing dataheavy and analyticsdriven systems
AI / ML / Data Testing Skills- Handson experience testing AI/ML or LLMbased solutions
- Strong understanding of:
- Data validation and KPI testing
- AI output correctness and consistency
- Promptbased and agentbased systems
- Familiarity with AI evaluation metrics (accuracy, error rate, hallucination rate, relevance)