QA Lead - AI/ML

TechDigital

  • Bolingbrook, IL
  • 27 days ago

    Highlights

    The AI/ML Test Lead will own endtoend quality assurance for AIdriven solutions across Ulta's Enterprise AI.This role is responsible for defining and executing an Enterprise AI testing strategy , ensuring functional correctness, data accuracy, AI output quality, robustness, performance, and Responsible AI compliance . The role blends handson testing leadership , AI/MLspecific validation , and onsite stakeholder collaboration , working closely with Product Owners, AI Engineering Leads and Data teams.

    Numbers & Facts

    LocationBolingbrook, IL
    IndustryOther/Not Classified
    Company Size100 to 499 employees

    Description

    E-commerce domain exp. is mandatory.
    Job Description:
    The AI/ML Test Lead will own endtoend quality assurance for AIdriven solutions across Ulta's Enterprise AI.This role is responsible for defining and executing an Enterprise AI testing strategy, ensuring functional correctness, data accuracy, AI output quality, robustness, performance, and Responsible AI compliance.
    The role blends handson testing leadership, AI/MLspecific validation, and onsite stakeholder collaboration, working closely with Product Owners, AI Engineering Leads and Data teams.
    Required Skills & Experience-
    Core QA & Testing Experience
    • 10+ years of experience in QA / Testing roles, with leadership responsibility
    • Strong experience defining test strategy, test plans, and execution ownership
    • Experience testing dataheavy and analyticsdriven systems
    AI / ML / Data Testing Skills
    • Handson experience testing AI/ML or LLMbased solutions
    • Strong understanding of:
      • Data validation and KPI testing
      • AI output correctness and consistency
      • Promptbased and agentbased systems
    • Familiarity with AI evaluation metrics (accuracy, error rate, hallucination rate, relevance)

    Similar Jobs

    See more jobs