QA AI Lead - Remote

The Dignify Solutions, LLC

  • Jersey City, NJ
  • 18 days ago
  • Remote

    Highlights

    Define and implement enterprise-wide AI testing and quality assurance strategies. Lead QA activities across AI product lifecycle from development through production deployment.

    Numbers & Facts

    LocationJersey City, NJ (
    Remote
    )

    Description

    • 10+ years of experience in Software Quality Assurance.
    • 5+ years of Test Automation experience.
    • 3+ years of experience testing AI/ML or Generative AI solutions.
    • Experience leading QA teams and enterprise testing programs.

    AI Quality Engineering Leadership

    • Define and implement enterprise-wide AI testing and quality assurance strategies.
    • Establish testing standards, governance, and best practices for AI/ML and Generative AI applications.
    • Lead QA activities across AI product lifecycle from development through production deployment.
    • Drive AI-powered quality engineering transformation initiatives.

    AI & Generative AI Testing

    • Validate LLMs, Chatbots, Copilots, and GenAI applications.
    • Develop test scenarios for:
    1. Prompt validation
    2. Hallucination detection
    3. Bias and fairness testing
    4. Security and privacy testing
    5. Performance and scalability testing
    6. Explainability validation
    • Define AI model quality metrics and monitoring standards.
    • Automation & Quality Engineering
    • Design and implement automated testing frameworks.
    • Integrate automated testing into CI/CD pipelines.
    • Establish AI-assisted test generation and test optimization strategies.
    • Drive shift-left and continuous testing practices.

    Similar Jobs

    See more jobs