Sign upLog in

Quality Assurance Analyst - Conversational AI Testing

Priwils, Inc

Adelphi, MD

Apply
JOB DETAILS
JOB TYPE
Full-time
SKILLS
Acceptance Testing, Algorithms, Analysis Skills, Artificial Intelligence (AI), Artificial Intelligence (AI) Natural Language, Best Practices, Bug Tracking/Defect Management, Communication Skills, Computer Science, Computer Security, Conversation Engine, Cross-Functional, Customer Satisfaction, Customer/Client Research, Data Modeling, Data Quality, Debugging Skills, Establish Priorities, Functional Testing, ISTQB Foundation, Information Technology & Information Systems, Integration Testing, Machine Learning, Microsoft Product Family, Natural Language Processing (NLP), Performance Analysis, Performance Management, Performance Metrics, Performance Modeling, Performance Testing, Problem Solving Skills, Product Backlog, Product Demonstration, Product Design, Quality Assurance, Quality Assurance Methodology, Reporting Skills, Resource Utilization, Software Testing, Standard Operating Procedures (SOP), Team Player, Test Case, Test Data, Test Design, Test Strategy, Test Tools, Testing, Trend Analysis, Usability Testing, User Interface/Experience (UI/UX), Work From Home
LOCATION
Adelphi, MD
POSTED
4 days ago
Summary
We are seeking a skilled Quality Assurance Analyst to join our team and support testing activities for Kore AI's conversational AI platform. The ideal candidate will have a strong background in software testing, with a focus on AI and natural language processing technologies. The resource will report to the Senior Director, Analysis, Change & Quality and will follow the best practices and standard operating procedures established by the quality assurance team.

Responsibilities
  • Define functional and non-functional test strategies for the conversational AI platform.
  • Collaborate with AI developers and product owner to design comprehensive test cases covering various user scenarios, edge cases, and potential failure points.
  • This is a Remote (work from home) position.
  • Conduct rigorous testing of conversational AI models, including:
    • Functional testing to verify correct behavior, assess the accuracy, relevance, and coherence of AI-generated responses.
    • Performance testing to evaluate response times, system load, and resource utilization.
    • Usability testing to assess the user experience and identify areas for improvement.
    • Coordinate security testing with the Information Technology Security team to identify and mitigate potential vulnerabilities.
    • Integration testing to ensure the product is integrated with various platforms and that data integrity is maintained between various back-end systems.
    • Coordinate with cross-functional quality assurance resources to conduct end to end testing between other systems/platforms.
  • Generate detailed reports on test executions, including bug reports, performance metrics, and user experience insights.
  • Analyze test results to identify trends, patterns, and areas requiring improvement and work with the product owner for prioritization in the product backlog.
  • Track and manage bug resolution and feature enhancements.
  • Provide actionable feedback to AI developers to improve model performance, accuracy, and user satisfaction.
  • Collaborate with the team to refine training data, adjust model parameters, and optimize algorithms.
  • Own User Acceptance Testing (UAT) and facilitate by providing demos and test data of the product to the UAT testers.
  • Keep up to date with the latest developments in conversational AI, natural language processing, and machine learning.
  • Research and explore new testing methodologies and tools to enhance the QA process.

Requirements
  • Bachelor’s degree in computer science, information technology, or related field.
  • At least 5 years of experience in software testing and quality assurance methodologies.
  • Knowledge of AI and machine learning concepts, particularly in natural language processing.
  • Expertise in testing conversational AI or chatbot systems.
  • Excellent analytical and problem-solving abilities.
  • Strong communication and collaboration skills.

Preferred Qualifications
  • Experience in testing Chatbots such as Microsoft Bot and Kore AI platform.
  • Certifications in software testing or AI (e.g., ISTQB, AI Testing certification).

 

Powered by JazzHR

About the Company

P

Priwils, Inc