AI Chatbot Evaluator (Small Business Owners)

Location: Remote (United States-based only)
Status: Project-based
Pay:

• $375 USD for completing 4 tasks (~2–3 hours total)
• $100 USD for each additional task completed beyond the initial 4
• Additional compensation may be provided based on total tasks completed

Benefits: Flexible schedule

Please note: To ensure eligibility for this project, applicants must currently reside in the United States and operate a small business with fewer than 10 employees.

Project Requirements:

• Fluent in English (reading and writing)
• You must have 3 hours available to complete the evaluation ASAP
• Must currently operate a small business (fewer than 10 employees)
• Must be based in the United States
• Strong attention to detail and ability to follow structured guidelines
• Comfortable following step-by-step instructions, using new online platforms, interacting with chatbot tools, uploading screenshots, and completing evaluation forms.

With Productive Playhouse, contributors can earn extra income on a flexible schedule while supporting mobile messaging data collection efforts that help improve spam detection and reduce unwanted messages.

The Project:

Productive Playhouse is seeking small business owners (10 employees or fewer) to participate in a paid AI chatbot evaluation study. The task involves interacting with multiple chatbot platforms, entering prompts, reviewing responses, following step-by-step instructions, and completing structured evaluation forms based on your experience. Participants may also be asked to log into a project-provided account and work within online platforms that may be new to them.

Some tasks may involve referencing your own business materials (e.g., documents or reports), which must be anonymized before use. All submissions will be reviewed and verified to ensure they meet quality standards before being approved for payment.

This is a flexible, remote, task-based project. Workload is limited to a one-time engagement.

To get started, please complete the short intake form below:

 https://forms.gle/uypuS2Q63jjhPUm77

Please note: Completing the intake form is required for consideration. Qualified participants will receive next steps after review.

Duties:

• Create a specific business prompt to test the AI. We provide a list of categories and examples to help you develop the prompt.
• Engage in conversations with four designated AI chatbots
• Use your own business files to test the AI's capabilities. Note: All files must be anonymized (remove sensitive personal identifiers) before use
• Complete an evaluation form for each chatbot following the interaction
• Upload screenshots and complete evaluation forms
• Deadline: All forms must be submitted within 2 days of your onboarding

Engagement Requirements:

• Must use your own device and internet connection
• Must follow all project guidelines and quality standards
• Only completed and qualified submissions will be eligible for payment
• Must complete the task within the expected timeframe after onboarding
• A project-specific Google account will be provided; no personal account is required
   

About Us: 

As a global data company, Productive Playhouse “PPH”, is pioneering our approach to language and data services, while incorporating their roots as a production company. Originally creating content to support children's language acquisition, our commitment to excellence, forward-thinking strategies, and world-wide cultural experience has proven key for delivering exceptional service.  

Originally founded as an educational production company, Productive Playhouse made a mark with our award winning children’s series, which taught fundamental subjects through engaging and effective programming. This early success paved the way for our evolution into a comprehensive data services provider.  

Since 2011, Productive Playhouse has expanded rapidly to offer an extensive suite of data services. Our current offerings include transcription, translation, linguistic analysis, rating, systems testing, localization, field and studio recording, language skill verification, and specialized data handling with a focus on sensitivity and diversity.  Our commitment to innovation means we continually enhance our service portfolio to meet the evolving needs of our clients.

At Productive Playhouse, we are proud of our reputation for addressing complex challenges with agility and delivering premium secure data solutions across diverse environments. Our dynamic team is dedicated to maintaining the highest standards and ensuring exceptional service every time. 
 

Disclaimer

The job description provided is designed to convey information essential to understanding the scope of the position and the general nature of the work performed. It is not intended to be an exhaustive list of duties, responsibilities, or qualifications associated with the job. Productive Playhouse reserves the right to modify or revise the job description as necessary

Productive Playhouse is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive work environment for all employees.  Employment with Productive Playhouse is at-will, meaning that either the employee or the employer can terminate the employment relationship at any time, with or without cause or notice.

All offers of employment at Productive Playhouse are contingent upon the candidate’s ability to provide valid documentation of identity and eligibility to work in the United States or relevant hiring location.  Productive Playhouse participates in E-Verify.

Productive Playhouse provides reasonable accommodation for qualified individuals with disabilities.  If you need assistance or accommodation due to a disability, please contact the Human Resources Department.

Powered by JazzHR