Job Title: AI Product Business Analyst
Work Location: Hartford, CT 06156
Contract duration: 12+ months
Interview Process (Is face to face required?): Yes
Nice to have skills
Experience in HR technology, learning technology, content creation platforms, or knowledge management solutions as a Business Analyst, Product Analyst, Product Owner, or equivalent role. Handson experience in building and executing specialized AI test cases, evaluating LLM outputs, prompt variations, and agentic workflows. Handson experience with prompt engineering, prompt optimization, and evaluation of AIgenerated content quality, accuracy, completeness, and consistency.
Experience designing e
Detailed Job Description
AI powered product focused, collaborating with business stakeholders, engineering, UX, and data science teams to gather requirements, create Jira user stories, manage product backlogs, define acceptance criteria, evaluate LLM based solutions, analyze AI performance metrics, execute product validation and drive continuous product improvements through Agile methodology.
Minimum years of experience: 8-10 years
Top 3 responsibilities you would expect the Subcon to shoulder and execute
Gather business requirements, create detailed Jira user stories, define acceptance criteria, and manage the product backlog while translating AI product requirements into actionable features and workflows.
Plan, execute, and monitor AILLM evaluations by designing test scenarios, validating model outpts, performing metrics, and driving continuous product quality improvements.
Collaborate with cross functional teams Engineering, UX, Data Science, and Business stakeholders to prioritize AL capabilities.