Work Location: Hartford, CT 6156
Vendor Rate: $75/hr
Contract duration: 12months
Target Start Date: 21 Jul 2026
Job Details:
Nice to have skills
Experience in HR technology, learning technology, content creation platforms, or knowledge management solutions as a Business Analyst, Product Analyst, Product Owner, or equivalent role. Handson experience in building and executing specialized AI test cases, evaluating LLM outputs, prompt variations, and agentic workflows. Handson experience with prompt engineering, prompt optimization, and evaluation of AIgenerated content quality, accuracy, completeness, and consistency.
Experience designing e
Detailed Job Description
AI powered product focused, collaborating with business stakeholders, engineering, UX, and data science teams to gather requirements, create Jira user stories, manage product backlogs, define acceptance criteria, evaluate LLM based solutions, analyze AI performance metrics, execute product validation and drive continuous product improvements through Agile methodology.
Minimum years of experience
8-10 years
Top 3 responsibilities you would expect the Subcon to shoulder and execute
Gather business requirements, create detailed Jira user stories, define acceptance criteria, and manage the product backlog while translating AI product requirements into actionable features and workflows.
Plan, execute, and monitor AILLM evaluations by designing test scenarios, validating model outpts, performing metrics, and driving continuous product quality improvements.
Collaborate with crossfunctional teamsEngineering, UX, Data Science, and Business stakeholders to prioritize AL capabiliti
Interview Process (Is face to face required?)
Yes
Project Code: Caremark Hartford 2026 TnM DCG HINJ3STP