AI Data Annotation Specialist

BC Forward

Charlotte, NC

Apply

JOB DETAILS

SALARY

$56–$56.08 Per Hour

JOB TYPE

Full-time

SKILLS

Agile Programming Methodologies, Artificial Intelligence (AI), Benchmarking, Business Solutions, Calibration, Communication Skills, Data Science, Data Sets, Detail Oriented, Diversity, Educational Technology, Fortune 500 Customers, Government, Information Retrieval, Information Technology Consulting, Metadata, Metrics, Multiplatform/Cross-Platform, Natural Language Processing (NLP), Operations Processes, Operations Research, Organizational Skills, Quality Assurance, Scrum Project Management and Software Development, Semantic Search, Software Engineering, Spreadsheets, Taxonomies, Time Management, Training Data Sets, Workflow Analysis, Writing Skills

LOCATION

Charlotte, NC

POSTED

12 days ago

Job Title: Application Programmer IIILocation: Charlotte, NCDuration: Contract - 12 monthsPay Range: $56.08/hr (W2)Job ID: 373918About BCforwardBCforward is a leading global IT consulting and workforce solutions firm providing services and support to Fortune 500 and government clients. Founded in 1998, BCforward has grown with our customers needs into a full-service business solutions provider. With delivery centers and offices across North America and India, we take pride in building long-term relationships and delivering excellence through innovation, collaboration, and integrity.Job DescriptionWe are seeking an AI Data Annotation Training Data Contractor to join our dynamic team. The ideal candidate will have strong experience in AI/ML data labeling, QA, and evaluation across NLP, information retrieval, entity extraction, routing/classification, semantic search, and RAG/LLM applications, and a proven ability to deliver accurate, consistent annotations and evaluation datasets at scale.Responsibilities:Annotate and label large datasets for AI/ML training and evaluation tasks across text, tabular, and retrieval workflows.Create labels for query classification, intent detection, entity and time extraction, metric identification, semantic similarity, relevance ranking, and document retrieval quality.Tag and classify user queries, documents, entities, metadata, tool routing, structured vs. unstructured query type, human preference, and LLM response quality.Perform QA reviews to ensure consistency, accuracy, completeness, and adherence to acceptance criteria; escalate ambiguities and edge cases.Participate in inter-annotator agreement, calibration sessions, and feedback loops to refine dataset quality.Assist in building evaluation datasets, benchmark suites, and golden sets for classifiers, retrieval systems, and LLM generation quality.Review AI outputs, provide structured scoring and feedback, and help identify failure modes, hallucinations, routing issues, and retrieval gaps.Follow detailed annotation specifications and operational procedures; document decisions, edge cases, and standards.Support taxonomy and schema refinement; organize datasets, metadata, and labeling workflows across tools and platforms.Work effectively within Agile development practices and collaborate with data science, ML engineering, and platform teams.Required Skills & Qualifications:Bachelor's degree or equivalent practical experience.Experience with data annotation, data labeling, QA, research operations, or analytical workflows.Ability to follow complex technical instructions and detailed labeling guidelines with high accuracy.Strong attention to detail, organizational skills, and written communication.Comfort with large datasets, structured processes, spreadsheets, and labeling interfaces.Ability to work independently, manage priorities, and meet deadlines in a fast-paced environment.Preferred Skills:Familiarity with RAG, LLM evaluation, semantic search, and information retrieval concepts.Experience working in Agile/Scrum settings and collaborating with ML engineering teams.Why BCforward?At BCforward, we believe in advancing lives and careers. When you join our team, you gain access to:Competitive compensation and benefits.Opportunities for growth with global clients.A supportive, inclusive culture that values innovation and people.Exposure to cutting-edge technologies and projects.About Our CommitmentBCforward is an equal opportunity employer. We value diversity and are committed to creating an inclusive environment for all employees. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, sexual orientation, gender identity, national origin, age, disability, or veteran status.Interested? Apply Now!If this sounds like the right opportunity for you, please apply with your most recent resume.

AI Data Annotation Specialist

BC Forward

Charlotte, NC

About the Company

BC Forward

Similar Job Searches