Skip to content

Training data and labeling QA providers

25 published entries state training data and labeling QA on their AI testing pages. Between them they name 8 AI product types.

Audits of training and evaluation data: label accuracy sampling, leakage checks and golden set maintenance.

golden set: A fixed set of inputs with approved outputs used for regression checks.
AI product type
Company type
Country (HQ or delivery)

Showing 25 of 25. Default order: coverage score, then name. How the score works.

Entries on this page: Training data and labeling QA providers
RankCompany typeAI products (as stated)ServicesVerified
1DeviQAPure-play QA companyPoland, Warsaw
LLM applicationsAI agentsRecommender and ranking systemsPredictive ML modelsComputer visionVoice AI
82010162026-11-09
2AbstractaPure-play QA companyUnited States, Jacksonville
LLM applicationsAI agentsPredictive ML models
102008152026-11-09
2ImpactQAPure-play QA companyUnited States
LLM applicationsAI agentsComputer visionVoice AIRecommender and ranking systems
9152026-11-09
4QATestLabPure-play QA companyCyprus
LLM applicationsAI agentsPredictive ML models
10142026-11-09
4TestingXpertsPure-play QA companyUnited States
LLM applicationsAI agentsVoice AI
10142026-11-09
4TestriqPure-play QA companyIndia, Mira-Bhayandar
LLM applicationsAI agentsPredictive ML models
92010142026-11-09
11QualityAI (formerly Qualitest)Pure-play QA companyUnited States, Santa Clara
LLM applicationsAI agentsPredictive ML modelsRecommender and ranking systems
7122026-11-09
11SunTec IndiaData and evaluation vendorIndia, New Delhi
LLM applicationsDocument AIPredictive ML models
71999122026-11-09
14LionbridgeData and evaluation vendorUnited States, Waltham
LLM applicationsVoice AIComputer visionRecommender and ranking systems
51996112026-11-09
14Testrig TechnologiesPure-play QA companyUnited States, Dallas
Predictive ML models
82015112026-11-09
18KualitatemPure-play QA companyUnited States, New York
Predictive ML models
72010102026-11-09
18Sparkout TechIT services firm with a QA practiceIndia, Coimbatore
Predictive ML models
72017102026-11-09
23BugRaptorsPure-play QA companyIndia
Computer visionPredictive ML modelsVoice AI
4201692026-11-09
23Luxe QualityPure-play QA companyUnited States, McLean
Computer visionVoice AIPredictive ML models
592026-11-09
29Frugal TestingPure-play QA companyIndia, Hyderabad
Voice AIComputer visionAutonomous and embedded AI
482026-11-09
29SG AnalyticsIT services firm with a QA practiceIndia, Pune
LLM applications
5200782026-11-09
29TestMatickPure-play QA companyUnited States, New York
Recommender and ranking systemsPredictive ML models
4200982026-11-09
34CognizantIT services firm with a QA practiceUnited States, Teaneck
AI agentsVoice AIPredictive ML models
472026-11-09
34MacgenceData and evaluation vendorIndia, Noida
Predictive ML models
572026-11-09
34MosChipIT services firm with a QA practiceIndia, Hyderabad
AI agentsAutonomous and embedded AI
3199972026-11-09
34ResillionPure-play QA companyUnited Kingdom
Predictive ML models
572026-11-09
40QA MentorPure-play QA companyUnited States, New York
Computer visionVoice AI
2201062026-11-09
40TaskUsData and evaluation vendorUnited States, New Braunfels
AI agentsAutonomous and embedded AI
35001+62026-11-09
61Resolution EconomicsUnited States, Los Angeles
Predictive ML models
242026-11-09
61Trilateral ResearchAI assurance and audit specialistUnited Kingdom, London
Predictive ML models
342026-11-09

Product types covered by vendors stating this service

Count of entries on this page that state each product type.

Product types stated by entries offering Training data and labeling QA
Product typeTraining data and labeling QA
LLM applications10
AI agents10
Voice AI9
Computer vision7
Predictive ML models17
Recommender and ranking systems5
Generative media0
Document AI1
Autonomous and embedded AI3

Scope and standards referenced

Dataset audits, label accuracy sampling, leakage checks.

The directory lists which vendors state this service. It does not test whether a vendor applies these standards.

Request a listing or correction