Prompt and model regression testing providers
17 published entries state prompt and model regression testing on their AI testing pages. Between them they name 7 AI product types.
Repeated runs of a golden set after each prompt or model change, with assertions that tolerate non-deterministic output.
golden set: A fixed set of inputs with approved outputs used for regression checks.Showing 17 of 17. Default order: coverage score, then name. How the score works.
| Rank | Company type | AI products (as stated) | Services | Verified | |||||
|---|---|---|---|---|---|---|---|---|---|
| 2 | Abstracta | Pure-play QA company | United States, Jacksonville | LLM applicationsAI agentsPredictive ML models | 10 | 2008 | 15 | 2026-11-09 | |
| 2 | ImpactQA | Pure-play QA company | United States | LLM applicationsAI agentsComputer visionVoice AIRecommender and ranking systems | 9 | 15 | 2026-11-09 | ||
| 4 | BetterQA | Pure-play QA company | Romania, Cluj-Napoca | LLM applicationsAI agentsVoice AI | 9 | 2018 | 14 | 2026-11-09 | |
| 4 | QATestLab | Pure-play QA company | Cyprus | LLM applicationsAI agentsPredictive ML models | 10 | 14 | 2026-11-09 | ||
| 4 | TestDevLab | Pure-play QA company | Latvia, Riga | LLM applicationsAI agentsVoice AIComputer visionPredictive ML modelsRecommender and ranking systemsAutonomous and embedded AI | 5 | 2011 | 14 | 2026-11-09 | |
| 4 | Testlio | Crowdtesting platform | United States, Austin | LLM applicationsAI agentsPredictive ML modelsRecommender and ranking systems | 8 | 2012 | 14 | 2026-11-09 | |
| 14 | QA Madness | Pure-play QA company | Poland, Warsaw | LLM applicationsAI agentsRecommender and ranking systems | 7 | 11 | 2026-11-09 | ||
| 14 | QAwerk | Pure-play QA company | Ukraine, Kyiv | LLM applicationsAI agents | 7 | 2015 | 11 | 2026-11-09 | |
| 14 | Testrig Technologies | Pure-play QA company | United States, Dallas | Predictive ML models | 8 | 2015 | 11 | 2026-11-09 | |
| 18 | KiwiQA | Pure-play QA company | Australia, Bella Vista | LLM applications | 7 | 2009 | 10 | 2026-11-09 | |
| 18 | Kualitatem | Pure-play QA company | United States, New York | Predictive ML models | 7 | 2010 | 10 | 2026-11-09 | |
| 18 | Shaip | Data and evaluation vendor | United States, New York | LLM applicationsAI agentsVoice AI | 6 | 10 | 2026-11-09 | ||
| 23 | Chetu | IT services firm with a QA practice | United States, Sunrise | Predictive ML models | 6 | 2000 | 9 | 2026-11-09 | |
| 23 | Codoid | Pure-play QA company | India, Chennai | LLM applicationsAI agents | 5 | 2012 | 9 | 2026-11-09 | |
| 23 | QASource | Pure-play QA company | United States, Pleasanton | LLM applicationsAI agents | 5 | 2002 | 9 | 2026-11-09 | |
| 29 | Applause | Crowdtesting platform | United States | LLM applicationsAI agentsVoice AI | 4 | 8 | 2026-11-09 | ||
| 40 | Appen | Data and evaluation vendor | Australia | LLM applications | 5 | 6 | 2026-11-09 |
Product types covered by vendors stating this service
Count of entries on this page that state each product type.
| Product type | Prompt and model regression testing |
|---|---|
| LLM applications | 14 |
| AI agents | 12 |
| Voice AI | 5 |
| Computer vision | 2 |
| Predictive ML models | 7 |
| Recommender and ranking systems | 4 |
| Generative media | 0 |
| Document AI | 0 |
| Autonomous and embedded AI | 1 |
Scope and standards referenced
Golden sets, non-deterministic assertions, repeated runs, version diffs.
The directory lists which vendors state this service. It does not test whether a vendor applies these standards.