Crowdtesting platforms
3 published entries are classed as crowdtesting platform: managed crowd of testers with an AI or GenAI testing service. They are headquartered in 2 countries.
Showing 3 of 3. Default order: coverage score, then name. How the score works.
| Rank | Company type | AI products (as stated) | Services | Verified | |||||
|---|---|---|---|---|---|---|---|---|---|
| 4 | Testlio | Crowdtesting platform | United States, Austin | LLM applicationsAI agentsPredictive ML modelsRecommender and ranking systems | 8 | 2012 | 14 | 2026-11-09 | |
| 29 | Applause | Crowdtesting platform | United States | LLM applicationsAI agentsVoice AI | 4 | 8 | 2026-11-09 | ||
| 74 | Testbirds | Crowdtesting platform | Germany, Munich | Voice AI | 1 | 3 | 2026-11-09 |
What this company type states it tests
Product types by service, counted over the entries on this page.
| Product type | LLM output evaluation | RAG pipeline validation | Prompt and model regression testing | Red teaming and adversarial testing | AI security penetration testing | Bias and fairness audit | Compliance and conformity assessment support | ML model validation | Training data and labeling QA | Performance and latency testing | Conversational flow testing | Production monitoring and drift testing |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| LLM applications | 2 | 2 | 2 | 2 | 0 | 1 | 0 | 1 | 0 | 0 | 1 | 1 |
| AI agents | 2 | 2 | 2 | 2 | 0 | 1 | 0 | 1 | 0 | 0 | 1 | 1 |
| Voice AI | 1 | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 0 |
| Computer vision | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| Predictive ML models | 1 | 1 | 1 | 1 | 0 | 1 | 0 | 1 | 0 | 0 | 1 | 1 |
| Recommender and ranking systems | 1 | 1 | 1 | 1 | 0 | 1 | 0 | 1 | 0 | 0 | 1 | 1 |
| Generative media | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| Document AI | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| Autonomous and embedded AI | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
HQ countries of this type
- United States 2
- Germany 1