Skip to content

Companies that test LLM applications

61 published entries state testing of LLM applications on their AI pages. They are headquartered in 18 countries and state 12 testing services between them.

LLM applications: Products built on a large language model: chat assistants, copilots, summarisers, RAG search.

Testing service
Company type
Country (HQ or delivery)

Showing 61 of 61. Default order: coverage score, then name. How the score works.

Entries on this page: Companies that test LLM applications
RankCompany typeAI products (as stated)ServicesVerified
1DeviQAPure-play QA companyPoland, Warsaw
LLM applicationsAI agentsRecommender and ranking systemsPredictive ML modelsComputer visionVoice AI
82010162026-11-09
2AbstractaPure-play QA companyUnited States, Jacksonville
LLM applicationsAI agentsPredictive ML models
102008152026-11-09
2ImpactQAPure-play QA companyUnited States
LLM applicationsAI agentsComputer visionVoice AIRecommender and ranking systems
9152026-11-09
4BetterQAPure-play QA companyRomania, Cluj-Napoca
LLM applicationsAI agentsVoice AI
92018142026-11-09
4QATestLabPure-play QA companyCyprus
LLM applicationsAI agentsPredictive ML models
10142026-11-09
4TestDevLabPure-play QA companyLatvia, Riga
LLM applicationsAI agentsVoice AIComputer visionPredictive ML modelsRecommender and ranking systemsAutonomous and embedded AI
52011142026-11-09
4TestingXpertsPure-play QA companyUnited States
LLM applicationsAI agentsVoice AI
10142026-11-09
4TestlioCrowdtesting platformUnited States, Austin
LLM applicationsAI agentsPredictive ML modelsRecommender and ranking systems
82012142026-11-09
4TestriqPure-play QA companyIndia, Mira-Bhayandar
LLM applicationsAI agentsPredictive ML models
92010142026-11-09
10ITRex GroupIT services firm with a QA practiceUnited States, Sacramento
LLM applicationsAI agentsComputer visionPredictive ML modelsRecommender and ranking systems
62009132026-11-09
11QualityAI (formerly Qualitest)Pure-play QA companyUnited States, Santa Clara
LLM applicationsAI agentsPredictive ML modelsRecommender and ranking systems
7122026-11-09
11SunTec IndiaData and evaluation vendorIndia, New Delhi
LLM applicationsDocument AIPredictive ML models
71999122026-11-09
14LionbridgeData and evaluation vendorUnited States, Waltham
LLM applicationsVoice AIComputer visionRecommender and ranking systems
51996112026-11-09
14QA MadnessPure-play QA companyPoland, Warsaw
LLM applicationsAI agentsRecommender and ranking systems
7112026-11-09
14QAwerkPure-play QA companyUkraine, Kyiv
LLM applicationsAI agents
72015112026-11-09
18Indium SoftwareIT services firm with a QA practiceUnited States, Cupertino
AI agentsLLM applicationsRecommender and ranking systems
6102026-11-09
18KiwiQAPure-play QA companyAustralia, Bella Vista
LLM applications
72009102026-11-09
18ShaipData and evaluation vendorUnited States, New York
LLM applicationsAI agentsVoice AI
6102026-11-09
23AppSierraIT services firm with a QA practiceIndia, Noida
LLM applicationsAI agentsPredictive ML models
592026-11-09
23CodoidPure-play QA companyIndia, Chennai
LLM applicationsAI agents
5201292026-11-09
23QASourcePure-play QA companyUnited States, Pleasanton
LLM applicationsAI agents
5200292026-11-09
29AIDX TechAI assurance and audit specialistSingapore, Singapore
LLM applicationsAI agentsVoice AIComputer vision
482026-11-09
29ApplauseCrowdtesting platformUnited States
LLM applicationsAI agentsVoice AI
482026-11-09
29SG AnalyticsIT services firm with a QA practiceIndia, Pune
LLM applications
5200782026-11-09
40AppenData and evaluation vendorAustralia
LLM applications
562026-11-09
40Fairly AIAI assurance and audit specialistCanada, Kitchener
LLM applicationsPredictive ML modelsAI agents
362026-11-09
40InnodataData and evaluation vendorUnited States, Ridgefield Park
LLM applicationsGenerative media
462026-11-09
40KainosIT services firm with a QA practiceUnited Kingdom, Belfast
LLM applications
31001-500062026-11-09
40Pen Test PartnersSecurity firm with AI testingUnited Kingdom, Buckingham
LLM applicationsAI agents
1201062026-11-09
40QualysecSecurity firm with AI testingIndia, Bhubaneswar
LLM applicationsAI agents
362026-11-09
40ScienceSoftIT services firm with a QA practiceUnited States, McKinney
LLM applicationsAI agents
2198962026-11-09
40Software SecuredSecurity firm with AI testingCanada, Ottawa
LLM applicationsAI agents
362026-11-09
50Artifice SecuritySecurity firm with AI testingUnited States, Denver
LLM applicationsAI agents
2201952026-11-09
50Bishop FoxSecurity firm with AI testingUnited States, Tempe
LLM applicationsAI agents
252026-11-09
50BridewellSecurity firm with AI testingUnited Kingdom, Reading
LLM applications
2201352026-11-09
50DeepStrikeSecurity firm with AI testingUnited States
LLM applications
2201652026-11-09
50Digital Divide DataData and evaluation vendorUnited States, New York
LLM applicationsVoice AI
352026-11-09
50HackerOneSecurity firm with AI testingUnited States, San Francisco
LLM applicationsAI agents
352026-11-09
50Knovel EngineeringIT services firm with a QA practiceSingapore, Singapore
LLM applications
452026-11-09
50PraetorianSecurity firm with AI testingUnited States, Austin
LLM applicationsAI agents
352026-11-09
50QAlifiedPure-play QA companyUruguay, Montevideo
LLM applications
352026-11-09
50Redbot SecuritySecurity firm with AI testingUnited States, Denver
LLM applicationsAI agents
252026-11-09
617ASecuritySecurity firm with AI testingIreland, Dublin
LLM applicationsAI agents
242026-11-09
61DataArtIT services firm with a QA practiceUnited States, New York
LLM applications
1199742026-11-09
61IBA GroupIT services firm with a QA practiceCzech Republic, Prague
LLM applicationsAI agents
142026-11-09
61IBMIT services firm with a QA practiceUnited States, Armonk
LLM applications
2191142026-11-09
61NexigenIT services firm with a QA practiceUnited States, Newport
LLM applicationsAI agents
242026-11-09
61TolokaData and evaluation vendorNetherlands
LLM applicationsAI agents
242026-11-09
61VaadataSecurity firm with AI testingFrance, Lyon
LLM applicationsAI agents
242026-11-09
61Welo DataData and evaluation vendorUnited States
LLM applications
342026-11-09
61WorkNestUnited Kingdom, London
LLM applicationsAI agents
242026-11-09
74Anvil SecureSecurity firm with AI testingUnited States, Seattle
LLM applications
232026-11-09
74BreachLockSecurity firm with AI testingUnited States, New York
LLM applications
132026-11-09
74BugcrowdSecurity firm with AI testingUnited States, San Francisco
LLM applications
1201232026-11-09
74CrowdStrikeSecurity firm with AI testingUnited States, Austin
LLM applications
232026-11-09
74DionachSecurity firm with AI testingUnited Kingdom, Oxford
LLM applications
232026-11-09
74NetSPISecurity firm with AI testingUnited States, Minneapolis
LLM applications
232026-11-09
74SamaData and evaluation vendorUnited States, San Francisco
LLM applicationsGenerative media
132026-11-09
74TesvanPure-play QA companyArmenia, Sevan
LLM applications
132026-11-09
74VeriServePure-play QA companyJapan, Tokyo
LLM applications
232026-11-09
86SynackSecurity firm with AI testingUnited States, Redwood City
LLM applications
122026-11-09

Which services listed vendors state for LLM applications

Count of entries on this page that also state each service. Built from the data at build time.

Services stated by entries testing LLM applications
Product typeLLM output evaluationRAG pipeline validationPrompt and model regression testingRed teaming and adversarial testingAI security penetration testingBias and fairness auditCompliance and conformity assessment supportML model validationTraining data and labeling QAPerformance and latency testingConversational flow testingProduction monitoring and drift testing
LLM applications34141445392512141012918

Questions

What is tested in an AI chatbot?

Intent recognition, multi-turn context, factual accuracy, tone, refusals, escalation to humans, and behaviour on each channel. Security checks look for prompt injection and leakage of private data.

What does LLM testing cover?

LLM testing covers answer quality and factual accuracy, hallucination, retrieval quality for RAG systems, regression across prompt and model versions, adversarial robustness, latency and cost. 36 published entries state LLM output evaluation.

How is an LLM application tested before release?

Teams build an evaluation set from real use cases, score answers against a rubric, run adversarial tests and load tests, and set acceptance thresholds. The same set is rerun after every prompt, model or data change.

How do testers handle non-deterministic LLM output?

They assert on meaning instead of exact text, run each case several times and use score thresholds. Settings such as temperature are fixed during tests, and results are tracked as rates across runs.

How is a RAG pipeline tested?

Retrieval and generation are tested separately: first whether the right passages are retrieved, then whether the answer stays grounded in them and cites them correctly. Changes to chunking or the index are followed by a regression run. 14 published entries state RAG pipeline validation.

Which AI systems should be red teamed: models, applications or agents?

All three, at different depths. Model red teaming tests behaviour; application red teaming adds the system prompt, retrieval and user interface; agent red teaming adds tools and permissions, where a successful attack can cause actions.

Request a listing or correction