Bias and fairness audit providers
44 published entries state bias and fairness audit on their AI testing pages. Between them they name 9 AI product types.
A bias audit compares outcomes across groups and reports disparate impact.
bias audit: Measurement of whether a model's outcomes differ across demographic groups.Showing 44 of 44. Default order: coverage score, then name. How the score works.
| Rank | Company type | AI products (as stated) | Services | Verified | |||||
|---|---|---|---|---|---|---|---|---|---|
| 1 | DeviQA | Pure-play QA company | Poland, Warsaw | LLM applicationsAI agentsRecommender and ranking systemsPredictive ML modelsComputer visionVoice AI | 8 | 2010 | 16 | 2026-11-09 | |
| 2 | Abstracta | Pure-play QA company | United States, Jacksonville | LLM applicationsAI agentsPredictive ML models | 10 | 2008 | 15 | 2026-11-09 | |
| 2 | ImpactQA | Pure-play QA company | United States | LLM applicationsAI agentsComputer visionVoice AIRecommender and ranking systems | 9 | 15 | 2026-11-09 | ||
| 4 | QATestLab | Pure-play QA company | Cyprus | LLM applicationsAI agentsPredictive ML models | 10 | 14 | 2026-11-09 | ||
| 4 | TestingXperts | Pure-play QA company | United States | LLM applicationsAI agentsVoice AI | 10 | 14 | 2026-11-09 | ||
| 4 | Testlio | Crowdtesting platform | United States, Austin | LLM applicationsAI agentsPredictive ML modelsRecommender and ranking systems | 8 | 2012 | 14 | 2026-11-09 | |
| 4 | Testriq | Pure-play QA company | India, Mira-Bhayandar | LLM applicationsAI agentsPredictive ML models | 9 | 2010 | 14 | 2026-11-09 | |
| 10 | ITRex Group | IT services firm with a QA practice | United States, Sacramento | LLM applicationsAI agentsComputer visionPredictive ML modelsRecommender and ranking systems | 6 | 2009 | 13 | 2026-11-09 | |
| 11 | Fulminous Software | IT services firm with a QA practice | India, Jaipur | Voice AIAI agentsAutonomous and embedded AI | 7 | 2019 | 12 | 2026-11-09 | |
| 11 | QualityAI (formerly Qualitest) | Pure-play QA company | United States, Santa Clara | LLM applicationsAI agentsPredictive ML modelsRecommender and ranking systems | 7 | 12 | 2026-11-09 | ||
| 11 | SunTec India | Data and evaluation vendor | India, New Delhi | LLM applicationsDocument AIPredictive ML models | 7 | 1999 | 12 | 2026-11-09 | |
| 14 | QAwerk | Pure-play QA company | Ukraine, Kyiv | LLM applicationsAI agents | 7 | 2015 | 11 | 2026-11-09 | |
| 14 | Testrig Technologies | Pure-play QA company | United States, Dallas | Predictive ML models | 8 | 2015 | 11 | 2026-11-09 | |
| 18 | Indium Software | IT services firm with a QA practice | United States, Cupertino | AI agentsLLM applicationsRecommender and ranking systems | 6 | 10 | 2026-11-09 | ||
| 18 | KiwiQA | Pure-play QA company | Australia, Bella Vista | LLM applications | 7 | 2009 | 10 | 2026-11-09 | |
| 18 | Kualitatem | Pure-play QA company | United States, New York | Predictive ML models | 7 | 2010 | 10 | 2026-11-09 | |
| 18 | Shaip | Data and evaluation vendor | United States, New York | LLM applicationsAI agentsVoice AI | 6 | 10 | 2026-11-09 | ||
| 18 | Sparkout Tech | IT services firm with a QA practice | India, Coimbatore | Predictive ML models | 7 | 2017 | 10 | 2026-11-09 | |
| 23 | AppSierra | IT services firm with a QA practice | India, Noida | LLM applicationsAI agentsPredictive ML models | 5 | 9 | 2026-11-09 | ||
| 23 | BugRaptors | Pure-play QA company | India | Computer visionPredictive ML modelsVoice AI | 4 | 2016 | 9 | 2026-11-09 | |
| 23 | Chetu | IT services firm with a QA practice | United States, Sunrise | Predictive ML models | 6 | 2000 | 9 | 2026-11-09 | |
| 23 | Luxe Quality | Pure-play QA company | United States, McLean | Computer visionVoice AIPredictive ML models | 5 | 9 | 2026-11-09 | ||
| 29 | AIDX Tech | AI assurance and audit specialist | Singapore, Singapore | LLM applicationsAI agentsVoice AIComputer vision | 4 | 8 | 2026-11-09 | ||
| 29 | Frugal Testing | Pure-play QA company | India, Hyderabad | Voice AIComputer visionAutonomous and embedded AI | 4 | 8 | 2026-11-09 | ||
| 29 | SG Analytics | IT services firm with a QA practice | India, Pune | LLM applications | 5 | 2007 | 8 | 2026-11-09 | |
| 29 | TestMatick | Pure-play QA company | United States, New York | Recommender and ranking systemsPredictive ML models | 4 | 2009 | 8 | 2026-11-09 | |
| 34 | Centific | Data and evaluation vendor | United States, Redmond | AI agentsComputer vision | 4 | 7 | 2026-11-09 | ||
| 34 | Cognizant | IT services firm with a QA practice | United States, Teaneck | AI agentsVoice AIPredictive ML models | 4 | 7 | 2026-11-09 | ||
| 34 | Macgence | Data and evaluation vendor | India, Noida | Predictive ML models | 5 | 7 | 2026-11-09 | ||
| 34 | Qualitrix | Pure-play QA company | India, Bengaluru | Predictive ML models | 5 | 7 | 2026-11-09 | ||
| 34 | Resillion | Pure-play QA company | United Kingdom | Predictive ML models | 5 | 7 | 2026-11-09 | ||
| 40 | Appen | Data and evaluation vendor | Australia | LLM applications | 5 | 6 | 2026-11-09 | ||
| 40 | Fairly AI | AI assurance and audit specialist | Canada, Kitchener | LLM applicationsPredictive ML modelsAI agents | 3 | 6 | 2026-11-09 | ||
| 40 | Innodata | Data and evaluation vendor | United States, Ridgefield Park | LLM applicationsGenerative media | 4 | 6 | 2026-11-09 | ||
| 40 | Kainos | IT services firm with a QA practice | United Kingdom, Belfast | LLM applications | 3 | 1001-5000 | 6 | 2026-11-09 | |
| 50 | Digital Divide Data | Data and evaluation vendor | United States, New York | LLM applicationsVoice AI | 3 | 5 | 2026-11-09 | ||
| 50 | Knovel Engineering | IT services firm with a QA practice | Singapore, Singapore | LLM applications | 4 | 5 | 2026-11-09 | ||
| 50 | QAlified | Pure-play QA company | Uruguay, Montevideo | LLM applications | 3 | 5 | 2026-11-09 | ||
| 61 | Accenture | IT services firm with a QA practice | Ireland, Dublin | AI agents | 2 | 5001+ | 4 | 2026-11-09 | |
| 61 | Resolution Economics | United States, Los Angeles | Predictive ML models | 2 | 4 | 2026-11-09 | |||
| 61 | Snoopgame | Pure-play QA company | Estonia, Tallinn | Computer visionRecommender and ranking systems | 2 | 4 | 2026-11-09 | ||
| 61 | Trilateral Research | AI assurance and audit specialist | United Kingdom, London | Predictive ML models | 3 | 4 | 2026-11-09 | ||
| 61 | Welo Data | Data and evaluation vendor | United States | LLM applications | 3 | 4 | 2026-11-09 | ||
| 74 | APTMetrics | United States, Westport | Predictive ML models | 1 | 1995 | 3 | 2026-11-09 |
Product types covered by vendors stating this service
Count of entries on this page that state each product type.
| Product type | Bias and fairness audit |
|---|---|
| LLM applications | 25 |
| AI agents | 19 |
| Voice AI | 11 |
| Computer vision | 9 |
| Predictive ML models | 24 |
| Recommender and ranking systems | 8 |
| Generative media | 1 |
| Document AI | 1 |
| Autonomous and embedded AI | 2 |
Scope and standards referenced
Disparate impact across groups; NYC Local Law 144; EU AI Act Article 10.
- NYC Local Law 144: bias audit requirement for automated employment decision tools
- EU AI Act (Regulation 2024/1689): Article 9 risk management, Article 10 data governance, Article 43 conformity assessment
The directory lists which vendors state this service. It does not test whether a vendor applies these standards.
Related
Product types
Other services
Guides
Questions
What is an AI bias audit?
A bias audit measures whether a model's outcomes differ across groups such as sex, race or age, and reports the size of any difference. 44 published entries state bias and fairness audits.
How is an AI bias audit carried out?
The auditor defines the groups and outcomes to compare, collects or receives outcome data, computes metrics such as selection rates and impact ratios, and documents data limits and methods. Findings usually come with remediation suggestions and a plan for repeat audits.
When is an AI bias audit legally required?
In New York City, Local Law 144 requires an independent bias audit within one year before an automated employment decision tool is used for hiring or promotion, with a public summary of results. The EU AI Act asks providers of high-risk systems to examine data for possible biases under Article 10.
How should you read the results of an AI bias audit?
Look at which groups were compared, the metric used, the size of each gap and the data it was computed on. A small sample or missing group data limits what the result shows, and a good report states those limits.
What should you ask before hiring an AI bias auditor?
Ask whether the auditor is independent of the system's developer, which metrics and legal standards the audit follows, what data it needs from you, and whether the summary can be published if a law requires it.
What is an algorithmic audit, and how does it differ from a bias audit?
An algorithmic audit reviews a whole automated decision system: its purpose, data, accuracy, transparency, governance and impacts. A bias audit is a narrower measurement of outcome differences across groups and is often one part of an algorithmic audit.