Amazon partners with AVERI to launch third-party independent review of AI safety evaluation datasets.

Amazon and independent non-profit organization AVERI have partnered to conduct a third-party independent review of their internal safety evaluation datasets, focusing on the quality and rigor of the tests themselves. The review confirmed advantages such as comprehensive topic coverage, diverse testing methods, and low contamination risk, while also offering improvement suggestions including expanding language and style diversity, adding multi-step adversarial prompts, and maintaining evaluation freshness. Amazon has since updated its test sets, introduced a tiered difficulty framework, established a quarterly review mechanism, and expanded multilingual coverage.