OpenAI proposes complementary observability metrics beyond g-mean²
OpenAI has introduced two complementary metrics alongside g-mean². The pair-matched metric compares observability only across instances supported by multiple models, while the post-control metric simulates deployment risks after a monitor rejects an output. The original text notes that g-mean² scores may be influenced by differing subsets of tasks supported by each model and do not reflect the actual effectiveness of monitors as control mechanisms during deployment.
Return to original text
A short introduction is retained here; the full text from the source website is not reposted. For specific wording and subsequent updates, please refer to the original article.
Open AIHOT original