A benchmark task can defeat a capable system and still tell us little about how systems differ. Three tasks from our security evaluation show what pass rates conceal, and why an unexpected result can
The Measure of Hard but Fair
A benchmark task can defeat a capable system and still tell us little about how systems differ. Three tasks from our security evaluation show what pass rates conceal, and why an unexpected result can