Benchmark Gaming in AI: InfoSec Alliance Warns of Leaderboard Risks—and How to Build Secure Evaluations
Public AI leaderboards now shape marketing narratives, investor decks, and even enterprise procurement decisions. A few percentage points on a benchmark can swing budgets and headlines. That visibility creates powerful incentives to optimize for the test rather than the task—and bad actors are noticing. In a May 2026 advisory, the InfoSec Alliance warned that “benchmark…
