leaderboards
Type: Concept
Public rankings (e.g., LM Arena) that can incentivize superficial optimization (length, emojis, formatting) over truthfulness and instruction-following.
Field: AI evaluation; incentives
Mentioned in 1 podcast episode
Who brought it up
- The $1B Al company training ChatGPT, Claude & Gemini on the path to responsible AGI | Edwin Chen on Lenny's Podcast — Lenny Rachitsky