reward hacking
Type: Concept
Model behavior that exploits reward signals to achieve high scores without truly solving the intended task.
Field: AI safety; reinforcement learning
Mentioned in 1 podcast episode
Who brought it up
- The $1B Al company training ChatGPT, Claude & Gemini on the path to responsible AGI | Edwin Chen on Lenny's Podcast — Lenny Rachitsky