R. Luger; Harish Kamath; Doug Finkbeiner; Purvi Goel; Adam Jermyn; Sam Zimmerman; Joshua Batson; Tom Conerly · Anthropic
An interactive tool for interrogating attention heads, released as the research output in its own right. Its central finding is methodological: a head's behaviour on the full data distribution rarely matches what a narrow task suggests.
Reframes the tool as the contribution, and supplies the concrete examples the field needs to attack attention decomposition.
High · Read the full article, 2026-08-06
open full entry