Attention

R. Luger; Harish Kamath; Doug Finkbeiner; Purvi Goel; Adam Jermyn; Sam Zimmerman; Joshua Batson; Tom Conerly · Anthropic

An interactive tool for interrogating attention heads, released as the research output in its own right. Its central finding is methodological: a head's behaviour on the full data distribution rarely matches what a narrow task suggests.

Reframes the tool as the contribution, and supplies the concrete examples the field needs to attack attention decomposition.

High · Read the full article, 2026-08-06

Catherine Yeh; Yida Chen; Aoyu Wu; Cynthia Chen; Fernanda Viégas; Martin Wattenberg · Harvard University

Visualises a joint embedding of the query and key vectors a transformer uses to compute attention, which makes it possible to see global patterns across many input sequences rather than one prompt at a time.

Shifted attention visualisation from single-example to distribution-level — the exact move Anthropic's HeadVis names as its closest prior work three years later.

High · Read the arXiv abstract page in full, 2026-08-06. The live demo at attentionviz.com was not inspected — client-rendered, fetch returned an empty page shell.