INTERP ATLAS

makes visible

Architecture

1 entry

2024 (1)

IA-009

Transformer Explainer is showing , about .

Aeree Cho; Grace C. Kim; Alexander Karpekov; Alec Helbling; Zijie J. Wang; Seongmin Lee; Benjamin Hoover; Duen Horng (Polo) Chau · Georgia Institute of Technology (Polo Club of Data Science)

An interactive tool that runs a live GPT-2 instance in your browser and visualises every stage of the forward pass — embeddings, attention, MLP, output probabilities — updating as you type your own text.

The most accessible route into transformer internals that exists: no installation, no GPU, no prior knowledge. That is a different kind of contribution from any research result in this ledger, and arguably a wider-reaching one.

HighRead the arXiv abstract page in full, 2026-08-06. The live tool itself was not inspected — it is client-rendered and the fetch returned an empty page shell.

open full entry