modality
language
9 entries
2026 (1)
IA-005HeadVis is a scatter plotA graph where each point represents a pair of values, showing the relationship between two sets of numbers on a coordinate plane.A graph of paired numerical values, with one variable on the horizontal axis and the corresponding value of a second variable on the vertical axis, used to reveal relationships or association between the variables.glossary showing attentionHow the model decides which earlier words matter when it is working on the current one.Which positions a model attends to, and how strongly.glossary, about induction-headsParts of the model that spot a pattern earlier in the text and continue it.Attention heads that continue a pattern seen earlier in the context.glossary, polysemanticityOne part of the model doing several unrelated jobs at once.A single component responding to several unrelated concepts.glossary and attention-headsThe parts that decide which earlier words matter for the next one.What an attention head does, on a chosen task or across the full data distribution.glossary.
2025 (1)
IA-004On the Biology of a Large Language Model is a node-link graphDots joined by lines, showing what connects to what.Nodes joined by edges, showing what connects to or causes what.glossary showing circuitsA chain of parts inside the model that work together to do one job.Connected components and the paths between them.glossary, about planningThe model deciding where a sentence is going before it writes it.Selecting a future output before generating the text that leads to it.glossary, hallucinationThe model stating something confidently when it has nothing to base it on.Producing confident content for which the model has no basis.glossary, jailbreakGetting a model to do something it was trained to refuse.Circumventing a model's trained refusals.glossary and unfaithful-reasoningThe explanation a model gives not matching the reasoning it actually did.Stated reasoning that does not correspond to the computation actually performed.glossary.
2024 (4)
IA-009Transformer Explainer is a flow diagramBoxes joined by arrows, showing what happens in what order.Boxes and arrows showing a process or structure in sequence.glossary showing architectureThe shape of the model itself: what parts it has, and the order they run in.The model's structure rather than anything it learned.glossary, about attention-headsThe parts that decide which earlier words matter for the next one.What an attention head does, on a chosen task or across the full data distribution.glossary.
IA-011TalkTuner is a dashboardA single screen putting several different readouts side by side.Several visual forms arranged together as one interface, read as a unit.glossary showing a user modelThe picture a model builds of who it is talking to, such as age, gender or mood.What the model has inferred about the person using it.glossary, about biasThe model treating people or groups differently in ways it should not.Systematic differential treatment of people or groups by the model.glossary and user-modellingWhat the model has quietly worked out about the person talking to it.The model's internal inferences about the person it is talking to.glossary.
IA-008Golden Gate Claude has no visual form and shows nothingThere is nothing visual to look at.Nothing is rendered. The artefact is encountered rather than viewed.glossary, about feature-interpretationWorking out what one small piece of the model has learned to recognise.What an individual learned feature means.glossary.
IA-003Scaling Monosemanticity is highlighted textOrdinary text with words shaded in, where the shading shows how strongly the model reacted to each word.Running text with individual words or tokens shaded to encode a per-token value, most often how strongly a feature activated there.glossary showing featuresA single thing the model has learned to recognise, like a place, a tone of voice, or a kind of mistake.Individual learned directions or concepts inside the model.glossary, about polysemanticityOne part of the model doing several unrelated jobs at once.A single component responding to several unrelated concepts.glossary and safety-relevant-featuresParts of the model to do with harm, deception, bias or misuse.Representations bearing on harm, deception, bias or misuse.glossary.
2023 (3)
IA-002Towards Monosemanticity is highlighted textOrdinary text with words shaded in, where the shading shows how strongly the model reacted to each word.Running text with individual words or tokens shaded to encode a per-token value, most often how strongly a feature activated there.glossary showing featuresA single thing the model has learned to recognise, like a place, a tone of voice, or a kind of mistake.Individual learned directions or concepts inside the model.glossary, about superpositionA model packing more ideas into its wiring than it has room for, by letting them overlap.Representing more features than there are dimensions, by encoding them sparsely and near-orthogonally.glossary, polysemanticityOne part of the model doing several unrelated jobs at once.A single component responding to several unrelated concepts.glossary and feature-interpretationWorking out what one small piece of the model has learned to recognise.What an individual learned feature means.glossary.
IA-010AttentionViz is a scatter plotA graph where each point represents a pair of values, showing the relationship between two sets of numbers on a coordinate plane.A graph of paired numerical values, with one variable on the horizontal axis and the corresponding value of a second variable on the vertical axis, used to reveal relationships or association between the variables.glossary showing attentionHow the model decides which earlier words matter when it is working on the current one.Which positions a model attends to, and how strongly.glossary, about attention-headsThe parts that decide which earlier words matter for the next one.What an attention head does, on a chosen task or across the full data distribution.glossary.
IA-006
Neuronpedia is a dashboardA single screen putting several different readouts side by side.Several visual forms arranged together as one interface, read as a unit.glossary and a node-link graphDots joined by lines, showing what connects to what.Nodes joined by edges, showing what connects to or causes what.glossary showing featuresA single thing the model has learned to recognise, like a place, a tone of voice, or a kind of mistake.Individual learned directions or concepts inside the model.glossary and circuitsA chain of parts inside the model that work together to do one job.Connected components and the paths between them.glossary, about feature-interpretationWorking out what one small piece of the model has learned to recognise.What an individual learned feature means.glossary.