modality
vision
3 entries
2023 (1)
IA-010AttentionViz is a scatter plotA graph where each point represents a pair of values, showing the relationship between two sets of numbers on a coordinate plane.A graph of paired numerical values, with one variable on the horizontal axis and the corresponding value of a second variable on the vertical axis, used to reveal relationships or association between the variables.glossary showing attentionHow the model decides which earlier words matter when it is working on the current one.Which positions a model attends to, and how strongly.glossary, about attention-headsThe parts that decide which earlier words matter for the next one.What an attention head does, on a chosen task or across the full data distribution.glossary.
2019 (1)
IA-007
Activation Atlas is a scatter plotA graph where each point represents a pair of values, showing the relationship between two sets of numbers on a coordinate plane.A graph of paired numerical values, with one variable on the horizontal axis and the corresponding value of a second variable on the vertical axis, used to reveal relationships or association between the variables.glossary and an activation gridLots of tiny pictures in a grid, each showing what the model saw at that spot.Many small images laid out in a grid, each one standing for what a part of the model responded to at that position.glossary showing featuresA single thing the model has learned to recognise, like a place, a tone of voice, or a kind of mistake.Individual learned directions or concepts inside the model.glossary, about feature-interpretationWorking out what one small piece of the model has learned to recognise.What an individual learned feature means.glossary.
