ICL Visualizer

Real-time In-Context Learning Analysis

Disconnected

Controls

ICL Metrics

Induction Score:
Induction Heads:
Copying Score:
Copying Heads:
Sequence Length:
Generation Step:

Attention Statistics

entropy:0
max attention:0
sparsity:0
diagonal attention:0

Final Analysis

max induction score:0
avg induction score:0
pattern diversity:0
sequence complexity:0

Loading Visualizations...

Output

In-Context Learning Text

In-Context Learning Visualization

TokenInduction Target - Model predicting using pattern matching
TokenCopying Source - Token being referenced/copied
TokenHigh Attention - Important for context
TokenAttention Source - Attending to other tokens
💡 Hover over colored tokens to see detailed attention information

Tokens

Top Predictions