Landscape 16:9 figure of 4 attention heatmaps (2×2 grid), shared 12-token input.
Token labels across X and Y (rotated 45° on X): "The", "quick", "brown", "fox", "jumped", "over", "the", "lazy", "dog", "near", "the", "river".
Four 12×12 cell panels with individual titles:
"Layer 6, Head 3 — subject-verb" (highlighted cells between "fox"/"jumped")
"Layer 9, Head 7 — coreference" (highlighted cells between "the"(×2)/"river")
"Layer 11, Head 2 — prepositional" (highlighted cells between "over"/"dog", "near"/"river")
"Layer 14, Head 1 — sentence-final" (activity concentrated in rightmost column)
Cells: dusty-teal gradient, darker = higher weight. Peak cells outlined in 1px soft-terracotta. Shared vertical color bar on far right with ticks "0.0", "0.25", "0.5", "0.75", "1.0" and label "attention weight".
Title: "Representative multi-head attention patterns in a 16-layer Transformer". Subtitle: "four of 256 heads, hand-picked for illustrative head-role diversity; inspired by Clark et al., 2019."
日本語訳
4 つのアテンションヒートマップ(2×2 グリッド)の横向き 16:9 図。共通の 12 トークン入力。
X 軸と Y 軸のトークンラベル(X は 45° 回転):「The」「quick」「brown」「fox」「jumped」「over」「the」「lazy」「dog」「near」「the」「river」。
12×12 セルの 4 パネル、それぞれに個別のタイトル:
「Layer 6, Head 3 — subject-verb」(「fox」/「jumped」間のセルをハイライト)
「Layer 9, Head 7 — coreference」(「the」(×2)/「river」間のセルをハイライト)
「Layer 11, Head 2 — prepositional」(「over」/「dog」、「near」/「river」間のセルをハイライト)
「Layer 14, Head 1 — sentence-final」(活動が右端の列に集中)
セル:くすんだティールのグラデーション、濃いほど重みが大きい。ピークのセルは 1px の柔らかなテラコッタで囲む。右端に共通の縦カラーバー、ティック「0.0」「0.25」「0.5」「0.75」「1.0」、ラベル「attention weight」。
タイトル:「Representative multi-head attention patterns in a 16-layer Transformer」。サブタイトル:「four of 256 heads, hand-picked for illustrative head-role diversity; inspired by Clark et al., 2019.」