Synthegma · The Attention Studies — demo v2

Every signal attends to every other.

Twelve studies built on the actual mechanism behind the logo — self-attention. Not a matrix for decoration: the dot-product, the softmax budget, the value-blend that rewrites a signal's meaning from its context. Each page embodies one facet of how attention works — and why it is Synthegma's philosophy.

The mechanism, in one breath

Every signal emits a Query (what it's looking for), a Key (what it offers), and a Value (what it contributes). Signal i attends to signal j by how well its Query matches j's Key — score = Qᵢ·Kⱼ / √d.

Those scores pass through softmax, so each signal's attention is a finite budget that sums to 1 — to attend more to one thing is to attend less to another. The signal is then rewritten as the weighted blend of everyone's Values.

Which means: no signal means anything alone. Its meaning is recomputed from everything it relates to. The 118 engines are heads — each reading a different kind of relationship. The weights are the evidence. That is the whole product.

attention.softmax( ) Revenue

Σ attention = 1.00 · a finite budget, redistributed — pick any signal above