Architectures · intermediate · concept 54 of 176

🏗️Self-Attention

A special case of attention where a sequence attends to itself, each token computes relationships with every other token. This is the core mechanism powering Transformers.