Architectures · intermediate · concept 54 of 187

🏗️Attention Mechanism

A technique allowing models to focus on relevant parts of input when producing output. Self-attention (in Transformers) lets each position attend to all other positions in a sequence.