Architectures · intermediate · concept 53 of 176

🏗️Attention Mechanism

A technique allowing models to focus on relevant parts of input when producing output. Self-attention (in Transformers) lets each position attend to all other positions in a sequence.