Architectures · intermediate · concept 59 of 187

🏗️GPT (Generative Pre-trained Transformer)

A decoder-only Transformer trained to predict the next token. Each GPT generation, from GPT-1 through GPT-5 and beyond, showed that scaling this simple idea produces increasingly capable AI. The architecture behind ChatGPT.