Transformer 架构

A neural network architecture based on self-attention; the foundation of modern LLMs.

Introduced in 2017, Transformer replaces recurrence with self-attention, enabling parallel training and long-range dependencies. Nearly all major LLMs (GPT, Claude, Gemini, DeepSeek) build on it or its variants.