多头注意力

Running several attention heads in parallel to capture diverse relations in different subspaces.

Multi-head attention splits queries, keys and values across heads, each focusing on different patterns (syntax, coreference, semantics), then concatenates them. A standard Transformer component that boosts expressiveness.