位置编码

A method for injecting position information into a model.

Attention is order-agnostic, so positional encoding adds a position signal to each token, letting the model tell "you hit me" from "I hit you". Modern models favor extrapolatable schemes like RoPE.