延迟

The time from sending a request to receiving the first (or full) response.

Latency defines UX: time-to-first-token shapes the "typing feel", full latency shapes task duration. It depends on model size, concurrency, network and decoding; real-time use usually wants TTFT under a second.