InferenceInference performance, quantization and cost optimization
API(应用程序接口)
The standard interface for applications to access model services, billed by usage.
Model APIs let developers call models over HTTP without running inference themselves. Most vendors expose OpenAI-compatible endpoints with streaming, function calling and context caching—the main delivery channel for closed models.