Tools · Transport and Gateways¶

Compare streaming and real-time transports, then examine how LLM gateways govern production traffic.

First distinguish event formats, browser APIs, and underlying transports, then consider disconnection recovery, cancellation, and side effects. A compatible gateway interface does not guarantee compatible model capabilities; semantic cache hit rates and added latency must both be measured under the actual workload.