What is streaming?
Streaming sends the model's reply in small pieces as it is generated instead of all at once.
Definition
Streaming sends the model's reply in small pieces as it is generated instead of all at once.
How it works on TokenRex
Set stream to true in chat requests.