StreamHandler

StreamHandler = (token) => void

Defined in: LLMProvider.ts:99

Callback invoked for each streamed token during generation.

Parameters

Parameter	Type	Description
token	string	The next token string produced by the model

Returns

void

Example

const handler: StreamHandler = (token) => {
  process.stdout.write(token); // or append to UI
};
await provider.stream('Hello', handler);