When you hit a limit
- HTTP endpoints return
429 Too Many Requests. - WebSocket sessions send an error frame with the code
rate_limit.
Handle it
Back off and retry. Space retries out with exponential backoff and jitter rather than retrying right away. When a response carries aRetry-After header, wait that many seconds before the next attempt. The agents control plane also sends Retry-After while a referenced tool or dependency is still preparing.
Send fewer requests
- Move large, non-realtime audio to the Batch API instead of many single requests.
- Keep one WebSocket session open for a stream instead of reconnecting per message.