The two tiers
Each limit is a fixed 60-second window. The full quota is available at once, then resets at the end of the window.
What counts against the limit
Limits apply per organization, and within that per API key. GC AI checks both on every request, and whichever is exhausted first blocks it:- The per-organization limit is the binding ceiling. It is shared across every key the organization holds, so minting extra keys does not raise your total throughput.
- The per-key limit keeps one integration from monopolizing the organization’s budget. It is the per-integration sub-limit beneath the organization ceiling.
When you exceed a limit
A throttled request returns429 Too Many Requests:
Honor
Retry-After: wait that many seconds before sending the next request. For batch workloads, use fire-and-forget and pace your enqueues rather than retrying in a tight loop.
Related
- Asynchronous Requests: inference calls are jobs; pace batches with fire-and-forget.
- API Introduction: base URL, authentication, and a first request.