AI gateway
AI gateway: A proxy in front of model APIs that adds caching, rate limits, logs and billing across providers. Example: Cloudflare AI Gateway gives caching and rate limiting free on all plans. Also in the glossary is agents.json: An OpenAPI-based file at /.well-known/agents.json describing flows of API calls for agents.
Definition
A proxy in front of model APIs that adds caching, rate limits, logs and billing across providers.
Example, with source
Cloudflare AI Gateway gives caching and rate limiting free on all plans. (developers.cloudflare.com, read 4 November 2026)
Where it appears on this site
Neighbouring terms
- agents.json: An OpenAPI-based file at /.well-known/agents.json describing flows of API calls for agents.
- Client ID Metadata Document (CIMD): A JSON file on the client's domain whose HTTPS URL is used as the OAuth client_id, the recommended MCP registration method.
- Code Mode: A Cloudflare approach where the agent writes code against a typed API instead of calling many tools one by one, set by portal policy.