---
title: "AI gateway: definition and example | Agent MCP Directory"
description: "AI gateway: A proxy in front of model APIs that adds caching, rate limits, logs and billing across providers. Defined with a sourced example."
canonical: https://agentmcpdirectory.com/glossary/ai-gateway
site: "Agent MCP Directory"
last_updated: 2026-11-04
section: "Glossary"
---

# AI gateway: definition and example | Agent MCP Directory

> AI gateway: A proxy in front of model APIs that adds caching, rate limits, logs and billing across providers. Defined with a sourced example.

Source: https://agentmcpdirectory.com/glossary/ai-gateway
Site: Agent MCP Directory
Last reviewed: 2026-11-04

# AI gateway

AI gateway: A proxy in front of model APIs that adds caching, rate limits, logs and billing across providers. Example: Cloudflare AI Gateway gives caching and rate limiting free on all plans. Also in the glossary is agents.json: An OpenAPI-based file at /.well-known/agents.json describing flows of API calls for agents.

## Definition

A proxy in front of model APIs that adds caching, rate limits, logs and billing across providers.

## Example, with source

Cloudflare AI Gateway gives caching and rate limiting free on all plans. ([developers.cloudflare.com](https://developers.cloudflare.com/ai-gateway/reference/pricing/), read 4 November 2026)

## Where it appears on this site

-   [Hosts and gateways compared](https://agentmcpdirectory.com/hosts/)

## Neighbouring terms

-   [agents.json](https://agentmcpdirectory.com/glossary/agents-json/): An OpenAPI-based file at /.well-known/agents.json describing flows of API calls for agents.
-   [Client ID Metadata Document (CIMD)](https://agentmcpdirectory.com/glossary/client-id-metadata-document/): A JSON file on the client's domain whose HTTPS URL is used as the OAuth client\_id, the recommended MCP registration method.
-   [Code Mode](https://agentmcpdirectory.com/glossary/code-mode/): A Cloudflare approach where the agent writes code against a typed API instead of calling many tools one by one, set by portal policy.

Edition

4 November 2026

Method

[How rows are verified](https://agentmcpdirectory.com/method/)

Data

[CSV and JSON](https://agentmcpdirectory.com/data/)

Markdown

[This page as markdown](https://agentmcpdirectory.com/glossary/ai-gateway/index.md)

## Sources

-   [Source for the AI gateway example](https://developers.cloudflare.com/ai-gateway/reference/pricing/), read 4 November 2026

Last reviewed 4 November 2026