AiGateway

Source: src/Cloudflare/AiGateway/AiGateway.ts

A Cloudflare AI Gateway for observability, caching, rate limiting, and governance across AI provider requests.

AI Gateway gives your application a stable gateway ID and account-scoped endpoint that can route model requests through Cloudflare.

Creating a Gateway

Basic gateway

const gateway = yield* Cloudflare.AiGateway("Gateway");

Gateway with caching and rate limiting

const gateway = yield* Cloudflare.AiGateway("Gateway", {
  id: "my-gateway",
  cacheTtl: 300,
  cacheInvalidateOnUpdate: true,
  rateLimitingInterval: 60,
  rateLimitingLimit: 100,
  rateLimitingTechnique: "sliding",
});

Logging

const gateway = yield* Cloudflare.AiGateway("Gateway", {
  collectLogs: true,
  logManagement: 10000,
  logManagementStrategy: "STOP_INSERTING",
});