RELEASE · COMPANIES · #3148
Google Cloud API Gateway introduces streaming support in public preview for real-time and AI apps
Google announced a public preview of streaming support for Google Cloud API Gateway, allowing streaming endpoints (SSE, chunked response streaming, WebSockets, gRPC) to operate behind the gateway while keeping existing gateway policies and security (API key enforcement, JWT, service account auth) and Cloud Logging/Monitoring. The release also adds deterministic gateway hostnames, model routing to Gemini/Claude/OpenAI (gpt-oss), one‑hour streaming connections, and requires explicit --enable-streaming during the preview; some limitations remain (existing gateways can’t be switched in place and latency metrics reflect whole-stream duration).
KEY POINTS
- Google announced a public preview of streaming support for Google Cloud API Gateway, allowing streaming endpoints (SSE, chunked response streaming, WebSockets, gRPC) to operate behind the gateway while keeping existing gateway policies and security (API key enforcement, JWT, service account auth) and Cloud Logging/Monitoring.
- The release also adds deterministic gateway hostnames, model routing to Gemini/Claude/OpenAI (gpt-oss), one‑hour streaming connections, and requires explicit --enable-streaming during the preview; some limitations remain (existing gateways can’t be switched in place and latency metrics reflect whole-stream duration).
- It lets developers stream progressive model responses and interactive agent workflows while retaining centralized security, routing and observability controls, addressing a common trade‑off for AI real‑time apps.
WHY IT MATTERS
It lets developers stream progressive model responses and interactive agent workflows while retaining centralized security, routing and observability controls, addressing a common trade‑off for AI real‑time apps.