Tech Meridian ← ENTITY INDEX
PROMY MERIDIAN RU

TOPIC · ENTITY #37807

Inference Gateway

Related event timeline, sources and context from the news index.

EVENT TIMELINE

2

MODELS · 1 SOURCE · AWS Machine Learning

Amazon SageMaker HyperPod adds Global Inference Gateway for cross-cluster and cross-Region routing

Amazon announced the Global Inference Gateway for SageMaker HyperPod, a SageMaker-managed gateway that routes inference requests across registered HyperPod clusters in one or multiple AWS Regions. The gateway authenticates requests with SigV4/IAM, forwards traffic over AWS PrivateLink, provides automatic failover and per-request cluster selection, and exposes a single endpoint instead of per-cluster endpoints.

7.0

COMPANIES · 1 SOURCE · AWS Machine Learning

Amazon SageMaker adds Studio UI, SDK v3.17.0 integration and LoRA support for inference recommendations

Amazon updated its SageMaker Inference recommendations: a low‑code UI in SageMaker AI Studio, integration into the SageMaker Python SDK v3.17.0+, benchmark runs on real GPU infrastructure via NVIDIA AIPerf, and explicit support for LoRA adapters (as Model Package ARNs or S3 URIs). The announcement also highlights broader serving and routing features—managed NVIDIA Dynamo, the Inference Gateway, HyperPod Inference updates, multi‑Region/account routing, agent skill integration, and the ability to compare frameworks like LMI and vLLM.

7.0