NVIDIA tutorial: serving GLM-5.3 across two DGX Stations with vLLM
NVIDIA published a tutorial demonstrating how to serve the 753B-parameter GLM-5.3 (NVFP4 quantized MoE model) locally across two DGX Stations with GB300 GPUs using vLLM. The guide shows a TP=2 tensor-parallel setup over ConnectX-8 RDMA (no CPU weight offload), with Station A hosting an OpenAI-compatible API endpoint and Station B acting as a worker, and includes steps for checkpoint transfer (≈464 GB), networking checks, and baseline load measurements.