Tech Meridian
← ENTITY INDEX
COMPANY · ENTITY #1251
Related event timeline, sources and context from the news index.
NVIDIA AIPerf replaces GenAI-Perf with a ground-up multiprocess architecture designed to avoid client-side bottlenecks for high-concurrency LLM inference benchmarking. It supports 15+ endpoint types, public datasets and trace replay formats (ShareGPT, Mooncake, Baseten, WEKA/AgentX), configurable arrival patterns, and reports TTFT, ITL, latency percentiles and GPU telemetry when DCGM or pynvml are available.
Baseten, through its Base Labs research arm, announced a new safety infrastructure standard for open-weight models and said it is partnering with Hugging Face and Goodfire AI to build evaluation and monitoring tooling; the companies provided no technical details. The effort frames safety as a built-in part of training and deployment and includes an open call for contributions amid concerns about ‘abliteration’ and thousands of abliterated models on Hugging Face.
Hugging Face published an item titled “Baseten on Hugging Face Inference Providers 🔥”. The source text is not provided here; the headline suggests Baseten is being referenced in relation to Hugging Face’s Inference Providers program or listing, but details and scope of the announcement are not available.
Allow Google Analytics to measure visits? It stays off until you choose. You can change your choice at any time.