Tech Meridian
← ENTITY INDEX
TOPIC · ENTITY #176
Related event timeline, sources and context from the news index.
An NVIDIA Developer post compares dense and Mixture-of-Experts (MoE) architectures, showing how a 30B-parameter model can activate only about 3B parameters per token and discussing the resulting capacity and throughput trade-offs; Nemotron 3.5 Lightning is used as an illustrative example.
Mistral AI launched Forge, a system for enterprises to train frontier-grade AI models grounded in their proprietary documentation, codebases, structured records and policies. Forge supports pre-training, post-training, reinforcement learning, dense and MoE architectures, multimodal inputs, and is already being used in partnerships with organizations such as ASML, DSO National Laboratories Singapore, Ericsson, ESA, HTX Singapore and Reply.
Allow Google Analytics to measure visits? It stays off until you choose. You can change your choice at any time.