Tech Meridian ← ENTITY INDEX
PROMY MERIDIAN RU

MODEL · ENTITY #4285

Gemini 3.1 Pro Preview

Related event timeline, sources and context from the news index.

EVENT TIMELINE

2

RESEARCH · 1 SOURCE · arXiv cs.AI

MathVis benchmark (arXiv:2610.12954v1) evaluates LLM diagram generation for math

MathVis is a new benchmark (arXiv:2610.12954v1) of 512 tasks that tests large language models' ability to visualize mathematical problems and produce executable TikZ/SVG diagrams, providing reference diagrams, a Gold intermediate representation, atomic rubrics, and error codes. In initial evaluations GPT-6-Astra, Claude Fable 5, and Gemini 3.1 Pro Preview scored pass@1 of 31.25%, 26.56%, and 22.85% respectively, and the authors report LLM outputs are often formal-language-heavy and visually confusing rather than demonstrating explicit diagram-mediated reasoning.

6.0

RESEARCH · 1 SOURCE · arXiv cs.AI

Benchmarking LLM Safety for Vehicle Voice Command Authorization

The paper (arXiv:2609.19630v1) introduces a 202-scenario benchmark and seven-class taxonomy to evaluate pre-action authorization decisions for vehicle voice assistants. It evaluates two local open-weight models and three API-based LLMs, reporting decision alignment from 40.1% (Llama 3.2 3B) to 89.1% (Gemini 3.1 Pro Preview), finds API models at 83.2–89.1% with no significant differences, observes two to three False Executes among 161 non-execution scenarios, and concludes that structured LLM decisions alone are insufficient—deployments require an independent enforcement layer to verify permissions and vehicle-state constraints.

7.0