Tech Meridian ← ENTITY INDEX
PROMY MERIDIAN RU

COMPANY · ENTITY #37992

LVLM

Related event timeline, sources and context from the news index.

EVENT TIMELINE

1

RESEARCH · 1 SOURCE · arXiv cs.AI

BOS Summary: inference-only method that makes the BOS token carry input context to boost reasoning

The paper proposes BOS Summary, a training-free, inference-time modification that relaxes causal masking for the beginning-of-sequence (BOS) query row at a single transformer layer during prefill so BOS aggregates all visual and textual inputs into an input-specific context; other tokens keep standard causal attention. The change requires no extra parameters or decoding overhead and reportedly improves multi-step reasoning across several LLM and LVLM families and benchmarks, outperforming direct/CoT prompting and recent sink-intervention methods, while analysis shows it also reduces BOS sink dominance and redistributes attention toward content tokens.

7.0