Tech Meridian ← ENTITY INDEX
PROMY MERIDIAN RU

TOPIC · ENTITY #4341

reasoning benchmarks

Related event timeline, sources and context from the news index.

EVENT TIMELINE

2

RESEARCH · 1 SOURCE · arXiv cs.AI

LogicTrack: auditing LLM reasoning with formal logic solvers

LogicTrack is a neuro-symbolic framework that auto-formalizes each Chain-of-Thought step and verifies them with automated theorem provers, introducing a Solver-Based Backtracking Reward (SBR) to score step-wise logical soundness and guide backtracking tree search at inference time. The authors also use backtracking traces to build supervised fine-tuning data and report improved reasoning-chain verifiability and final-answer pass rates across 8 benchmarks and 7 LLMs (arXiv:2609.21492v1).

6.0

RESEARCH · 1 SOURCE · arXiv cs.AI

LLM-as-an-Improver paper proposes Verify–Repair–Reselect (VRR) to use verification feedback to generate better candidates

arXiv:2609.19515v1 introduces LLM-as-an-Improver and Verify–Repair–Reselect (VRR), a method that uses verifier feedback not just to rank but to generate and reselect improved candidate solutions. VRR keeps the initial winner, conditionally generates repaired and alternative solutions, filters invalid/duplicate candidates using only inference-time signals, and reselects under the original criteria; the paper reports improvements over fixed-pool verifier selection on multiple models and on code-generation and reasoning benchmarks, including cases where the initial pool contained no correct answers.

6.0