Tech Meridian ← ENTITY INDEX
PROMY MERIDIAN RU

COMPANY · ENTITY #11638

NAQD-Env

Related event timeline, sources and context from the news index.

EVENT TIMELINE

2

RESEARCH · 1 SOURCE · arXiv cs.AI

Fine-tuning Qwen2.5-3B (LoRA) to withdraw actions in synthetic NAQD-Env

This arXiv v1 paper evaluates supervised fine-tuning (LoRA) of Qwen2.5-3B-Instruct in NAQD-Env to teach selective withdrawal (suspending actions when support is lost). SFT checkpoints improve aggregate decision agreement (0.77–0.92) and withdrawal recall (0.46–0.86) compared with instruction-tuned baselines (agreement 0.45–0.63, withdrawal recall ≤0.06), but exhibit rule-specific failures (e.g., an original-curriculum checkpoint wrongly withdrew 26/34 actions with alternative support) and other limitations; the authors present a method to detect such regressions and note experimental constraints that limit causal claims.

6.0

RESEARCH · 1 SOURCE · arXiv cs.AI

NAQD-Env: benchmark for selective withdrawal in language agents

The paper (arXiv:2609.38460v1) introduces NAQD-Env, a synthetic deterministic benchmark that evaluates language-agent decisions to withdraw, preserve, and resume actions across 11 dependency families and explicit evidence/authorization inputs. Evaluating three open-weight instruction-tuned models (Qwen2.5-7B, Qwen2.5-3B, Llama-3.1-8B) under three prompt conditions on 350 scenarios (3,150 episodes) finds very low withdrawal recall (≤0.06), no valid resumptions at eligible opportunities, and only one episode matching the full reference policy; supervised fine-tuning raised Qwen2.5-3B decision accuracy from ~0.45–0.54 to ~0.83–0.92 but introduced other faults.

6.0