RESEARCH · RESEARCH · #2880
FilingLoop: interactive benchmark and self‑evolving LLM agent framework for SEC disclosure review (arXiv v1)
FilingLoop is an interactive benchmark and self‑evolving agent framework for reviewing and revising corporate disclosures, grounded in historical U.S. SEC correspondence. The paper reconstructs 380 mostly IPO review tasks from 96 companies, evaluates final filings against 6,099 eligible requirements, and shows procedural evolution (without weight updates) raises requirement fulfillment from 24.28% to 27.96% and full comment resolution from 16.90% to 20.75% at a 5.8% higher cost versus a fixed policy.
KEY POINTS
- FilingLoop is an interactive benchmark and self‑evolving agent framework for reviewing and revising corporate disclosures, grounded in historical U.S.
- The paper reconstructs 380 mostly IPO review tasks from 96 companies, evaluates final filings against 6,099 eligible requirements, and shows procedural evolution (without weight updates) raises requirement fulfillment from 24.28% to 27.96% and full comment resolution from 16.90% to 20.75% at a 5.8% higher cost versus a fixed policy.
- It provides a targeted, evidence‑based benchmark and procedural adaptation method for LLM agents on high‑stakes financial disclosure tasks where discovering missing facts and verifying evidence is critical.
WHY IT MATTERS
It provides a targeted, evidence‑based benchmark and procedural adaptation method for LLM agents on high‑stakes financial disclosure tasks where discovering missing facts and verifying evidence is critical.