RESEARCH · RESEARCH · #2101
ARIA: runtime inspection and amendment framework plus dataset for LLM-based multi-agent systems
Researchers from LabRAI introduce ARIA, a MAS-agnostic framework and learned model for runtime inspection and amendment of LLM-based multi-agent executions. They also release the ARIA dataset—built from over 24,000 trajectories across four multi-agent frameworks, six benchmarks, and eight host models—containing 3,953 execution-verified repair pairs; the trained model shows strong post-hoc and runtime repair performance and generalizes to unseen frameworks and host models; code is on GitHub.
KEY POINTS
- Researchers from LabRAI introduce ARIA, a MAS-agnostic framework and learned model for runtime inspection and amendment of LLM-based multi-agent executions.
- They also release the ARIA dataset—built from over 24,000 trajectories across four multi-agent frameworks, six benchmarks, and eight host models—containing 3,953 execution-verified repair pairs; the trained model shows strong post-hoc and runtime repair performance and generalizes to unseen frameworks and host models; code is on GitHub.
- ARIA provides the first large-scale dataset of execution-verified repairs and a MAS-agnostic learned runtime repair approach, enabling automated interventions that can stop local agent mistakes from cascading in LLM-based multi-agent systems.
WHY IT MATTERS
ARIA provides the first large-scale dataset of execution-verified repairs and a MAS-agnostic learned runtime repair approach, enabling automated interventions that can stop local agent mistakes from cascading in LLM-based multi-agent systems.