Study (arXiv:2611.17639v1) examines what LLM agents act on vs. what users say
The paper uses presupposition theory to analyze when LLM agents proceed with actions (e.g., cancel reservations, delete folders) based on tool outputs versus user statements. It shows that agents frequently act without asking when lookups cannot distinguish one vs. multiple records, that listings stop most agents whereas simple counts do not, that user claims (e.g., “it is empty”) can reduce acting, and that latest Claude and GPT models tested opened a counted second record then never acted; a retail benchmark with same-name same-zip customers produced wrong-account writes in about a quarter of conversations unless lookups checked competing records or street data.