RESEARCH · RESEARCH · #1896
Deb Roy (MIT CCC) urges accountability for AI-generated civic comments
Deb Roy, director of MIT’s Center for Constructive Communication, argues in a Bulletin of the Atomic Scientists essay titled “Who stands behind the words?” that civic conversations require clear human accountability and "answerability" even when AI helps craft text. He warns that realistic AI-generated comments (e.g., via ChatGPT and other LLMs) can undermine public comment processes; CCC and its partner Cortico use AI to surface themes but design workflows so humans can check, override, and remain responsible for public statements.
KEY POINTS
- Deb Roy, director of MIT’s Center for Constructive Communication, argues in a Bulletin of the Atomic Scientists essay titled “Who stands behind the words?” that civic conversations require clear human accountability and "answerability" even when AI helps craft text.
- He warns that realistic AI-generated comments (e.g., via ChatGPT and other LLMs) can undermine public comment processes; CCC and its partner Cortico use AI to surface themes but design workflows so humans can check, override, and remain responsible for public statements.
- This matters because unchecked AI‑generated input can delegitimize public comment channels and weaken democratic policymaking unless processes ensure human accountability and the ability to override AI outputs.
WHY IT MATTERS
This matters because unchecked AI‑generated input can delegitimize public comment channels and weaken democratic policymaking unless processes ensure human accountability and the ability to override AI outputs.