Smart Coder Framework: structuring human–LLM collaborative qualitative coding (arXiv:2610.33205v1)
The paper proposes the Smart Coder Framework, a three‑phase approach (Instruction, Prompt Strategy, Reliability Check) to structure human–LLM collaborative qualitative coding. The authors evaluated the framework on 72 middle‑school math teacher interview transcripts (12 for prompt development, 60 for formal evaluation) against a human‑consensus benchmark using a factorial design comparing instructed vs uninstructed prompts, few‑shot vs few‑shot+chain‑of‑thought, and single‑pass vs self‑consistency; instruction consistently improved agreement, chain‑of‑thought helped further under adequate instruction, and self‑consistency gave smaller theme‑dependent gains while flagging unstable decisions for human review.