Cohere Labs community scales open-science cultural-riddles benchmark
Cohere Labs organized an open‑science project that recruited over 100 contributors from more than 50 countries via Discord to create and evaluate a community-built benchmark of culturally specific riddles, testing where AI models trained mainly on English data fail or hallucinate on cultural knowledge across languages. The initiative emphasized inclusive participation (no prior expertise required) and produced dataset items and evaluations highlighting gaps between model fluency and culturally grounded interpretation.