TasteBench: multimodal benchmark for sensory prediction (arXiv:2610.02599v1)
Researchers introduce TasteBench, a multimodal benchmark and privacy-preserving competition for sensory prediction that includes a food-level ranking task built on 21K+ human evaluations across 215 plant-based foods in 24 categories (yielding 935 within-category ranking pairs) and a molecular-level taste classification task over 15K flavor molecules. The paper characterizes ground-truth reliability (Krippendorff's α = 0.077; panel-aggregated split-half reliability ceiling = 0.825) and reports baselines achieving up to 0.661 pairwise accuracy on panel-rated pairs (comparable to the median individual panelist at 0.650).