Tech Meridian ← ENTITY INDEX
PROMY MERIDIAN RU

COMPANY · ENTITY #34601

PC Web

Related event timeline, sources and context from the news index.

EVENT TIMELINE

1

RESEARCH · 1 SOURCE · arXiv cs.AI

OCTAVE: capability-resolved benchmark for end-to-end HTML5 game generation (arXiv:2611.17681v1)

OCTAVE is a capability-resolved benchmark for end-to-end HTML5 game generation organized into eight Capability Dimensions, 180 tasks, and 1,800 Evaluation Requirements drawn from player requests, commercial mechanics reconstruction, and expert design; it covers PC Web, Mobile Web, 2D and 3D. The paper reports static source-code requirement-level evaluation across 11 model-harness combinations (33.2% Completeness, 32.5% Richness), finds many static gate failures and missing artifacts, and shows no evaluated system exceeds 50% on both public and hidden requirements when excluding same-model self-evaluation.

7.0