PrismML brings 1-bit 'Bonsai' tiny LLM to Qualcomm Snapdragon AR1 Gen1 smart-glass platform
At Qualcomm's Snapdragon Summit, PrismML demonstrated a 1-bit version of its Bonsai tiny LLM tailored for vision-and-language tasks that can run locally on devices using the Snapdragon AR1 Gen 1 platform; the smart-glasses-capable build is a 2-billion-parameter model but no consumer glasses running it have been announced. PrismML, founded by Caltech researchers and advised by UC Berkeley’s Ion Stoica, aims to enable open-weight on-device AI as an alternative to cloud-dependent proprietary models.