NEWS · STARTUPS · #991
PrismML brings 1-bit 'Bonsai' tiny LLM to Qualcomm Snapdragon AR1 Gen1 smart-glass platform
At Qualcomm's Snapdragon Summit, PrismML demonstrated a 1-bit version of its Bonsai tiny LLM tailored for vision-and-language tasks that can run locally on devices using the Snapdragon AR1 Gen 1 platform; the smart-glasses-capable build is a 2-billion-parameter model but no consumer glasses running it have been announced. PrismML, founded by Caltech researchers and advised by UC Berkeley’s Ion Stoica, aims to enable open-weight on-device AI as an alternative to cloud-dependent proprietary models.
KEY POINTS
- At Qualcomm's Snapdragon Summit, PrismML demonstrated a 1-bit version of its Bonsai tiny LLM tailored for vision-and-language tasks that can run locally on devices using the Snapdragon AR1 Gen 1 platform; the smart-glasses-capable build is a 2-billion-parameter model but no consumer glasses running it have been announced.
- PrismML, founded by Caltech researchers and advised by UC Berkeley’s Ion Stoica, aims to enable open-weight on-device AI as an alternative to cloud-dependent proprietary models.
- Shows a concrete step toward running compact, high-performing LLMs locally on Snapdragon AR1 Gen1 smart-glass hardware, advancing on-device/open-weight AI and potential privacy benefits, though consumer products are not yet available.
WHY IT MATTERS
Shows a concrete step toward running compact, high-performing LLMs locally on Snapdragon AR1 Gen1 smart-glass hardware, advancing on-device/open-weight AI and potential privacy benefits, though consumer products are not yet available.