FREE
$0- Personal feed and saved stories
- Up to 20 companies, models and topics
- Weekly Meridian Brief by email
AI INDUSTRY INTELLIGENCE
One event, every source. Classified, ranked and summarized in real time.
TODAY · BRIEF
MY MERIDIAN · PLANS
The public feed stays open. An account adds personalization; Pro adds working lists and a daily brief.
$70 yearly · save two months
Exphormer is a sparse-attention framework for graph transformers proposed by Google Research (presented at ICML 2023) that replaces the dense full-attention interaction graph with a sparse d-regular expander graph (using a randomized Friedman near-Ramanujan construction). The approach combines expander edges with the input graph and virtual nodes to achieve linear edges and reports strong empirical results across diverse graph datasets; an implementation is available on GitHub.
Why it matters: Reducing the quadratic cost of full attention on graphs by using expander-based sparse interaction graphs makes transformer architectures practical for much larger graph-structured datasets.
OPEN EVENT →Allow Google Analytics to measure visits? It stays off until you choose. You can change your choice at any time.