FUNDING · STARTUPS · #1448
Trillium Labs launches nonprofit to publish open research on post-training, RSI and agents
Nathan Lambert and Tom Zick have launched Trillium Labs, a nonprofit that will conduct and publish experiments on high-risk AI areas—including post-training fine-tuning, recursive self-improvement (RSI), agents, and reinforcement learning—to enable outside scrutiny and replication. The lab has initial funding from Schmidt Sciences and Halcyon Futures, aims to raise $40–100 million total, and plans to spend $30 million on training over the next 18 months.
KEY POINTS
- Nathan Lambert and Tom Zick have launched Trillium Labs, a nonprofit that will conduct and publish experiments on high-risk AI areas—including post-training fine-tuning, recursive self-improvement (RSI), agents, and reinforcement learning—to enable outside scrutiny and replication.
- The lab has initial funding from Schmidt Sciences and Halcyon Futures, aims to raise $40–100 million total, and plans to spend $30 million on training over the next 18 months.
- Opening detailed experiments could broaden community scrutiny and reproducibility of frontier AI work, shifting how risks and capabilities are understood and governed.
WHY IT MATTERS
Opening detailed experiments could broaden community scrutiny and reproducibility of frontier AI work, shifting how risks and capabilities are understood and governed.