FlexFloor: Elastic expert parallelism to speed RL post-training of LLMs
The arXiv preprint (arXiv:2611.06984v1) introduces FlexFloor, a system that reduces wasted worker time in synchronous response generation for reinforcement-learning post‑training of large language models by adaptively scheduling responses and progressively releasing workers while preserving expert availability. Compared with the reported verl baseline, FlexFloor yields ~65.40% more response tokens per unit of occupied compute time and increases throughput by ~52.74% with little observed change in rollout reward.