Tech Meridian ← ENTITY INDEX
RU

COMPANY · ENTITY #370

Large language models (LLMs)

Related event timeline, sources and context from the news index.

EVENT TIMELINE

2

RESEARCH · 1 SOURCE · arXiv cs.AI

OrchSLM: Probing the Dynamics of Small Language Model Orchestration

This arXiv preprint introduces OrchSLM, a routing framework that unifies existing non-interactive orchestration methods for small language models (SLMs) and exposes key design parameters. Using OrchSLM as a probe, the authors analyze how orchestration behavior emerges from task structure, model-pool composition, and multi-agent consensus, motivated by constraints of SLMs versus cloud-scale LLMs.

6.0

RESEARCH · 1 SOURCE · arXiv cs.AI

FLoKD: Adaptive knowledge distillation for federated LoRA fine-tuning of LLMs over wireless networks

This arXiv preprint proposes FLoKD, an adaptive knowledge-distillation framework for federated LoRA fine-tuning of large language models over bandwidth‑constrained wireless networks. Instead of sharing full parameters or token logits, FLoKD transmits intermediate LoRA activations and selectively sends only important transformer blocks and public samples aligned with local distributions; experiments on WikiText-103, PTB and a dialog dataset report 50–65% communication reduction while converging to competitive perplexity compared to baselines.

6.0