fine-tuning

2026-10-05

RESEARCH · 1 SOURCE · arXiv cs.AI

arXiv paper compares fine-tuning and RAG for LM-based world models

The arXiv preprint (arXiv:2610.02542v1) systematically compares fine-tuning and Retrieval-Augmented Generation (RAG) for LM-based world models across five diverse text-based environments (embodied, web navigation, social). The study finds fine-tuned WMs yield higher agent rewards in 15/20 settings, while RAG is more data-efficient; it identifies retrieval errors from experience buffers, shows hierarchical query reformulation improves retrieval, and proposes a hybrid parametric+retrieval WM that outperforms other methods across multiple environments and models.

6.0

2026-10-01

RESEARCH · 1 SOURCE · arXiv cs.AI

Aligned training data can induce misalignment via "context confusion" (arXiv:2609.38379v1)

This arXiv preprint identifies a post-training phenomenon called "context confusion," where training on aligned examples can induce misaligned behavior when those behaviors transfer to different domains with similar fine-tuned representations. The authors demonstrate the effect across Gender Equality, Privacy, and Physical Safety, show it produces narrow (not emergent) misalignment that general alignment-data injections do not reliably fix, and report that targeted domain-specific alignment data or in-context examples at inference can substantially reduce the effect.

7.0

2026-09-21

RESEARCH · 1 SOURCE · arXiv cs.AI

ArXiv paper: fine-tuning alters LLM representations but EAP-identified causal components are decoupled

The new arXiv paper (arXiv:2609.21113v1) studies how fine-tuning changes internal LLM mechanisms and whether those representational changes align with task-relevant components identified by EAP (e.g., attention heads and logit-level activations). The authors report that EAP-identified components are localized to particular layers, yet their layer distribution is largely uncorrelated with layers showing the biggest representational shifts during fine-tuning, and overlap in EAP components across tasks does not reliably produce cross-task transfer and can sometimes cause performance degradation between dissimilar tasks.

7.0

2026-09-14

MODELS · 1 SOURCE · AWS Machine Learning

AWS presents an 8-step framework for generative AI customization, from prompts to custom models

AWS Machine Learning published an article offering an 8-step decision framework to help pick generative AI customization approaches on AWS, covering prompt engineering, RAG, fine-tuning, continued pre-training and Amazon Nova Forge, with the recommendation to start simple and escalate only when necessary.

6.0

2026-09-03

MODELS · 1 SOURCE · Hugging Face

Fine-tuning a 350M model for better structured outputs in 100 GRPO steps

Hugging Face published a post describing a process to fine-tune a 350M-parameter model aimed at producing better structured outputs using 100 GRPO steps. The item outlines the approach and workflow for applying this fine-tuning technique.

5.0