Tech Meridian ← ENTITY INDEX
PROMY MERIDIAN RU

TOPIC · ENTITY #34559

proxy distribution (spectral coverage α, leakage β)

Related event timeline, sources and context from the news index.

EVENT TIMELINE

1

RESEARCH · 1 SOURCE · arXiv cs.AI

A Spectral Framework for Universal Proxy Regularization in Model Merging (arXiv:2611.17728v1)

The paper proposes a spectral framework that characterizes when a task-agnostic proxy distribution can substitute for task data during model merging via two metrics—spectral coverage (α) and leakage (β)—and derives a unified parameter-interference bound showing smaller (α,β) reduces interference. It introduces a proxy regularizer with three instantiations (J: Jacobian-vector exact, F: Fisher frozen curvature, O: output-drift) that coincide under NTK linearization, analyzes their departures for nonlinear fine-tuning, and validates the theoretical predictions on CLIP.

6.0