Calibrated Partial Resets: Preventing Policy Collapse in Continual Reinforcement Learning
arXiv:2607.24996v1 Announce Type: new Abstract: Neural networks are hindered by accumulating dormant neurons and loss of expressivity throughout training, particularly in non-stationary data settings, such as continual supervised and reinforcement learning. Recently, neuron resets have been used to maintain gradient flow and restore plasticity. However, full unit reinitialization often sacrifices peak performance and can destabilize training, leading to policy collapse. To preserve plasticity wi...
arXiv cs.LG
·Luc McCutcheon, Evangelos Chatzaroulas, Saber Fallah
·
// relacionados
Leia também
Blog
Desenvolvedores de IA de fronteira pedem coordenação internacional para conter o ritmo da pesquisa automatizada antes que as capacidades superem o controle
Blog
A marca d'água SynthID do Google é difícil de burlar, mas não resolve a desinformação gerada por IA
Blog
Relatório da OpenAI associa agentes de programação a construções mais rápidas de softwares científicos
Blog