Regularizing modality contribution drift in multimodal continual learning
arXiv:2607.27260v1 Announce Type: new Abstract: Multimodal continual learning (MMCL) aims to learn emerging knowledge from multimodal data while preserving knowledge. To mitigate forgetting, current MMCL methods usually focus on cross-modal representation alignment or semantic similarity, but they overlook whether the relative contributions of individual modalities and their interactions remain stable across incremental tasks. We term this decision-level shift Modality Contribution Drift (MCD) a...
arXiv cs.LG
·Zhen Zhang, Jielei Chu, Bin Liu, Tianrui Li
·
// relacionados
Leia também
Blog
Latent States in Neural Networks: Recovering the Temporal Structure of Drifting Data from Model Weights
Blog
Can LVLMs Uncover the Truth Behind Visual Illusions? An Analysis of Perceptual and Reasoning Capabilities
Blog
MPIE-Bench: Benchmarking Anatomically Plausible Multi-Person Interaction Editing
Blog