MJEPA: A Simple and Scalable Joint-Embedding Predictive Architecture for Audio-Visual Learning
arXiv:2606.25225v1 Announce Type: new Abstract: Self-supervised learning from large-scale video data has emerged as a dominant paradigm for visual representation learning. Since audio and visual streams naturally co-occur in video data, extending this success to jointly learn from both modalities is a natural next step, yet it remains challenging. Existing audio-visual self-supervised methods rely on modality-specific encoders and complex combinations of contrastive or reconstruction objectives,...
arXiv cs.CV
·Revant Teotia, Adrien Bardes, Michael Rabbat, Sumit Chopra, Matthew J. Muckley, Nicolas Ballas
·
// relacionados
Leia também
Blog
As Reddit stock falls, CEO questions value of Google's AI Overviews
Blog
Smallest.ai raises $13M to build ultra-fast voice AI that sounds genuinely human
Modelo
Audio8/Audio8-TTS-Preview-0.6b
Blog