Wan-Streamer v0.1: End-to-end Real-time Interactive Foundation Models
Wan-Streamer is a unified, end-to-end multimodal model that enables real-time audio-visual interaction through causal attention mechanisms and integrated processing of visual, audi…
Hugging Face · Daily Papers
·Lianghua Huang, Zhifan Wu
·
·▲ 34 upvotes
Este artigo está em destaque na seleção diária de papers do Hugging Face, curada pela comunidade de pesquisa em IA.
Autores: Lianghua Huang, Zhifan Wu, Wei Wang, Yupeng Shi, Mengyang Feng, Junjie He
- 34 upvotes da comunidade
- Temas: Transformer, block-causal attention, causal encoders, causal decoders, multimodal token scheduling, audio-visual interaction
Resumo
Resumo original (em inglês), extraído do paper:
Wan-Streamer is a unified, end-to-end multimodal model that enables real-time audio-visual interaction through causal attention mechanisms and integrated processing of visual, audio, and text modalities.
