Wan-Streamer v0.1: End-to-end Real-time Interactive Foundation Models

Wan-Streamer v0.1: End-to-end Real-time Interactive Foundation Models

Wan-Streamer is a unified, end-to-end multimodal model that enables real-time audio-visual interaction through causal attention mechanisms and integrated processing of visual, audi…

Hugging Face · Daily Papers ·Lianghua Huang, Zhifan Wu · ·▲ 34 upvotes

Este artigo está em destaque na seleção diária de papers do Hugging Face, curada pela comunidade de pesquisa em IA.

Autores: Lianghua Huang, Zhifan Wu, Wei Wang, Yupeng Shi, Mengyang Feng, Junjie He

  • 34 upvotes da comunidade
  • Temas: Transformer, block-causal attention, causal encoders, causal decoders, multimodal token scheduling, audio-visual interaction

Resumo

Resumo original (em inglês), extraído do paper:

Wan-Streamer is a unified, end-to-end multimodal model that enables real-time audio-visual interaction through causal attention mechanisms and integrated processing of visual, audio, and text modalities.

Ler o paper completo no Hugging Face →

compartilhar: