BrainJanus: A Unified Model for Understanding and Generation across Brain, Vision, and Language
BrainJanus represents the first unified brain model integrating brain, vision, and language through a shared Omni space, enabling bidirectional mapping between neural activity and…
Hugging Face · Daily Papers
·Haitao Wu, Qirui Zhang
·
·▲ 5 upvotes
Este artigo está em destaque na seleção diária de papers do Hugging Face, curada pela comunidade de pesquisa em IA.
Autores: Haitao Wu, Qirui Zhang, Zhouheng Yao, Shangquan Sun, Qihao Zheng, Mianxin Liu
- 5 upvotes da comunidade
- Temas: brain encoding, brain decoding, multimodal integration, Unified Brain Tokenizer, Omni space, All-in-One autoregressive architecture
Resumo
Resumo original (em inglês), extraído do paper:
BrainJanus represents the first unified brain model integrating brain, vision, and language through a shared Omni space, enabling bidirectional mapping between neural activity and sensory stimuli via a tokenized representation and autoregressive architecture.Onde ler
// relacionados
Leia também
Blog
Auditing Generalization in AI-Generated Video Detection: A Six-Control Protocol and the VidAudit Toolkit
Blog
3D HAMSTER: Bridging Planning and Control in Hierarchical Vision Language Action Models through 3D Trajectory Guidance
Blog
Dense Structural Priors for Sparse Functional Landmark Localization in Surgical Videos
Blog