Go-with-the-Track: Video Compositing and Motion Control with Point Tracking
Go-with-the-Track unifies motion control and reference image compositing in video generation by using point-track embeddings with spatial-aware encoding and video diffusion transfo…
Hugging Face · Daily Papers
·Koichi Namekata, Yash Kant
·
·▲ 1 upvotes
Este artigo está em destaque na seleção diária de papers do Hugging Face, curada pela comunidade de pesquisa em IA.
Autores: Koichi Namekata, Yash Kant, Zhizheng Liu, Ryan D Burgert, Yuancheng Xu, Kuan Heng Lin
- 1 upvotes da comunidade
- Temas: point-track-conditioned image-to-video models, reference-to-video models, video diffusion transformer, spatially-aware point-track embeddings, coordinate-wise MLP, temporal pooling
Resumo
Resumo original (em inglês), extraído do paper:
Go-with-the-Track unifies motion control and reference image compositing in video generation by using point-track embeddings with spatial-aware encoding and video diffusion transformers.