Go-with-the-Track: Video Compositing and Motion Control with Point Tracking

Go-with-the-Track: Video Compositing and Motion Control with Point Tracking

Go-with-the-Track unifies motion control and reference image compositing in video generation by using point-track embeddings with spatial-aware encoding and video diffusion transfo…

Hugging Face · Daily Papers ·Koichi Namekata, Yash Kant · ·▲ 1 upvotes

Este artigo está em destaque na seleção diária de papers do Hugging Face, curada pela comunidade de pesquisa em IA.

Autores: Koichi Namekata, Yash Kant, Zhizheng Liu, Ryan D Burgert, Yuancheng Xu, Kuan Heng Lin

  • 1 upvotes da comunidade
  • Temas: point-track-conditioned image-to-video models, reference-to-video models, video diffusion transformer, spatially-aware point-track embeddings, coordinate-wise MLP, temporal pooling

Resumo

Resumo original (em inglês), extraído do paper:

Go-with-the-Track unifies motion control and reference image compositing in video generation by using point-track embeddings with spatial-aware encoding and video diffusion transformers.

Ler o paper completo no Hugging Face →

compartilhar: