Skip to yearly menu bar Skip to main content


Poster

Drag Anything: Motion Control for Anything using Entity Representation

weijia wu · Zhuang Li · Yuchao Gu · Rui Zhao · Yefei He · David Junhao Zhang · Mike Zheng Shou · Yan Li · Tingting Gao · Zhang Di

[ ]
Wed 2 Oct 7:30 a.m. PDT — 9:30 a.m. PDT

Abstract:

We introduce DragAnything, which utilizes a entity representation to achieve motion control for any object in controllable video generation. Comparison to existing motion control methods, DragAnything offers several advantages. Firstly, trajectory-based is more user-friendly for interaction, when acquiring other guidance signals (e.g., masks, depth maps) is labor-intensive. Users only need to draw a line (trajectory) during interaction. Secondly, our entity representation serves as an open-domain embedding capable of representing any object, enabling the control of motion for diverse entities, including background. Lastly, our entity representation allows simultaneous and distinct motion control for multiple objects. Extensive experiments demonstrate that our DragAnything enables precise and flexible control over the motion of any object in video generation.

Live content is unavailable. Log in and register to view live content