Sketching provides an intuitive way to convey dynamic intent in animation authoring (i.e., how elements change over time and space), making it a natural medium for automatic content creation. Yet existing approaches often constrain sketches to fixed command tokens or predefined visual forms, overlooking their freeform nature and the central role of humans in shaping intention. To address this, we introduce an interaction paradigm where users convey dynamic intent to a vision-language model via free-form sketching, instantiated here in a sketch storyboard to motion graphics workflow. We implement an interface and improve it through a three-stage study with 24 participants. The study shows how sketches convey motion with minimal input, how their inherent ambiguity requires users to be involved for clarification, and how sketches can visually guide video refinement. Our findings reveal the potential of sketch and AI interaction to bridge the gap between intention and outcome, and demonstrate its applicability to 3D animation and video generation.
SketchDynamics：探索自由手绘草图在动画生成中表达动态意图 / SketchDynamics: Exploring Free-Form Sketches for Dynamic Intent Expression in Animation Generation
这篇论文提出了一种新的交互方式，让用户通过自由手绘草图来向AI模型直观地表达动画的动态意图（比如物体如何运动和变化），并通过用户研究发现，这种结合草图和AI交互的方法能有效弥合创作意图与最终动画效果之间的差距。
源自 arXiv: 2601.20622
