AI tools for Video Editing

Diffuman4D is a novel approach to 4D consistent human view synthesis from sparse-view videos. It enables high-fidelity free-viewpoint rendering of human performances from sparse

SpatialTrackerV2 is a novel framework for 3D point tracking that estimates world-space 3D trajectories for arbitrary 2D pixels in monocular videos. Unlike previous methods that

Yume is an interactive world generation model that creates dynamic worlds from images, text, or videos, allowing exploration and control via peripheral devices or neural signals

Epona is an autoregressive diffusion world model designed for autonomous driving. It enables localized spatiotemporal distribution modeling through two key innovations: decouple

EX-4D is a novel framework for extreme viewpoint 4D video synthesis via depth watertight mesh. It addresses the challenges of generating high-quality camera-controllable videos

SeC is a concept-driven segmentation framework that advances complex video object segmentation via progressive concept construction. It shifts from conventional feature matching

Ultra3D is an efficient 3D generation framework that significantly accelerates sparse voxel modeling without compromising quality. It leverages the compact VecSet representation

OmniVCus is a feedforward subject-driven video customization method that allows for multimodal control conditions. It can compose different input signals to customize a video, i

ObjectClear is an object removal model that can jointly eliminate the target object and its associated effects leveraging Object-Effect Attention, while preserving background co

PUSA V1.0 is a groundbreaking paradigm that leverages vectorized timestep adaptation (VTA) to enable fine-grained temporal control within a unified video diffusion framework. Th

ThinkSound is a novel framework that leverages Chain-of-Thought (CoT) reasoning to enable stepwise, interactive audio generation and editing for videos. The approach decomposes

LongAnimation is a novel framework for long animation generation with dynamic global-local memory. It addresses the challenge of maintaining long-term color consistency in anima