✦
Summary
LiveEdit is a streaming video editing framework for causal, frame-by-frame diffusion editing with real-time responsiveness. It aims to preserve backgrounds and non-edited regions while applying local or global text-guided changes as a video arrives, rather than waiting for a full offline sequence.
Key Features
Causal frame-by-frame diffusion for streaming video editing.
Targets 12.66 FPS real-time streaming inference.
Uses a three-stage foundation, causal, and DMD distillation pipeline.
Adapts bidirectional editing priors to chunk-wise causal attention.
Compresses generation to four diffusion steps.
Uses an AR-oriented mask cache for unchanged-region token reuse.
Supports local and global text-guided video edits.
Provides public code, demos, ablations, and baseline comparisons.
About LiveEdit
The system uses a three-stage distillation pipeline: foundation tuning gives a bidirectional diffusion transformer editing ability, causal adaptation converts it to chunk-wise streaming attention, and DMD distillation compresses generation to four diffusion steps. An autoregressive-oriented mask cache reuses tokens from unchanged regions to reduce redundant computation.
LiveEdit is useful for interactive video effects, creative tools, virtual production, and low-latency visual editing research. The project reports 12.66 FPS streaming inference and provides code, comparison galleries, and examples such as changing fur, lighting, clothing, sky, and other scene attributes while maintaining temporal continuity.