Summary

3DV-TON is an advanced video try-on framework designed to seamlessly replace clothing in video sequences with high-fidelity, temporally consistent results. Unlike traditional video try-on methods that often struggle with complex garment patterns and diverse body poses, 3DV-TON introduces a diffusion-based approach guided by textured 3D meshes. This explicit 3D guidance allows the system to reference garment texture movements directly, ensuring that clothing transitions remain realistic and coherent throughout the video. By leveraging these animatable textured meshes, 3DV-TON effectively addresses the persistent challenge of motion incoherence, delivering visually appealing and natural video outputs.

Key Features

Diffusion-based video try-on with explicit textured 3D mesh guidance
Adaptive pipeline for dynamic 3D garment animation
Rectangular masking strategy to prevent artifact propagation
High-resolution HR-VVT benchmark dataset for evaluation
Superior temporal consistency and garment detail preservation
Handles complex poses and diverse clothing patterns

About 3DV-TON


The core pipeline of 3DV-TON is adaptive and multi-stage. It begins by selecting a keyframe from the input video for initial 2D image try-on. Next, it reconstructs and animates a textured 3D mesh that is synchronized with the original video’s body poses. This mesh acts as a dynamic guide, informing the diffusion model on how the garment should move and deform across frames. To further enhance visual quality, 3DV-TON incorporates a robust rectangular masking strategy that prevents artifact propagation and mitigates the risk of leaking clothing information during rapid movements. This ensures that even in challenging scenarios-such as fast motion or complex interactions between the body and garments-the generated results remain free of visual artifacts.


To support rigorous evaluation and foster research in the field, 3DV-TON introduces the HR-VVT benchmark dataset, which contains 130 high-resolution videos featuring a wide variety of clothing types and scenarios. Quantitative and qualitative assessments demonstrate that 3DV-TON consistently outperforms existing video try-on methods, particularly in terms of temporal consistency and garment detail preservation. The framework’s innovative combination of diffusion modeling, 3D mesh guidance, and artifact mitigation strategies positions it as a leading solution for realistic, high-quality video try-on, suitable for applications in fashion, e-commerce, and digital content creation.

Get more likes & reach the top of search results by adding this button on your site!

Embed button preview - Light theme
Embed button preview - Dark theme
TurboType Banner

Subscribe to the AI Search Newsletter

Get top updates in AI to your inbox every weekend. It's free!