Representation Distribution Matching

NEW

Key Features

Trains one-step image generators through distribution matching.
Uses no online teacher, adversarial loss, or trajectory matching.
Combines exact within-batch repulsion with Nyström attraction.
Uses a frozen reference distribution computed over training data.
Balances a battery of fourteen pretrained encoders.
Supports joint image-text distribution matching for text-to-image.
Post-trains FLUX.2 [klein] from four steps to one step.
Releases MIT-licensed code and public model checkpoints.

The method combines exact within-batch repulsion with a Nyström attraction to a frozen reference distribution and uses large fresh generation batches with gradient caching. It balances fourteen encoder representations, including image and text features for conditional generation, so the model cannot optimize a single representation while leaving visible artifacts in other spaces.


RDM is useful for researchers and infrastructure teams working on fast text-to-image generation. The release shows one-step ImageNet generation with an SW_r14 distance of 1.30 and post-training of four-step FLUX.2 [klein] into a one-step model that exceeds the teacher on GenEval and PickScore, with public code and checkpoints for reproduction.

Get more likes & reach the top of search results by adding this button on your site!

Embed button preview - Light theme
Embed button preview - Dark theme
TurboType Banner
Zero to AI Engineer Program

Zero to AI Engineer

Skip the degree. Learn real-world AI skills used by AI researchers and engineers. Get certified in 8 weeks or less. No experience required.

Subscribe to the AI Search Newsletter

Get top updates in AI to your inbox every weekend. It's free!