Clover-35B-A3B-Preview

NEW

Key Features

Block-diffusion text generation.
35B mixture-of-experts backbone.
Approximately 3B active parameters.
128K combined context window.
Parallel confident-token resolution.
Qwen3.6-derived hybrid architecture.
Custom Transformers implementation.
SGLang and llama.cpp backend resources.

Instead of generating every position in a block strictly one token at a time, Clover starts with masked tokens and resolves confident positions in parallel. Its adapted Qwen3.6-derived hybrid backbone supports bidirectional attention within the current block while retaining a causal prefix for completed text.


Clover is useful for developers studying diffusion-based language generation and alternative inference tradeoffs. The release supplies custom Transformers code and backend implementations, exposing block size, confidence-based decoding, and supported acceleration paths for experimentation with self-hosted language applications.

Get more likes & reach the top of search results by adding this button on your site!

Embed button preview - Light theme
Embed button preview - Dark theme
TurboType Banner

Subscribe to the AI Search Newsletter

Get top updates in AI to your inbox every weekend. It's free!