Mercury 3: Diffusion at scale
Inception Labs introduced Mercury 3, a diffusion-based language model designed for high-throughput text and code generation.
Inception Labs introduced Mercury 3, a diffusion-based language model designed for high-throughput text and code generation. Moving away from standard autoregressive transformers, Mercury 3 applies non-autoregressive diffusion architecture at scale to enable faster parallel token generation. Benchmark results show that scaling laws hold for diffusion language models, allowing Mercury 3 to match the quality of conventional autoregressive models while significantly reducing latency. This approach offers developers and enterprise applications a high-efficiency alternative for rapid sequence generation.