BYTEDANCE'S ILLADA MATCHES QWEN2.5 WITH DIFFUSION APPROACH

Researchers from Renmin University and ByteDance unveiled iLLaDA, an 8B language model using diffusion-based text generation. The model performs comparably to Qwen2.5 at base level, though it lags after fine-tuning.