Posted inAI & Machine Learning Open Source
Sumi-7B: The First Open Diffusion Language Model Trained From Scratch
Posted by
By
Posted inAI & Machine Learning, Open Source
By
Posted inAI & Machine Learning, Open Source
Sumi-7B is the first uniform diffusion language model trained from scratch at 7B scale. This fully open model by Tohoku University can revise any token at any step — a paradigm shift from autoregressive generation.
