Scaling up Masked Diffusion Models on Text

[@spkgyk]

Your videos are incredible, so meticulous and packed with clear and well thought out explanations. Keep up the great work!

[@nieshen4163]

What a detailed and insightful video about masked diffusion language models! Thank you so much for your excellent work!

[@rohollahhosseyni8564]

Great video. We revert to BERT.

[@spkgyk]

What is CFG?

[@gabrielmongaras]

Classifier Free Guidance. Mainly a method of getting good quality out of diffusion models. It basically emphasizes the given class or text some amount, c, over the null prediction the model would've made without the class information, thus making your image more representative of the given class. arxiv.org/abs/2207.12598 I think I talked about it in my SD 3 video if you're curious. There's a lot of other resources on it too!