InstructPix2Pix Explained - Edit Images with Words!

[@Yenrabbit]

Something I forgot to mention: They generated 100x more training data and filtered to pick the 'best' results for training! One way to try and improve the data quality I guess :)

[@Yenrabbit]

Also apologies about the one errant slack notification that made it into the edited video!

[@shubhchaurasia2437]

​@@Yenrabbit o

[@lkewis]

Was hoping you'd cover this, great video!! Thanks

[@adityakharbanda3290]

Could you please explain the loss function in a bit more detail? Thanks

[@aliteshnizi672]

Thanks for the great video! Question: At inference time, is z_t a randomly sampled vector or is it a diffused version of the input image? Cause if it's the latter, then they're passing the original image information in 2 ways (the initial latent and the image conditioning)

[@parthwagh3607]

this is not working on updated stable diffusion webui and forge

[@imaine-qn5vv]

Thanks for cool review. I got some question while reading paper, I think this model can not only overall style transfer but also do localized object change. But there is no direct hint that this model can infer where to change on image like masking or swaping word attention map. I guess localizing ability of this model came from generated dataset (instructions for GPT and images from Prompt2Prompt) eventhough balancing guidance level might also affect. Whats your opinion about this?

[@LIMBICNATIONARTIST]

Amazing!

[@kornellewychan]

Love u bro, u will me me bilioner, greate fucking work !!!