Hey Data Science enthusiasts, this is the second part in understanding Diffusion Models. The Reparameterization Trick is also explained in this video.
@thomasschmitt9669Ай бұрын
Great Video. Tried t o follow the steps but did not get far. The actual version of the transformer library does not work with your code. Can you pls tell me which version you used, so i can adjust my environment. Thx
@SantoshPanigrahi30Ай бұрын
A great analogy to explain a complex and technical diffusion models topic with such an ease and relatable example. Thanks for this👍👍
@datafuseanalyticsАй бұрын
Thanks a lot Santosh. I am glad you liked the video... 😃 😊
@datafuseanalyticsАй бұрын
Hello Data Science Enthusiasts. Did you know this fact? "The name diffusion takes inspiration from the well-studied property of thermodynamic diffusion. An important link was made between this purely physical field and deep learning in the 2015 paper Deep Unsupervised Learning using Nonequilibrium Thermodynamics (Sohl-Dickstein, 2015, arxiv.org/abs/1503.03585)".
@chuanjiang6931Ай бұрын
In student_training_args you specified alpha is 1, is it intentionally to not account for loss_kd?
@milindkubal27382 ай бұрын
Best explanation of batch normalization👍
@datafuseanalytics2 ай бұрын
Thank you Milind brother 😃
@hemantwani47572 ай бұрын
Very nice video… Simplified yet Informative …👌👍
@datafuseanalytics2 ай бұрын
Thanks a lot Wani sir. I am glad you liked the video 😃 😊
@datafuseanalytics2 ай бұрын
Hello Data Science Enthusiasts, Chapters: 0:00 Introduction to Batch Normalization 0:47 Why Normalization is required? 1:20 Unstable Neural Networks, Vanishing and Exploding Gradient Problem 1:49 Batch Normation 2:49 Important Papers and References 3:54 Implementation of Batch Normalization in Python 📌 Code: github.com/DiveshRKubal/Machine-Learning/blob/master/batch_normalization/Batch_Normalization.ipynb
Did not knew the background story of name Gemma…good to know that.
@datafuseanalytics2 ай бұрын
Thank you brother. I am glad that this video was helpful 😃
@rembautimes88082 ай бұрын
Wow good tutorial. RAG is quite the topic and nice that you walked us through an example
@datafuseanalytics2 ай бұрын
Thanks a lot for this amazing comment. Please do share this video with your Data Science Enthusiasts friends too 😃
@rifatrahman87722 ай бұрын
Hey! This was a beautiful tutorial and helped me out tremendously in my own personal project. Thank you!
@datafuseanalytics2 ай бұрын
Hello friend. I am glad that the video helped you. Do share it with your friends 😁
@SuryaRegalla2 ай бұрын
Bro, if we increase the epochs, will reconstructed images deviate from the shirt image?
@datafuseanalytics2 ай бұрын
Greetings, brother. It all depends on the distribution of the training data, and increasing the epochs will yield various permutations of shirt images. It will not generate images of other types of clothing that were not present in the training data.
@SuryaRegalla2 ай бұрын
@@datafuseanalytics can we generate pant / shoe images rather than shirt image?
@datafuseanalytics2 ай бұрын
@@SuryaRegalla Yes definitely we can. While training we need to show the model some basic shoe and pants images. While inferencing, with the help of sampling, we can generate variety of shoe/pant images.
@SuryaRegalla2 ай бұрын
@@datafuseanalytics u mean, we only need to put shoe/pant images in the training set?
@datafuseanalytics2 ай бұрын
@@SuryaRegalla Yes, a sample or representative images
@datafuseanalytics2 ай бұрын
Hello Data Science enthusiasts, I have uploaded the code to GIT Repository. 📌 Code: github.com/DiveshRKubal/Retrieval_Augmented_Generation/tree/main/rag_custom_chatbot
@ahmedelsabagh69902 ай бұрын
Greate video!
@datafuseanalytics2 ай бұрын
Thanks a lot. Please do share it with your friends 😁
@prakash.penterpreneur61663 ай бұрын
interesting bro
@datafuseanalytics2 ай бұрын
Yeah brother. LLM with Langchain is an interesting topic. If you want to learn the development of RAG Custom Chatbot, please refer to this tutorial - kzbin.info/www/bejne/g3yrdpSumdSkrqM
@dennissinitsky97793 ай бұрын
Thanks! I find it a very nice tutorial in autoencoder implementation in TF; somewhat similar to what DeepLearningAI do on Coursera in their advanced tensorflow course.
@datafuseanalytics2 ай бұрын
Thanks a lot for this wonderful comment. I will try my best to come up with more impactful and helpful videos
@flakky6263 ай бұрын
Go in more depth lol VAE's are not something you can just learn with 9 minutes video.. Can you recommend best resource to learn VAE from please?
@mthornit3 ай бұрын
Jakup Tomczak's deep generative modelling is pretty good. Also Umar Jamil's VAE video
@datafuseanalytics2 ай бұрын
Hello, if you want to learn in depth, I would refer this beautiful book - "Generative Deep Learning" by David Foster. (www.oreilly.com/library/view/generative-deep-learning/9781492041931/)
@jackmartin11463 ай бұрын
Hello great video, can you share the Colab notebook?
@datafuseanalytics2 ай бұрын
Thanks a lot. I have uploaded the Python Notebook to my Github Repo - github.com/DiveshRKubal/Data-Science-Use-Cases/blob/master/Text%20Classification%20without%20GPU/Text_Classification_Implementation.ipynb Please go through it and feel free to ask me if you face any issues
@pvtgcn87523 ай бұрын
❤
@datafuseanalytics2 ай бұрын
Thanks a lot ❤️
@rembautimes88084 ай бұрын
Excellent video and I joined as a sub. Like this style of going thru the various architectures and the use case. Maybe you can also update it with GPT 4 since it’s new out there.
@datafuseanalytics2 ай бұрын
Thanks a lot for this amazing comment. I have uploaded the latest video using ChatGPT model - kzbin.info/www/bejne/g3yrdpSumdSkrqM Please go through it and feel free to comment
@Sessrikant4 ай бұрын
There is a confusion. Why you did not include language models which are also part of GENERATIVE AI
@datafuseanalytics2 ай бұрын
thank you for the comment. I have made a separate playlist and videos on LLM - kzbin.info/aero/PLOj3JD_j8uXGNyelFkB-5drdkiSQROrXQ
@dudeabideth44284 ай бұрын
Yeah so many words like embeddings are used with no context
@datafuseanalytics2 ай бұрын
Hello. I apologize for the confusion. Please let me know the timestamps. I will try my best to explain the context
@jayeshkurdekar1264 ай бұрын
The main takeaway is sensitvising decoder to the joint distribution...cool.great video thanks
@datafuseanalytics4 ай бұрын
Thanks a lot brother. I am very happy that you liked it. 👍
@SantoshPanigrahi305 ай бұрын
This was very insightful and thoughtful video. Great effort in highlighting these AI applications
@datafuseanalytics5 ай бұрын
Thank you Santosh. I am glad you loved the video. 😃
@theadchannel11685 ай бұрын
Really good explanation
@datafuseanalytics5 ай бұрын
Thank you. I am glad that you liked the video
@555soup5 ай бұрын
HI! I appreciate to upload this video. Can this code be used on any model? I have all ready training model!
@datafuseanalytics5 ай бұрын
Yes. This can be used on any encoder based model. And requires modification on decoder only and encoder decoder model
@555soup4 ай бұрын
@@datafuseanalytics Thanks for apply : )
@datafuseanalytics4 ай бұрын
@@555soup most welcome 😃
@marianafees61445 ай бұрын
i am confused.how i use my dataset in this code?
@datafuseanalytics4 ай бұрын
What kind of dataset do you have?
@user-tt2jf7lv9q5 ай бұрын
💀 bhai 200 error hau 😐
@user-tt2jf7lv9q5 ай бұрын
bohot error hai bruh🫠🥲
@datafuseanalytics5 ай бұрын
Hey bro. I have pushed the code on GIT. If the error is not solved, please email the snapshot at [email protected]. I will help my best to solve it.
@ghostboy4255 ай бұрын
Sir, many channels are here in English. Please, make video in hindi and use simple language because thought the subscriber is low but in them one change their life.
@datafuseanalytics4 ай бұрын
Okay brother. Thanks a lot for your suggestion. I will try my best 👌
@ghostboy4254 ай бұрын
@@datafuseanalytics sir, you record your video in English. Just use language translation app Or software to change language. Then make KZbin channel and upload videos hindi, bengali, tamil, taligu etc.
@datafuseanalytics4 ай бұрын
@@ghostboy425 I tried apps to translate in Marathi and Hindi languages. But the issue is their model was not able to convert few keywords and gave wrong information for few phrases. To overcome this, i will spend some time to manually correct those issues. Again, thanks for your suggestion brother 🙏
@ghostboy4254 ай бұрын
You can solv it in two way, 1st you apply filter 2 or more time and obsorved that line reduce or not 2nd way, after thans lation add subtitle in English and those language (use ai or google speach translator as you like) You must give option subtitles english and those language I hope 1st and 2nd way combination solv the problem If any problem face just share me By the way, my mother language is bengali and i wait your bengali and hindi ai learning channel Have a good day😊😊😊😊😊
@datafuseanalytics4 ай бұрын
@@ghostboy425 definitely. I will be trying this. 👌
@pictzone5 ай бұрын
thank you!! keep it up
@datafuseanalytics5 ай бұрын
Thank you. It really means a lot 😃
@datafuseanalytics5 ай бұрын
The implementation cab be found at - github.com/DiveshRKubal/GenerativeAI/blob/main/Generative_Adversarial_Networks/DCGAN_(Deep_Convolutional_GAN).ipynb
@amortalbeing5 ай бұрын
Thanks a lot. do you have in-depth explanation/tutorials for each of these? what should you do when your language model doesnt exist on HF? How should you go about adding one?
@datafuseanalytics2 ай бұрын
Hello. Yes, I have made new playlists which would definitely help you. kzbin.info/aero/PLOj3JD_j8uXGNyelFkB-5drdkiSQROrXQ kzbin.info/aero/PLOj3JD_j8uXHDFQSE28c0q3wszLcQQhTg kzbin.info/aero/PLOj3JD_j8uXEsxFZGcRyjI_ZawoSvCfti Please do visit the channel
@amortalbeing2 ай бұрын
@@datafuseanalyticsthanks A LOT
@samirchauhan62195 ай бұрын
Where can i get the Google collab code ??
@datafuseanalytics5 ай бұрын
Hello Samir. I will add it soon. Will reply to this comment once its pushed to git
@samirchauhan62195 ай бұрын
@@datafuseanalytics ok sir
@datafuseanalytics5 ай бұрын
Hello Samir, Please refer to this link for Implementation - github.com/DiveshRKubal/GenerativeAI/blob/main/Variational%20Autoencoders/Variational_Autoencoders_Implementation.ipynb I have added this link in video's description too
@yosup1255 ай бұрын
for the algo
@datafuseanalytics5 ай бұрын
Thank you
@acsport57285 ай бұрын
Can you train your model own transformer or I port from hugging face buddy?
@datafuseanalytics5 ай бұрын
Hello. Yes, you can definitely train your own model with custom layers.
@alaad10096 ай бұрын
Good video !
@datafuseanalytics6 ай бұрын
Thank you
@asheeshmathur6 ай бұрын
As usual the best description of VAE, @04:26, you said it develops mean and variance(its log) for each dimension. Does it refers to each channel of image . Also what is need for z_sigma and epsilon. 1. Is Mean and Variance not enough
@datafuseanalytics5 ай бұрын
Hello. In a Variational Autoencoder (VAE), the mean and variance are crucial for defining the parameters of a distribution in the latent space. However, sigma and ϵ (random noise) are essential for the reparameterization trick. This trick enables the network to sample latent representations by decoupling the sampling process from the network's parameters during training. zsigma scales ϵ to match the desired distribution N(μ,σ), making the sampling process differentiable and allowing for effective learning of meaningful latent representations while reconstructing input data.
@user-id6pd6wd3y6 ай бұрын
Your video is wonderful!You did save my life ,thanks!😀
@datafuseanalytics6 ай бұрын
Hey thanks a lot. I am glad that this video was helpful. 👍 😃
@asheeshmathur6 ай бұрын
Good Video clarifying VAE
@datafuseanalytics6 ай бұрын
Thanks a lot Asheesh.. glad it helped you.
@tuhindutta41606 ай бұрын
Very well explained
@datafuseanalytics6 ай бұрын
Thanks a lot Tuhin
@user-os1xi8qf4y7 ай бұрын
thank you sir ! Fantastic method of explanation
@datafuseanalytics6 ай бұрын
Hey buddy. Thanks a lot. 😀
@datafuseanalytics6 ай бұрын
Hey buddy. Thanks a lot
@user-os1xi8qf4y7 ай бұрын
sir amazing method of teaching
@datafuseanalytics6 ай бұрын
Hey Thanks a lot
@user-td5kh2ld9b7 ай бұрын
Possible to do this with zephyr model.(mistral model) ?
@datafuseanalytics5 ай бұрын
Hello. Yes definitely. I have not worked on Zephyr model yet. But I researched a bit about your query and found these links to be effective - towardsdatascience.com/zephyr-7b-beta-a-good-teacher-is-all-you-need-c931fcd0bfe7, arxiv.org/pdf/2310.16944.pdf, www.unite.ai/zephyr-7b-huggingfaces-hyper-optimized-llm-built-on-top-of-mistral-7b/
@sanjaykrish87197 ай бұрын
This is fantastic 😍
@datafuseanalytics7 ай бұрын
Thanks a lot. Appreciate your valuable feedback. Please do share with Data Science enthusiasts 😃
@datafuseanalytics7 ай бұрын
Hello everyone, Hope I was able to simplify Generative Adversarial Network using this story. 0:00 Introduction to Generative Adversarial Networks 0:19 The Start of GAN Story 0:44 Let me introduce Generator and Discriminator 1:09 Alice deciding to use Generator and Discriminator to generate Paintings 1:30 Discriminator catches Fake Generated Paintings by Generator 2:06 Training of Generator and Discriminator based on Feedback 2:21 A Happy Alice 2:42 Powerful Generator and Discriminator 3:04 History of GANs - Ian Goodfellow's 2014 Research Paper - Generative Adversarial Nets 3:46 Architecture of Generative Adversarial Networks Please give me a feedback so I can improve in next tutorial videos...
@falknfurter7 ай бұрын
I just found this video and it's very good. I'm currently trying to understand when to use what type of model. Looking at Huggingface is just overwhelming. That's where this video jumps in and provides an excellent overview of the major models. I wish there would be a similiar video explaining the various pretraining objectives.
@datafuseanalytics7 ай бұрын
Hello. I will definitely make a video on the same. Thanks a lot. 😀