Pytorch TensorBoard Tutorial

An in-depth guide to tensorboard with examples in plotting loss functions, accuracy, hyperparameter search, image visualization, weight visualization as well as tensorboards visual embedding or projector.
The functions we look at from Pytorchs tensorboard are add_scalar, add_image, add_histogram, add_embedding and add_hparams.
❤️ Support the channel ❤️
/ @aladdinpersson
Paid Courses I recommend for learning (affiliate links, no extra cost for you):
⭐ Machine Learning Specialization bit.ly/3hjTBBt
⭐ Deep Learning Specialization bit.ly/3YcUkoI
📘 MLOps Specialization bit.ly/3wibaWy
📘 GAN Specialization bit.ly/3FmnZDl
📘 NLP Specialization bit.ly/3GXoQuP
✨ Free Resources that are great:
NLP: web.stanford.edu/class/cs224n/
CV: cs231n.stanford.edu/
Deployment: fullstackdeeplearning.com/
FastAI: www.fast.ai/
💻 My Deep Learning Setup and Recording Setup:
www.amazon.com/shop/aladdinpe...
GitHub Repository:
github.com/aladdinpersson/Mac...
✅ One-Time Donations:
Paypal: bit.ly/3buoRYH
▶️ You Can Connect with me on:
Twitter - / aladdinpersson
LinkedIn - / aladdin-persson-a95384153
Github - github.com/aladdinpersson
OUTLINE:
0:00 - Introduction
2:08 - Initializing SummaryWriter
2:55 - Creating a loss and accuracy plot
5:40 - Doing Hyperparameter search
16:36 - Visualizing Dataset Images and Network Weights
20:55 - Tensorboard Embedding Projector

[@HeadshotComing]

I was really fortunate to stumble upon this tutorial, it's pure gold! Decided to check your other videos on the channel real quick, I've eventually spent the last hour going through them! You're doing an amazing job with your videos, thank you :)

[@deepshankarjha5344]

the only comprehensive video on tensorboard. I am creating ANN using tensorflow and pytorch from 1 year but never knew the utility of this tool. thanks for sharing this knowledge.

[@AladdinPersson]

I appreciate the kind words 🙏

[@amnesie148]

I would recommend your videos to my friends who are still struggling with deep learning. Thank you again.

[@lecteranxa]

Thank you! Very helpful video

[@mahdiesrafili2809]

Thank you so much Aladdin, your explanation is great. I'm watching you videos for last two days non-stop. Well done

[@anonyme103]

Dude, I'm really learning a lot from your videos, thanks and keep up the cool work!

[@wernerlucas12]

Your videos are just gold! Thanks for doing this!

[@boxiongtan69]

Thanks! Very helpful

[@lingfengshen8559]

Great video with clear explanations! I do get insights from your work! Thank you.

[@ImanSh]

Your explanations were great. Thank you so much.

[@hizircanbayram9898]

Thank you for this great tutorial. It gives me the main topics I need to check in the docs and the first intuitions about the framework. Keep up with the good stuff!

[@AladdinPersson]

🙏

[@supervince110]

Your videos have helped me a lot!

[@saeedrehman5085]

LOVED IT !

[@salmaelghourbal9622]

very nice tuto ! I love your videos !

[@akhilezai]

Wow this is awesome!

[@talha_anwar]

Learnt a lot. Thanks

[@dmitrikochubei3569]

This is a really cool video, thanks making it !

[@AladdinPersson]

Glad it was useful :)

[@ruotianzhang3139]

Thank you very much!

[@harshkumaragarwal8326]

This is really helpful, Thanks :)

[@harrylan9495]

visdom hope to see that!THANK YOU!

[@zijingwu7547]

thanks for the video!

[@samuelkellerhals5942]

Really nice video, I'm inspired to use tensorboard now!

[@AladdinPersson]

Thanks I appreciate that a lot

[@carlosroquesuarezgurruchag8681]

thanks for the time.

[@ereh3423]

amazing class

[@christopherwashington9448]

I suggest you move the part of code you are working on in the middle of the screen. It was blocked by the video progress bar all the time.

[@AlbertMunda]

This is very impressive work! Thank you very much @Aladdin

[@robertbracco8321]

Extremely well done video, thank you! I'd be curious to hear your thoughts on the various libraries built on top of PyTorch like Pytorch-lightning and fastai/fastai2.

[@AladdinPersson]

Thank you for the kind words, really appreciate it. I'm very interested in learning more about Pytorch lightning but at this point I'm not too familiar with any of those libraries unfortunately. My view currently is that Fastai seems to be a library built to simplify things further, so that you can build state of the art models without diving into too much details (tailoring to the fastai mindset of a top-down approach).

[@jianxiangdong3481]

Very good video! Thank you so much. You mentioned in the video that the common way to do hyper parameter search is in log space? What is it?

[@Kwaiigurlie]

Thank you for sharing valuable series on Pytorch. At time 19.44 in this video, you are showing orange bar to change the images in different batches, however with same code typed by me, i am not able to get the orange bar. please look into this and suggest.

[@MorisonMs]

Thanks bro

[@ZobeirRaisi]

Great video

[@AladdinPersson]

Thanks I appreciate it :)

[@justaguynamedjosh4530]

Hey! I learned a lot from your videos! Just wanna request a video on how to do Confusion Matrix using Pytorch using the code you've been using. As a beginner, I'm having a hard time understanding how to get the metrics required for confusion matrix. Anyway, Thanks!

[@Xurshid_Mirzayev]

THANKS

[@AD-ox4ng]

At 6:37 you mention it's not the best way to do hyperparameter search, aren't the learning rates already on a log-10 scale? In any case, do you have other videos exploring hyperparameter search?

[@massisenergy]

Everything works for me except the last step of 'embedding projector'. It says: 'warning: Embedding dir exists, did you set global_step for add_embedding()?'

[@MorisonMs]

10:00 For some reason some of the graphs are totally fine and some doesn't show up at all or they show up but to a very limited step. Did this happen to some of you?

[@DIYGUY999]

Hey , I tried executing the tensorboard command, but nothing shows up.

[@arjunpukale3310]

Csn we visualize rgb images in tsne?

[@AladdinPersson]

Yeah if I remember correctly I tried it on CIFAR10 as well, but perhaps I didn't show that in the video