PyTorch 2.0 is here! Quick tutorial + NVIDIA RTX 4080 giveaway

The official version PyTorch 2.0 just launched! In this video, I break down some of the updates and how you can use them in your PyTorch code.
Sign up for NVIDIA GTC March 2023 - nvda.ws/3GUZygQ
Details for giveaway - www.mrdbourke.com/pytorch-2
NVIDIA GTC sessions I'm going to:
Compile and train with 43% speedup using PyTorch 2.0 - dbourke.link/nvidia-gtc-2023-...
Fireside Chat with Ilya Sutskever and Jensen Huang: AI Today and Vision of the Future - dbourke.link/nvidia-gtc-2023-...
Exploring next-generation methods for optimizing PyTorch models for inference with Torch-TensorRT - dbourke.link/nvidia-gtc-2023-...
FP8 Mixed-Precision Training with Hugging Face Accelerate - dbourke.link/nvidia-gtc-2023-...
Generative AI Demystified - dbourke.link/nvidia-gtc-2023-...
PyTorch 2.0 resources:
PyTorch 2.0 technical overview - pytorch.org/get-started/pytor...
PyTorch 2.0 release notes - pytorch.org/blog/pytorch-2.0-...
PyTorch 2.0 on TIMM/Hugging Face models - pytorch.org/blog/Accelerating...
PyTorch 2.0 speedups on Diffusers - pytorch.org/blog/accelerated-...
Which GPU for deep learning by Tim Dettmers - timdettmers.com/2023/01/30/wh...
Make deep learning models go brrrr by Horace He - horace.io/brrr_intro.html
My PyTorch 2.0 code intro - github.com/mrdbourke/pytorch-...
My PyTorch 2.0 benchmarks - github.com/mrdbourke/pytorch-...
Other links:
Learn AI/ML (beginner-friendly courses I teach) - www.mrdbourke.com/ml-courses/
AI/ML courses/books I recommend - www.mrdbourke.com/ml-resources/
Read my novel Charlie Walks - www.charliewalks.com
Connect elsewhere:
Web - dbourke.link/web
Twitter - / mrdbourke
Twitch - / mrdbourke
ArXiv channel (past streams) - dbourke.link/archive-channel
Get email updates on my work - dbourke.link/newsletter
Timestamps:
0:00 - Intro
0:10 - torch.compile()
0:53 - PyTorch 2.0 speedups
2:01 - PyTorch 2.0 new technologies
2:22 - Operator fusion
4:00 - Graph capture
5:14 - Other notable PyTorch 2.0 features
6:00 - GPU time
11:30 - NVIDIA GTC information and GPU giveaway details
#pytorch #ai

[@daironperezfrias7819]

PyTorch 2.0 comes out and I'm still watching and studying your 25-hour course, right now I'm going for hour 9, I hope to finish it on time, but I love your course and I'm learning everything well, Thank you for all the content you put on youtube Greetings

[@mrdbourke]

Glad you’re enjoying the course Dairon! Thank you for the kind words!

[@daironperezfrias7819]

@@mrdbourke Thanks for everything, sorry my english

[@AI_Escaped]

I'm on hour 1.5 and just discovered PyTorch 2.0, great, lol, at least you have a 5 month head start on me.

[@daironperezfrias7819]

@@AI_Escaped a lot of thig that happen in the life, now i especialice in neo4j for work and in my free time i study unreal engine for a game dev

[@PineTreeEnvy]

Wow! Really excited to see the improvements from 2.0. Time to spend a few hours going through your Pytorch tutorial XD

[@mrdbourke]

2.0 brings some epic improvements!

[@PenandPaperScience]

That GPU looks massive :D Good luck to all that enter the giveaway :)

[@chiragsharma9430]

Thanks Daniel for compiling all the reading material.

[@mrdbourke]

You’re welcome Chirag!

[@Jonathanimpossible]

Still the GOAT in ML library tutoring.

[@mrdbourke]

👊

[@togo7022]

Had to stop the video to checkout about the Horace blog post, it is blowing my mind right now and I can feel the lights turn on in my head 😂

[@rohanchess8332]

I got some models to train! I love it!

[@tweizh]

Thanks. I like the way you explain with a blender.

[@jamief06]

I'm gonna need a bigger case!

[@steeltormentors]

"it lights up!!" xD awesome congrats for the 4080

[@vikashchand.]

Nice! 🔥

[@mrsecretstatus9999]

Can I follow your old for PyTorch?

[@abdoualgerian5396]

will you update the udemy course with whats new in Pytorch 2.0 ? i think iwill reach the paid last 4 or 5 sections soon !

[@mrdbourke]

yes for sure, there’s already a new tutorial starting here: www.learnpytorch.io/pytorch_2_intro/

[@capocianni1043]

thank you

[@tanradsan]

Nice

[@muhammadanas7698]

I'd love to win it!

[@qiyang7234]

Compare with 4080 and 4090, why did you choose the 4080 one?

[@mrdbourke]

I’d personally choose a 4090, however, NVIDIA offered to send 2x 4080s for free

[@qiyang7234]

@@mrdbourke 😆 Yeah, if they give me 2 for free, i will also accept 4080. For Deep learning requriement, 2x 4080 and 1 x 4090 which one you will suggest to? If we dont need to consider the cost, but just for performance and efficiency

[@pen1208]

would be pretty sick to win. great vid as usual. always enjoy the enthusiasm.

[@mrdbourke]

Thank you Paul!

[@AnimeLeech]

Thanks for this sweet opportunity 😘

[@nourinahmedeka9518]

What an exciting video!

[@mrdbourke]

Glad you enjoyed!

[@perpetuallearner8257]

I don't use Twitter 😭

[@masterbaits4108]

lesss gooooooooooo

[@akj3344]

It's a shame i don't use Twitter and never will.

[@romanjay3551]

❤ ** 20.

[@TearyBoi]

God it’s so painful to see you use userbenchmark as a GPU comparison tool

[@agiengineer]

Love dragon Ball ❤

[@mrdbourke]

Me too 👊

[@gazolinanam067]

Daniel please that to me 😭😭😭😭 I am in Africa Namibia

[@gofudgeyourselves9024]

Where's the dance mate?

[@mrdbourke]

Hahaha you’re right! Next video!