PyTorch in 100 Seconds

PyTorch is a deep learning framework for used to build artificial intelligence software with Python. Learn how to build a basic neural network from scratch with PyTorch 2.
#ai #python #100SecondsOfCode
💬 Chat with Me on Discord
/ discord
🔗 Resources
PyTorch Docs pytorch.org
Tensorflow in 100 Seconds
Python in 100 Seconds • Python in 100 Seconds
🔥 Get More Content - Upgrade to PRO
Upgrade at fireship.io/pro
Use code YT25 for 25% off PRO access
🎨 My Editor Settings
- Atom One Dark
- vscode-icons
- Fira Code Font
🔖 Topics Covered
- What is PyTorch?
- PyTorch vs Tensorflow
- Build a basic neural network with PyTorch
- PyTorch 2 basics tutorial
- What is a tensor?
- Which AI products use PyTorch?

[@Telhias]

The more I learn about Python, the more it seems like good python code should contain as little code in python as possible.

[@r0manuks]

Try to build a table completely out of glue. Same thing, you want to use as little as possible

[@ipodtouch470]

Good python code seems to follow the following pattern import taskDoer doer = taskDoer doer.do_task()

[@SI0AX]

IMO, the less code something has, the better. *Especially* when it's boilerplate code. Sometimes I believe people have a typing fetish... I actually have a coworker that likes typing and he writes a lot of repetitive code and does not recycle the code.

[@MrRaja]

​@@SI0AX now he can beautify his code using gpt4. Don't show it to him it'll break his heart

[@mrgalaxy396]

​@@SI0AX You mean the less code _you_ have to type the better. We all want complexity abstracted away with nice easy to use APIs we can just chain to get things done, but there's still a bunch of code someone else had to write running in the background to get that thing done.

[@Kuznet609]

I have understood nothing.

[@cre8ive65]

I did my final project for my degree last year using TensorFlow. I'm tearing my hair out now learning about PyTorch, this looks like it would have saved me so much time and suffering 😭

[@suyashshrestha1099]

Is TensorFlow not worth learning than PyTorch?

[@akj3344]

@@suyashshrestha1099 Just pick one and go with it. Once you understand one of them, you can pick up the other in 2 hours or something.

[@SI0AX]

There are actually *very* few differences between the 2. Their use cases may differ, but that really only because of what a company decided to use for their project. You can actually switch from one to the other with little effort.

[@yourmomsboyfriend3337]

I agree with the above commenters, but if you are familiar with Numpy, USE PYTORCH. Numpy is extremely similar to PyTorch, and they even share an astounding number of identical functions, where PyTorch’s version just operate on tensors instead of numpy arrays and can use your GPU. Creating an array in numpy can be done identically in PyTorch with the Zeros(), Ones(), and empty() functions. They also connect very well, there’s even a from_numpy() function to get convert between the two

[@AmodSandeepa]

Pytorch is majorly used in academia and TF in the industry. Personally I found TF easier to learn than pytorch. Both are great in their own ways.

[@SpenceDuke]

kinda wish this was PyTorch in 1000 seconds

[@Officialjadenwilliams]

I absolutely have loved your videos for so long. Thank you for the incredible production quality and fast-paced information made simple!

[@whit3rose]

Let's develop a deep neural network to find who made the chicken.

[@hatnis]

botted subs momenttt

[@KingThrillgore]

Jaden moment

[@fahd2372]

@@whit3rose A dinosaur made the egg that mutated and made a chicken

[@tixonochek]

@@fahd2372 not really

[@JulianHarris]

Absolutely brilliant combination of conciseness and coverage.

[@1008OH]

I used PyTorch for my thesis and it was really easy to use, I loved the modularity of everything

[@sr.luisraytraceiii2422]

YoloV8 and Mindsdb is a great thing for us smooth brains. 😊

[@ramandeepkaurbanvat7583]

how did you got to learn pytorch can you tell me. I am interested in learning it but not able to find best source

[@nebuchadnezzarii6423]

what was the thesis on?

[@erikawwad7653]

@@ramandeepkaurbanvat7583 just use the documentation. what task are you trying to accomplish?

[@olcaybolat3452]

@@ramandeepkaurbanvat7583 If you finally got a good source, can you also share please

[@Wilton24]

Amazing explanation as always. Short yet concise. I hope you live 100+ more years.

[@Herdol90]

Such large concept in 100 seconds? Just brilliant work. Thanks!

[@bentaylor1153]

your 100 second videos seem to come out exactly when I need them. I just started a AI, ML project this week.

[@Pramit2000]

And I am starting now

[@mujibshaikh7494]

Will you please share details about your AI ML project

[@doomgirl5341]

​@@mujibshaikh7494SHUT up

[@RobertoKv]

I was just about to request this one! Thanks a lot!

[@HeyFaheem]

It's Impressive that You Have Knowledge/Intuition in Many Field. Keep On!

[@scottvickrey2743]

Keep them coming! I love these 100 second videos!

[@josejuan98]

Wonderful video!!! I would love to see Scala in 100 seconds next :)

[@SillyLittleMe]

Learning PyTorch currently and it was nice seeing you make a video on this topic.

[@jaktrak]

The code looks so much easier to understand then I expected. That's what makes me so excited and scared to even try this kind of thing.

[@theone5312]

Now I'm ready to start my Data Science career. Thank you Fireship!

[@marktyshchuk]

The best video tutorial on PyTorch I have ever seen. All the courses on this topic are so complicated but your video is an amazing one. I learned more than I have in a year. Thank you so much Fireship!!!

[@nickshapiro8308]

Always great info on this channel. Thanks!

[@moccomocco]

MORE DEEP LEARNING STUFF IN 100 SECONDS! I remember going through courses that took literally freaking days... tons of crazy equations and weird explanations... this stuff is gold man.

[@sanjaisrao484]

Thank you for a brief overview, It was so helpful.

[@latedriver9019]

The data you provide is invaluable when it comes to keeping me up to date with the tech around me. As a developer, I can't thank you enough.

[@erickmaraz9753]

Great video! :) I.think it would be important to add the backforward step in pytorch so people could see the complete cycle of training a NN.

[@redcraft612]

Interesting video. Keep up the good work 👍

[@megamind452]

Me clicking in 1 sec the notification drops

[@dhirajnavale3861]

Parkour

[@ApoorvPandeyDev]

Here for you🏆

[@Philopater-Phoneix]

​@@dhirajnavale3861 😂😂😂

[@horizont6172]

Script

[@saladmancer8151]

Me here complaining how my notifications are always 1hr late. Does anyone know why?

[@ruturajvyawahare9089]

This is the only channel I have the bell 🔔 for notifications because of its pure quality of content 🔥

[@jordanmalfara1501]

Alright man. Seriously? You have my computer bugged don't you? I swear, every god damn side project I start the next week we get a video with perfect relevance. I love you

[@sir_no_name1478]

Very good and concise explained, as always ^^

[@Tristan-mr3pk]

Always look forward to these videos

[@genzprogrammer]

Thinking of this, Pytorch is trending and why there is no 100 second video from Fireship. Just got into machine learning in pytorch. Absolutely 🔥🔥. Need a comparison with Tensorflow. 5days before the version 2 became stable.

[@Imperial_Squid]

It depends a bit on your use case, pytorch is better for prototyping/research/personal projects but tensorflow is more easily deployable in the real world As an ML researcher I love pytorch personally and can't recommend it enough but tensorflow has its upsides too

[@genzprogrammer]

@@Imperial_Squid Never tried Tensorflow before. Can I ask you something?, Which is more compatible with mobile devices. Tried pytorch with coreml and onnx. As ML researcher, which one do you prefer in case of Mobile/Edge devices

[@Fighter05]

Tensorflow has been around a lot longer. Its why its used in industry. It recently combined with the Keras library and got a lot of functionality from that. Pytorch itself is much newer and is used today more so as a way to build models. A lot of people, myself included prefer Pytorch for its usability. I personally think Pytorch is going to surpass Tensorflow because the magic of deploying a model has been demystified for awhile now. Its all about applied model accuracy; preventing overtraining etc etc. This is just flat out easier with Pytorch. Integration of a model with an API really is not an issue today.

[@gabrielblanco2969]

For deploying I'd had to say Tensorflow... Buf. I'd rather go with Torch. Sometimes not even the toy examples from TF doc works. Too much change from version 1 to 2. I'd stick to Torch

[@rikthecuber]

I just started learning pytorch and here is Fireship!

[@leoingson]

Great little intro to CUDA in here! Would like to see a video giving an overview on GPU layers (AMD ROC and whatnot), and maybe the associated hardware situation right now. CUDA/NVIDIA gets way too much press, it seems.

[@ggorg0]

We need a full length tutorial on PyTorch!

[@soham6649]

Great Video. Amazing demonstration of deep learning in Tesla Autopilot!

[@gianovici4008]

It amazes me to how much I can grasp in 100 seconds compared to what I might learn in a semester.

[@tropicaldog430]

Nah you must be joking lol

[@3kelvinhong]

@@tropicaldog430 it can be real, education in school don't teach very well especially on relatively new tech like this.

[@lottexy]

you're not wrong tbh, if you go to a garbage school then yeah, any youtube video is better than your semester at your school.

[@gianovici4008]

@@lottexy I go to the toughest school to get into. I go to IIT Kanpur which is like Indian MIT. Where I study statistics and data science

[@MagnuSagus]

But this does not teach any theory or reasoning as to why you would do certain things. And what the effects of these things are. But I guess if your school is trash, then you probably learn more here.

[@ancientserenade]

Wow i thought i will learn pytorch but now i have learned neural networks as well as pytorch. Thanks!

[@TheSoprah]

Hello @fireship, Can you please make a video about the python framework "flask" ? I am still confused about the functionalities and benefits of flask.

[@randomdev4246]

i really love this feeling of knowledge flowing through my brain, and none leaving after 2 seconds

[@user-hs4zz1pq3i]

let me cry a bit

[@curiousphilosopher2129]

Book recommendation: "A Primer to the 42 Most commonly used Machine Learning Algorithms (With Code Samples)."

[@v14mpo-fw5sd]

HAHAHA the tesla autopilot snippet killed me 😂 great vid man ❤

[@shahonsoftware]

This video is a most excellent example of how to summarize!!!

[@abrh2793]

Looking forward to more AI stuffs! Keep up the good work!

[@michaelgatmaitan1797]

This is what I've been waiting for

[@tylerbaum4295]

For all both of us out there using Haskell, there is an implementation of Torch being developed for the language called HaskTorch.

[@Alexis-hj6ci]

Also exist other for Tensorflow.

[@spandanmanna5753]

Video Suggestion: Tensorflow vs Pytorch😊

[@sharkPause1]

i have no idea what i'm hearing but i'm definitely excited about it

[@jeremy1991]

Just what I needed.

[@picoplanetdev]

Exciting! I've been meaning to get deeper into pytorch at some point

[@ujjalkhadka]

Keep it coming.

[@jeffkevin3]

FINALLY! FINALLY! FINALLY! FINALLY! FINALLY! Thank you Jeff!

[@reignydaphne]

You are an amazing teacher♥️ Please don't stop making these kinda videos 🥹♥️♥️

[@ahmedel-sinousy4848]

video is wonderfully useful.❤

[@nattherman7321]

woah, got an ad with your voice before this video, really trippy

[@omomer3506]

I understandthe words you used individually but strung together i got lost, still loved it

[@zeldamage001]

0:18 "... tensors, which are basically just multidimensional arrays" cries in mathematics, hearing computer science

[@NabeelFarooqui]

Fully utilized those 100 secs

[@gregoryneedsaname]

You summarized about 2 hours of Google searching in about 100 seconds. Nice job!

[@labibtanhar552]

waiting for this one❤

[@carlosrodriguez8698]

I have no idea what you just said, but I loved it.

[@thethiny]

Can you make a tutorial on how to pick the right cuda version for use with Docker?

[@nneural]

this video was so comprehensible i totally know what you're talking about.

[@mylesbuckley9675]

Love your videos ❤

[@loctite417]

Amazing video!

[@BlueEighthNote]

The timing of this video couldn't be any better because I'm working on some AI project with Pytorch right now :)

[@John_Versus]

Haha me too. I am downloading the ai models for the first time at this time just before the video

[@valentinoedits1963]

Just curious, what are you working on?

[@BlueEighthNote]

@@valentinoedits1963 some analysis about anime music cd sales

[@yozhis1]

now everything have that AI badge. you worked on web3 project before, right?

[@isaiahcastillo898]

@@BlueEighthNote i want to get into AI where do I start, already learning from coursera.

[@paulwal222]

Can you make a series on the youtube API? I wanna use it to auto-add technologies to my resume whenever you drop a new video.

[@maj3735]

This is brilliant

[@joevtap]

Finally I can say you read minds and released a video about something I just started learning

[@VaibhavShewale]

well that was more then 100 seconds more information then any videos!

[@marcinchaciej6528]

understood everything perfectly, gonna code skyned

[@de-kat]

can you pls do a short pytorch vs tensorflow video?

[@gtgunar]

Damn... started learning PyTorch for an interesting faculty, and you are here from the blue. THX for the vid, Torch really deserves more audience.

[@paprikar]

Btw, originally torch was library for getting the jacobian of functions

[@OhDoggy01]

but what about dagster tho (/s but not really?) thank you as always for the great content!

[@ABCABC-sw8mh]

thanks. dont stop

[@artifishul]

I'm dying at the crash at 0:53

[@cerulity32k]

OOOOOOOOOO I GOTTA TRY THIS

[@ryanclark1784]

As always, straight banger

[@mukkupretski]

I'TS A SCALAR NOT A SCALER

[@DANJUMA9]

Thanks for this. Been trying to do more than django/flask with python and this is my next learning step

[@ninhdang1106]

I always consider that ML/AI/Data is the main usage of Python and web framework like Django/Flask is just "hey we can do web dev using Python too!"

[@SI0AX]

PyTorch is a more advanced version of "Machine Learning". Learning PyTorch without learning ML with scikitlearn is like learning to run without having learned to walk. AI is basically ML but scaled up and with extra algorithms on top, but it still applies ML logic.

[@DANJUMA9]

@@SI0AX gotcha so go ML first before pytorch. Thanks for the advise

[@jakubwojciechowski9697]

0:52 I love these satirical inserts :D

[@LokeshWankhede]

Excellent explanation, Everything went over my head though.

[@axtept66666]

you're just watching this for fun

[@JackTheDev]

does it use CTypes for controlling it all so it is not as slow as python? it does use tensor cores so it should be ok? But just wondering.

[@zain5251]

It uses numpy I think, and that uses C. Which makes it fast

[@crnpowerimmortal]

I regret using tensorflow now, I had recently tried updating to latest tensorflow and found gpu support was dropped for windows. Now have to use wsdl and other workarounds just to speed up the training.

[@dennismuller1141]

I think you get way better results for an image classifier if you start with a convolutional layer instead of flattening the input instantly. I havn't tested it though.

[@adefiqri8218]

Agree, but this video is just a basic introduction to PyTorch in 100 seconds. Introducing the convolutional layer makes the video even longer.

[@discoline10191]

I would have appreciated a little more at the end showing how your neural network was working, perhaps with a simple UI

[@liveitout]

Within 10 minutes... This video is in recommend feed🔥

[@Manicsar1]

So is Intel working to support PyTourch via OpenAI or are they just adding support for Arc GPUs?

[@Cypaa_]

Looking at a fireship video with a fireship ad lmao

[@SomeRandomPiggo]

I like how it's speeding up ML research but also it's so slow and hard to set up!

[@sircharlesross537]

I’m going to pretend like I understood approximately 1 second in this video

[@shahar856]

Please do a video on control version - perforce

[@FridgeFucker96]

You're videos are so entertaining even though I don't understand a thing lol

[@HH-mf8qz]

So it’s the same as tensorflow? Including tensors, cuda an a computation graph

[@Felix5]

You are the only coding/tech youtuber I know of that talks fast enough to keep my ADHD brain interested. Love your videos.

[@WolfPhoenix0]

I have no idea what Fireship talked about in this video but he made it look awesome. 😂

[@luluw9699]

After learning Pytorch and seeing this vid, it gives every basic info

[@ruslanyusupov793]

what is the name of the effect with the appearance of the logo at the beginning of the video?

[@TheReal4L3X]

you litterally can read my mind. today i said it would be my first day learning python since i wanted to learn a language towards neural netwworks and ai... since javascript doesnt do that 💀

[@edumorlom]

love these videos

[@javamastery]

Pytorch tends to be difficult. How do you make the logo intros for the topics on your channel such as pytorch??

[@Oreoezi]

since there are svg versions for all of them, an easy way would be to import them as sprites in a 3D software and add the same emissive material to them, at most changing the color and the color of the background.

[@javamastery]

@@Oreoezi okay thanks so much