The Unofficial PyTorch Optimization Loop Song

A fun song to help you remember how to write a training loop and a testing loop in PyTorch.
The jingle is not endorsed by PyTorch whatsoever.
Materials for this video come from the Learn PyTorch for Deep Learning book - learnpytorch.io
Learn PyTorch for Deep Learning course (coming soon) - github.com/mrdbourke/pytorch-...
Connect elsewhere:
Web - dbourke.link/web
Twitter - / mrdbourke
Twitch - / mrdbourke
ArXiv channel (past streams) - dbourke.link/archive-channel
Get email updates on my work - dbourke.link/newsletter
#pytorch #deeplearning

[@andreplo]

At first, I thought that this was the cringiest thing I've ever witnessed. After a few days of doing your course I caught myself singing to this song while writting my loops. Thank you for this masterpiece!!

[@NicholasRenotte]

This is so damn good, when’s the mixtape dropping?!

[@e0n662]

My god. This guy is the ideal boyfriend. From fitness, to ML contents to learning efficiently, to a musician, to side hustles. Your partner would be lucky to have you. P.S, you are an inspiration. I am just a fan.

[@mrdbourke]

I showed my girlfriend this comment and she loved it - thank you for the kind words

[@user-bv5vt1dt8d]

Okay Daniel, we will still love you

[@mrdbourke]

❤️

[@justinclark8673]

Daniel, taking your class now. Your teaching style is great. Your enthusiasm infectious. Thank you for your wonderful lecture series. I love this.

[@zayyanushuaibu6188]

I almost give up to master the training loop procedure, your course and the song have make it very easy for me. Thank you so much.

[@mrdbourke]

You got this! Just remember… “for an epoch in a rangeee 🎶”

[@thimothelamoureux5718]

Hey Daniel, thanks for your great PyTorch course with clear explanations and for being yourself. I wasn't a big fan of the song but it is catching me by surprise. Most interestingly, after 1 play of your song, my partner can now "train a model" despite having no ML interest :D

[@mostafamohamad8210]

Awesome , thank you I will never forget it

[@krutikashimpi626]

Enough now... I'm adding this to my playlist. 🎶

[@Aliaksandr89]

jajaja. I like it. currently im whatching the Pytorch course. It´s soo good. Congrats

[@yashbachhav6962]

This is so amazing Sir🎵🎵

[@niundisponible]

I am in the time series chapter of your TensorFlow course in Udemy (I recommend it, as still TensorFlow is the most popular framework for deep learning), I can't stress enough how much I've learned thanks you your helpful material! Wish you loads of success man, and don't stop!

[@mrdbourke]

Glad to hear you're enjoying it!!! thank you for the kind words!

[@criticalanalyst7546]

Daniel i am literally obsessed with your content, love u, keep it up. some questions, how much machine learning do we need to learn to land a job? how many languages? is python sufficient?

[@mrdbourke]

Thank you for the kind words. Python is sufficient to start, maybe a little bit of SQL. Here is my best advice on getting a job: www.mrdbourke.com/how-can-a-beginner-data-scientist-like-me-gain-experience/

[@kakyoism]

It inspires me that coding is storytelling, and telling a story through music is essentially how our ancestors told many long-lasting lores. That art is not lost from our coding tribe! Thanks Daniel

[@daletrusky2052]

Added it to my study playlist so i will neveerrrrr forget Good book selection at the end btw

[@vasanthvel501]

His way of teaching 5/5 . I'm searching my One Piece (day 7 -> learning PyTorch with his lecture) 🔥

[@irshaadbahemia666]

Hello Daniel Bourke, do you work both structured data and unstructured data?. If you work with structured data as well do you perform data normalisation into 1NF, 2NF, 3NF and sometimes use SQL ?

[@dhruvilshah7770]

Hey! in the video setting m1 pro MacBook Pro for machine learning video if the base terminal changes due to some circumstances how can I get back to base terminal ?

[@philipbutler]

Thanks Daniel. Now while doing my ML hw I can't read "loss" without singing in my head, "Calculate the losss"🎶 lmao

[@mrdbourke]

Hahaha! That’s epic to hear! The jingle is stuck in my head too… I feel like I want to learn everything via jingle now

[@matthewkay1327]

In the grim dark future of the 40k yadda yadda mankind's tech priests sing songs to the machine spirits. . . . This is that song.

[@sanjayn5201]

We still love you Daniel...

[@razbarryz]

LEGENDARY

[@thabocalebjen]

Excellent teacher!🤣

[@karthikbharadhwaj9488]

I want a DJ version of this masterpiece ! 🕺🕺

[@zombeeDeadPool]

thankyou guru ji

[@shubhamgattani5357]

Yes, I admit that I sing this song every time I am writing the Training loop

[@SerobZeromintis]

at first I tought it was kind of cringe lol, but now I think this is pretty funny haha, thank you

[@xXMaDGaMeR]

cheezy, love it.

[@LLlikeme]

Still my sensei! ❤❤

[@akashuday7107]

the beat drops hard

[@praveenpitawala8422]

i like it broo.....

[@timandersen2386]

The best 100% best

[@phonethiriyadana]

Next step is official music video with instruments 😄

[@__-vk2gk]

He can sing too?! geeeeez amazing!!!!

[@merv893]

Cring time lol, best teacher. Feeling bit sick after that. Thanks for all the free training

[@mrdbourke]

Hahaha! I need to practice my singing skills :P

[@meeqvin]

omg he is enjoying with his song .as i do

[@dreamphoenix]

This is going platinum! Thank you.

[@mrdbourke]

Losssss backwardsssss!

[@tusharpatel2003]

Heyy, Denial you are very best teacher i want to mee you in physical mode 🙌❤️

[@harsha4074]

spotify link?

[@VsVBattery]

The calves on this guy, jeeez...

[@ShivanS]

is this on spotify? they should at least teach this in school. c'mon now!

[@mrdbourke]

Coming to a streaming service near you soon

[@paulrowland9741]

@@mrdbourke I have done your tensor flow course on Udemy. However I would love it if you had one o Pytorch - Do you?

[@zoroXgamings]

Are we really doing it 😎 pytroch now

[@mrdbourke]

We sure are, stay tuned for more ;)

[@davepunk2077]

Daniel do you have a song in spotify?😅

[@mrdbourke]

Perhaps I should release ML-based songs to Spotify! hahaha

[@davepunk2077]

Cant wait bro😂😂

[@king-sd5mp]

Today I became your student sir

[@philipbutler]

W

[@saminchowdhury7995]

Or alternatively Pytorch Lightning ⚡

[@mrdbourke]

Very valid alternative

[@10mgentile]

Does Tensorflow have a song too?

[@mrdbourke]

“Build the model, call model dot compile, set the loss, optimizer and learning rateeeeee, call model dot fit and watch the loss go down down down!”

[@ShaikAsad]

hahaha nice!

[@Romb_Studio]

100%

[@btp9576]

Come up with a PEMDAS for this and it will sink it too haha

[@aliyusifov5481]

Does it mean PyTorch course is coming?😍😍😍😍😍😍

[@mrdbourke]

Stay tuned ;)

[@timandersen2386]

Toe tapper

[@mrdbourke]

🕺

[@peterwan1808]

This is based 😎

[@amadios9874]

that's borderline genius

[@ApteraEV2024]

Nice!!)) L😆L £♡✌️€ it!!))

[@ApteraEV2024]

I'll work on ä Tune too)) I always wanted to be ä Producer))

[@shchen16]

wth

[@chrissgouros7282]

honestly dude, this is the cringiest thing ever. Thanks for the free lessons

[@garynico9872]

Nah this ain't it 🤣

[@gileneusz]

very good song, but please don't do it again

[@n.ganadily8973]

Unsubscribed ✔️

[@sapirmardan2557]

Lets train! for an epoch in arange call model.train do forward pass calculate the loss optimizer zero grad loss backwards optimizer step step step lets test! call model.eval with torch inference mode do forward pass calculate the loss print out what's happening for a another epoch... dont forget to save, save, save

[@mrdbourke]

🕺 And dance as the loss goes down down down!

[@sapirmardan2557]

I sing it all day long :D@@mrdbourke