Python Threading Tutorial: Run Code Concurrently Using the Threading Module

[@coreyms]

Hey everybody! I hope you find this video helpful. I'll be releasing the multiprocessing video next week. I am currently packing up my temporary recording station and will be moving into my new place tomorrow, so I should be able to get it recorded, edited, and released next week for sure. We'll be covering how to use multiprocessing to process the high-resolution images we downloaded in this video. Hope you all get some good use out of these topics!

[@youssefelbiyadi4285]

Hi corey Thank you very much for this topic it's quite interesting, your videos are very helpful. I have a view function in my django project that performs some complicated calculations, so it is CPU Bound. The problem is that when I run these calculations for a high number of objects (each object is an eNodeB site), it takes a while before loading the view page. I tried to use threading but it was not useful. So I wanna use multiprocessing but I have a problem with the __name__=="__main__" condition. I can't use it in Django framework... Do you have any other suggestions for me please that will be very helpful ? Thank you again for all your efforts :)

[@coreyms]

@@youssefelbiyadi4285 Hey there. When it comes to running asynchronous tasks on web applications, it might be a good idea to use a messaging task queue (e..g Celery). Anthony over at the PrettyPrinted channel released a video just the other day on how to do this. I think he did a great job. Check that out here: kzbin.info/www/bejne/mF6Znnh3p5agY6M

[@youssefelbiyadi4285]

@@coreyms Tkanks a lot that was very helpful

[@gingerboy9170]

Waiting for the next "IMG processing" vid sensei....🔥🔥🔥

[@marcelodimb]

Hi @Corey Schafer, please, can you make a tutorial explaining how we create a python web application (Django or Flask) using Docker? I love your videos. Best regards from Brazil!

[@HexagonalClosePacked]

When I first tried to switch my career to programming, I watched Corey's videos. Now, 3 years later, I already got a job in programming and still watch Corey's videos :)

[@dnetne5508]

Damn - that is amazing!

[@ksun8993]

@HexagonalClosePacked So basically you have your rank /Z effective as 6 with 2 corner atoms,3 body and 2 face atoms . And Zn and Mg adopt your structure. (To understand , read your username)

[@kwertie133]

@@ksun8993 iit?

[@K3vyB]

@@kwertie133 I unleashed a vile shit just now bro

[@muralidhar40]

Same here!

[@nicholastalbot6370]

Corey: I know that sounds confusing. Me: No, you explained that very well.

[@edwingarcia5043]

Unfortunately some things sound confusing, I mean, it heavy depends on my current knowledge, the good thing about Corey is the calm way of explaining.

[@edwingarcia5043]

@Slime Boi wadafa :0

[@dipankarkaushik5285]

Was waiting for this topic to learn from the world's best Python Mentor. Now the wait is over. God bless you.

[@saraljoshi1]

“hear hear"..exactly my sentiment. After trying concurrency in python on my own several times and failing. I knew only Corey's Videos will help.

[@kebman]

If you threaded the timer the wait would be much shorter....................

[@PyjamasBeforeChrist]

time.sleep(0)

[@kirubababu7127]

Hi Bro, If I am trying to read CSV files by pandas,time duration is not reducing. Could suggest your ideas?

[@CodeWithGBMags]

I agree, this was really helpful @Corey, you are my favorite Python mentor and so is your channel

[@CwMuller]

Had a service at work that created html pages with indexes of hundreds of xml reports. It used to read each report one by one. Used what I learned here to refactor the code to process files concurrently, which cut the script run time to a fraction of what it used to run at. Thanks for the fantastic tutorial!

[@coreyms]

That's awesome! Good work!

[@ismersh]

The best video in the internet about multithreading. Clear and step by step detailed explanation about different ways to run multiple threads in your script + Corey explained why the threading is useful, while some websites tend to say multithreading doesn't work in python. We are very lucky that we have Corey explaining these concepts for free in KZbin, because you won't find such good materials even in paid courses on Udemy or other sites.

[@coreyms]

Thanks!

[@pacoa-kdbg9303]

Almost 2 years since you uploaded this, you reduced my exect time from ~90 mins to ~2 mins at max . Awesome videos, will continue watching

[@paulh4654]

You are not only the master of this subject matter, but also you are a great communicator who can articulate artfully. I appreciate your time and effort to share your gift with all of us. Thank you so much.

[@AnselJanson-v5v]

still valid even after 3 yrs Awesome tutorial

[@dangidelta]

Mind Blown : 100% New Concept : Yes Easy Implementation : Yes More Control on Programs from now on : Yes Feel like a New Level Achieved : Definitely Yes

[@harrisongropper199]

I agree

[@vishnusingh4118]

Crystal-friggin'-clear! The coolest part was the real-world examples at the end which ensured there was a concrete takeaway and that it wasn't all just theoretical. The best threading vid on the internet! You keep getting better Corey. More power to you !

[@adobongasin214]

For those who are starting in Python, Corey is the best in terms of explaining things, I am already a Team Lead but I still go back to his tutorials once in a while hahaha

[@excitedbox5705]

This has to be the best made guide ever. This should exist for every programing language. Usually guides only give you the absolute basics and expect you to figure out the more advanced stuff yourself and that is where most people get stuck. The level of detail in this is perfect without making it overly long.

[@gytisbl]

Really liked the distinction at 4:27 that its best to use several threads when code is IO bound: -reading/writing disk, waiting for network

[@o1techacademy]

Thank you for this powerful tutorial.

[@gurudevilangovan]

You definitely do have a gift. It takes a ton of talent to explain concepts like this with so much lucidity. Whenever someone says they want to learn python, I point them right to your videos. Thanks Corey! I'm indebted to your videos.

[@anantchopra1663]

This video is a life-saver! I have a project due in 3 days that needs me to do a lot of fancy stuff in a multithreaded program, and I had no clue what multithreaded programs are! I'm in a much better position after watching this video. Thank you, Corey!

[@andrewhofmann5453]

So I just extended the Thread class into my own class and made something so much more efficient because of this video. Great job!

[@newpain01]

Completely agree about the basic example tutorials, I often find them useless. Great video, thanks!

[@ZbigniewLoboda]

❤ At last, I have found an instructor-you-who truly understands and knows what they are talking about in the subject of Python programming.

[@orkhanahmadov9963]

This man deserves a golden globe award... I have been watching his videos for the last 3 years. He helped me to master Python.. I would definitely like to recommend this channel to anyone who wants to learn CS.

[@DarshitParmar]

You are an angel. Most youtubers teach textbook. Thank you so much for this tutorial!

[@EdiFerreiranet]

10:54 Throw away variable!?! Nice!!! I didn't knew that. Awesome!!! Thank you. You're the best ;)

[@bratergames9410]

For five years I was looking for some simple explanation that I could use in my code, to pull my dna, from snpedia...OMG. So simple but very good. Thanks man.

[@juliocefe1807]

OMG, one of the best programming channels on KZbin

[@okyigwegbe1977]

Corey, you are unbelievably good. My python journey has been solid because of your brilliant and simplistic way of explaining the most complex of things. Thank you very much and God bless you.

[@victorialeigh2726]

I click it all excited to master threading in 30 minutes. In the first 10 seconds, I realise it's an intensive lecture so I need to take notes. After 2 hours I have 10 minutes left lol (but I know this will go a long way) Edit: after 3 hours I completed the tutorial. Now I'm gonna go improve my code.... thank you Corey!

[@truongtran99_]

Your explanation about threading was so clear and easy to understand. Thank you for making this video!

[@hotcrossbun26]

I'd be so screwed without your videos. The BEST explanations anywhere on the internet for learning python.

[@georgesd9]

Thank you Corey, channels like yours is what makes youtube worth visiting IMHO. One thing I needed to add, I tried to use threading on a sending email method in flask to avoid delay in redirecting, I found out that it can't be used out of the box, due to flask app-context, with some research I managed to make it work, by researching more about flask contexts I ended up using flask-script with Manager and Shell classes, using the shell to create a context for the thread. I'm writing this in case someone is trying to do the same.

[@terryhenyo9216]

When I see a Corey Schafer video I automatically like before watching, because I know it's going to be good :)

[@derrick7968]

Me too, i commented without watching

[@fergusonsofstirling8130]

Thank you very much Corey. I couldn't get my head around threading before watching your video. After adapting my code with concurrent.futures.ThreadPoolExecutor() / executor.map I managed to speed up a program that makes API calls - which is now at least 100 times faster!

[@Mrslykid1992]

Wow parenthesis throws everything off! Thank You Corey! from com.project.src.Experimentation.GatherDataWithThreads.GatherData import GatherData from com.project.src.Experimentation.GatherDataWithThreads.ThreadingData.ThreadData import ThreadingData class ThreadingDataTest(unittest.TestCase): def test_durationOfThreadIsAtleast3Sec(self): start = time.perf_counter() gd = GatherData() gd.getDataSource1() gd.getDataSource3() finish = time.perf_counter() self.assertTrue(finish-start>3) def test_durationOfThreadsIsLessThan3Sec(self): start = time.perf_counter() gd = GatherData() td = ThreadingData() thread = td.createThread(function=gd.getDataSource1) thread2 = td.createThread(function=gd.getDataSource3) td.startThread(thread) td.startThread(thread2) threadList = [] threadList.append(thread) threadList.append(thread2) td.joinThread(thread) td.joinThread(thread2) finish = time.perf_counter() self.assertTrue(finish-start < 3)

[@trevormckellen5613]

The reason I've learned so much from your videos is real world application. I hit a wall with all the tutorials online until I found this channel. Thank you Corey

[@alttablife6965]

Easy choice to subscribe. These are helping me learn more in a few days than combing through docs did in a week. For reference, I'm coming primarily from a bash background. Last time I looked at multiprocessing was in a college java class. This just refreshed almost everything I need for my current project.

[@chazyua]

OMG. This is not the first time you read my mind. Literally just wanted to find some threading topics ! Wow ! Thanks

[@PatooOfficial]

At first I thought this was some video from annoying courses companies that's just a waste of time and boring.. until the video started I got happy and knew this video is quality from a quality channel

[@TheFred10000]

This channel is criminally underrated.

[@luffingsails7542]

Tried Skillshare to take on learning Python. There is a bunch of milquetoast videos with no real substance. These videos by Corey are outstanding. Much appreciation. I'm glad it was a free subscription.

[@Sharmapawan98]

Can we have this man rewrite the official docs of python ? Love from India♥

[@BoukariYameogo]

Corey is really a great teacher

[@massiveblackwood]

indeed, idk why they refer a link to the same page and hyperlink it on every word on those page now i'm suffering vertago bcs of that thanks for words!

[@BoukariYameogo]

How come some people could dislike your videos? I really don't understand it. You're doing a great job for real. Thank you for your videos

[@cetilly]

Easily the best presentation on multi-threading and ThreadPoolExecutor that I've seen. Really great job.

[@dano2169]

Literally so many videos out there on threading and multiprocessing but by far this is the best. Thanks Corey!

[@sanviews9819]

One of the best Educator on programming out there ... love from India.

[@chawza8402]

Thank you very much! best python guide in all KZbin Although I only watch until 15:23, I have learned alot

[@mengzhu8385]

Most clear video on explaining multi-threading in Python!

[@mohit4u007]

Your threading and multiprocessing videos helped me a lot to solve my problem at work. Thanks a millions. Awesome effort and great wishes to you. Keep going!!!

[@MyYouthUk]

I'm currently only half way through... but this is far more comprehensive than anything else I've found. Easy to understand and detailed at the same time.

[@LiquidArremer]

I think the best part of these tutorials are the ones were you involve real world examples to show the utility, especially common cases and how it alters from then to now. Keep up the good work Corey!

[@wassimracing]

You sir, are a HERO. I don't usually hit the red button, but you deserve it! Thanks!

[@touchpad24]

Your explanation is so simple yet at the same time covers everything. Thanks so much!

[@JohnJohnson-db4vv]

Honestly, been wanting to figure out threading for the better part of a year now and every tutorial I've followed thus far has been confusing and doesn't explain a lot of important details. Thanks to this video I finally have been able to figure out threading!

[@gastonscazzuso4113]

Corey , this is the best explained Threading topic video in KZbin !.. Awesome.. and many Thanks !

[@jaylocker2055]

LOL, just cut a loop that makes 12,000+ API calls from 42 minutes to < 5 minutes. This is freakin awesome!

[@diegomedflo]

How do you avoid being banned? proxies?

[@jaylocker2055]

@@diegomedflo I'm hitting an internal service our company uses. Wish I could do batch requests, but the info I needed had to be a per record request as noted in the services documentation.

[@moeinmhzg7827]

I don't remember if I saw any better python tutorials. You are the best.

[@jaehochoi8062]

Clear, easy, pinpoint, reliable plus truly helpful explanation ever!

[@mehdibouss4551]

happy hear from u again,.The Mathplot videos were awesome.i saw also all the other videos.Keep going ,U got the juice of python man ! wating for more about data science...

[@jerry5646]

Hands down. Best python tutorial in youtube

[@borja4015]

These videos were really well explained. I had been curious for a time about multithreading VS multiprocessing and I feel like I learned a lot from your videos

[@athisii_ekhe6167]

Your videos doesn't want me to stop. I'm addicted to it. Cos its the best. Thank you. MGBY.

[@davidnago7947]

@Corey you need an award for the top quality content . keep it up

[@fredpaik1349]

Thank you Corey for ALL your videos! You are an inspiration and a great teacher. Keep up the good work!

[@tuvshinotgo5911]

Stop Corey, you are killing it. Kidding no stop

[@Nickelkitten75]

Very clear and concise explanation Kudos Corey

[@vishnusingh4118]

35:03 Yes yes yes ! Please make the vids on the advance topics as well! That will complete the knowledge-pack and make this video even more fruitful as we'll be able to apply the knowledge end-to-end in a real world setting. Thanks a ton Corey.

[@derrick7968]

Corey your the best, love your simplicity and cool examples. I use python for QA automation . Much appreciation from this side of the globe - Kenya.

[@shinobi9461]

Your tutorials are truly phenomenal. Thank you so much for sharing these videos with everyone, they’re incredible!

[@SlaineCZE]

Brilliant explanation (as always). Thank you, Corey. It would be great if you did the more advanced threading/multiprocessing (GIL etc.) video that you suggested.

[@soumyazyx]

More I see these videos, more do I fall in love with python and Corey. Thank you for your time and effort.Keep spreading the knowledge.

[@azemashaik4301]

Thank you so much, Corey, for this fantastic tutorial on introducing threading in Python to beginners! Your clear explanations and step-by-step demonstrations have really helped me grasp this concept much better. Your tutorials are always a go-to resource for me, and I appreciate how you make even complex topics so accessible. Your contribution to the Python community is invaluable, catering to both newcomers like me and experienced developers. Keep up the fantastic work, Corey!

[@dataenergy]

clear, concise and with provided example... excellent!!

[@somaloco3701]

omgggg I wanted to learn this but didn't because it seemed too advanced. thank you corey, there is no better source to learn from than you, I can learn anything that you teach!

[@yuliiakhalus7339]

Thank you very much for this tutorial! No one can explain all this Python stuff better that you!

[@arunprakasam.s]

Great tutorial on Threading. Thanks, Corey, Explanation is at the perfect pace, not needed to increase or decrease the playback speed.

[@spoonmanchen7631]

You never let me down, My Instructor. Always looking forward to your next video.

[@smithatubeme]

Thanks Corey! Can you please also do a tutorial on dockers?

[@letslearnabout4934]

Brilliant video as always, Corey. I love that it is not just theory or theory with a few "FooBar" examples, but real world applications.

[@stephenrwafa2519]

Awesome, simply awesome and had to watch ads all the way to the end in appreciation this level of quality. Thanks

[@karansmittal]

It was a very demanded video, Thanks for working on it. Always creating high quality video content.

[@pahehepaa4182]

Hands down, best instructor.

[@ahmedabdulrahman8567]

your fan from Sudan ... thanks for making such unique content

[@isaacfink123]

I have watched almost all of your python videos, and I've been waiting for something like that for a very long time, Thanks corey

[@mostafanakhaei4916]

Corey Your ability to teach is amazing.

[@Mainhunpyarkamusafir]

No one can explain better than you

[@ravikumaroruganti2097]

Explained multi threading concept with perfect example.Thanks Corey!

[@leondaz]

I watched the AD till the end and clicked on it, Thanks man

[@uguree]

Thanks a lot, what a brilliant video. Your english, real examples (sick and tired of hello worlds!) everything perfet. I will subscribe the Brilliant.org after watching this.

[@26_dharmeshmarathe86]

You're great. Your video on multithreading helped me to undertand the differncce between multithread & multiprocess. Great explaination!!❤❤

[@alexchung485]

You have saved my project! I was looking for the return of a thread process everywhere! Thank you!

[@nickvledder]

Covey, you must be God-sent. Thanks for this thorough explanation!

[@dinohunter7176]

The examples are so well done and nice explained. Good stuff.

[@bendibhafed1687]

Very clear and amazing course, thank you sir

[@johnnymysto]

Great explanation!! I knew basically nothing about this before I watched it, and it makes complete sense now.

[@elgary9074]

Long videos yes, but what a great explanation totally worth the time. Thanks a lot.

[@patloeber]

Great Tutorial!

[@sunilthapa6702]

Awesome Video!...Finally understood Threading in Python...Thanks for the video!

[@luanangtranhuu1919]

this is better than any lecture I have had at my university. 😊 thanksss

[@pranayb4115]

Clear & concise explanation on I/O vs CPU bound tasks. Looking forward for a video series on "asyncio" library.

[@ReCremisi89]

Amazing video as always. I started knowing basically nothing about the topic. Now I have a strategy to replace my for loops with functions, and to make batches of function calls. An interesting idea for a future video would be on how to combine multi-threading with multi-processing: Your example on image processing represents an interesting real world scenario where you need to perform a task that is I/O bound in some parts and CPU bound in others.

[@11rshan]

Viewed everything on the net. Nothing like this. Best video for threading