Concurrency Concepts in Python

[@santoshkumar-dr4qg]

Many times in the past, I attempted to understand the concept of multithreading programming in Python, but was unable to fully comprehend it and ultimately gave up. However, thanks to your detailed explanation, I now feel much more comfortable with the concept. I am grateful for the valuable content you have provided.

[@mathbyteacademy]

Glad I could help!

[@justatula]

He explains like a hot knife over a butter. Such detailed explanation I don't find anywhere.

[@mathbyteacademy]

Glad you enjoyed the video!

[@Costin8406]

this is great! i am currently on your 4th deep dive course and just found out recently you had a youtube channel... omg what a gem. Best teacher, you deserve more recognition.

[@mathbyteacademy]

Thank you!!

[@Costin8406]

@@mathbyteacademy any news on your new course?

[@abdellahiaioun8430]

I had to stop the video, to say thank you. This video is a gem. I am gonna give the rest of the videos in this channel a look, if they are of the same quality, then hey, the whole channel is a GEM :)

[@mathbyteacademy]

Glad you enjoyed it!

[@kurianpius]

Thank you Fred . Crystal clear as always!

[@mathbyteacademy]

You are welcome!

[@gorandev]

Thank you Fred for explaining all concepts so thoroughly. I bought all 4 parts of your Python 3 Deep Dive course on Udemy, and I keep recommending them to others.

[@mathbyteacademy]

Thank you!!

[@MsFxtrdr]

Same here. I work for a stock exchange doing analytics and the first thing I ask devs to do during their first month when they're waiting for accesses and stuff is to go through part 1 and part 4 of Fred's course. They have "aha" moments every day.

[@mathbyteacademy]

Thanks, glad to hear about those aha moments 😀

[@MsFxtrdr]

@@mathbyteacademy now if we could only get a second Fred to do a similar course on Rust … 👌🏼

[@mathbyteacademy]

😀 If you do find a good Rust course, please post it here! I'd be interested!

[@maganzo]

Btw Fred I finished all 4 parts of Deep Dive, and I wanted to say you helped me a lot. You are a great educator and by coincidence, we share the same alma mater Strathclyde University!

[@mathbyteacademy]

Glad you liked them. Strathclyde was great, I really enjoyed my stay in Glasgow! Small world 😀

[@maganzo]

​@@mathbyteacademy Will there be Deep Dive 5? (perhaps Design Patterns is a good topic for such a venture)

[@mathbyteacademy]

I've started work on an async course - but will be quite a while before I get something out.

[@maganzo]

@MathByte Academy wow can't wait for the release

[@imutyshev]

Awesome news! Can’t wait to buy separate course on async from you!!!

[@redDuck757]

I want to thank you for your work! You are my favorite lecturer and the best one in my experience. I bought all your courses on udemy and this was the best way to spend that money and best course. Just want to thank you once again!

[@mathbyteacademy]

Thank you!

[@avr4dev]

This video definitely deserves like and comment for better promotion.

[@mathbyteacademy]

Thanks! That would be nice, but very few people bother to take the time to do so.

[@driyagon]

this is one of the highest quality content i have seen. thank you for your efforts

[@mathbyteacademy]

You're welcome!

[@lersam1]

Hi, when we will se your course on asyncio. Thank You

[@maxjerman]

You're one of the very best in teaching Python. Thanks!

[@mathbyteacademy]

Thank you!

[@DamoOne]

Your content is excellent Fred. Thank you!

[@johnmckenna7121]

Hi Fred, I think I seen under one of your other videos you mentioned that you have been working on a async course for Udemy, I was wondering if this is still in progress, and if so is there at eta on it? Also if you haven't finished it yet, I would suggest to show the comparison between part 2 deep dive series, and the alternative in async, I recall you mentioning that part of the series is outdated, yet I can't seem to get my head around how they relate. Anyways keep up the good work, I have gotten so much benefits from your courses.

[@mathbyteacademy]

Hi John, no ETA yet on an async course - just finished the pydantic course, and taking a break for the holidays before resuming my work on it. Before the natuve coroutine capabilities of Python, you could define coroutines using generator functions (yield can both send and receive data). This has been deprecated, and instead coroutines are now natively available using things like async def and await, along with the functionality available from the asyncio standard library.

[@cogdraw]

superb. just what I need to master. patiently waiting for the full course to come out. Thanks Dr. Fred

[@mathbyteacademy]

Thanks!

[@kafychannel]

The greatest explanation, thanks ❤

[@mathbyteacademy]

You're very welcome!

[@ElectronToInterface]

You’re such an inspiration Fred. Many Thanks for such videos.

[@mathbyteacademy]

Thanks!

[@shadowmind_rex]

Fred you are an amazing teacher. Huge respect for you!! And really thank you for your time and effort for the quality content. Also, will you also be making videos on how you use your favourite IDE, some tips and tricks or setup those ?

[@mathbyteacademy]

Thanks, glad you like the content. I probably won't do videos on PyCharm (which is the IDE I use, not VSCode) as it's pretty straightforward for the most part - but I do have a video in this channel that describes how to set up PyCharm with Python virtual environments: kzbin.info/www/bejne/Z6rTiWyJh9ZoqsU

[@MrBfaris96]

Really great conceptual overview and helpful tips on libraries at the end!

[@mathbyteacademy]

Glad it was helpful!

[@ahmadfaraz9279]

Great explanations! The completeness and clarity of this video is awesome and really helpful for beginners like me . Thanks!

[@mathbyteacademy]

Thanks!

[@python_by_abhishek]

One of your huge fan Fred. Following your Deep Dive series from Udemy as well. Your lectures are like those movies which not only are entertaining but also have BTS in the end. The way you explain the BTS of python concepts is amazing. I am Professor myself who teaches Python to Engineering undergraduates and I always tell them that you are my teacher. Thanks for giving your knowledge to this world.

[@mathbyteacademy]

Thank you Abhishek, glad you like the videos! But what does BTS stand for? I know it's a Korean band, but not sure what you mean here 😀

[@python_by_abhishek]

@@mathbyteacademy Behind The Scene

[@mathbyteacademy]

Ah, thanks!!

[@szymonpiechutowski2340]

​@@mathbyteacademy The dirty secret of our master is out: he listens to BTS when he's not coding or teaching 😂

[@sampri22]

I wish I had skipped Uni (was a long time ago though) and just graduated from your academy. Well done, sir!

[@mathbyteacademy]

Hehe, glad you like the content!

[@eugenemwangi6914]

Thanks for this. It is very helpful

[@mathbyteacademy]

Glad it was helpful!

[@iwswordpress]

Excellent as ever!

[@mathbyteacademy]

Thank you!

[@omrieliyahulevy7985]

It's a *great* video.

[@mathbyteacademy]

Thank you!

[@iChrisBirch]

Thanks again for another great video explaining difficult concepts. I'm always recommending your channel and Udemy courses to all of my colleagues that want to improve their Python.

[@mathbyteacademy]

Thanks for that!

[@nombreinvicto]

Thanks a lot for sharing the detailed knowledge Fred. Appreciate it!

[@mathbyteacademy]

My pleasure!

[@bearmond]

Jeez that was so good

[@mathbyteacademy]

Thanks, glad you liked it!

[@nnnpooh]

Many thanks!

[@mathbyteacademy]

You're welcome!

[@lukashk.1770]

still there is a lack of good resources about async python. it would be good to have full udemy part about it

[@harshbiyani3048]

Hi Fred, do you have any plans to extend the Deep dive series to include AysncIO ?

[@mathbyteacademy]

Hi, not at the moment.

[@harshbiyani3048]

@@mathbyteacademy 😔

[@carlbaillargeon4037]

Can you use multiprocessing in combination with asyncio, meaning having one event loop per process? Would it be beneficial for I/O workloads? Thank you as always Fred!

[@mathbyteacademy]

Sure, I don't see why not (I've seen this done with threading not async, but I don't see why that would not work in theory). I would argue though, that if you need the CPU work distributed, you might be better off looking at an external queue and workers (each one can use async for I/O). If you use subprocesses you are limiting your scale to a single machine. If that single machine ever becomes insufficient for the load, you're only option (without rewriting your software) is to scale the machine up (beefier CPU, more cores, etc). With the queue/worker approach (I have an example video on that using Redis as a queue) you can easily scale out without any software rewrites (and the code is much much simpler).

[@frustratedalien666]

Another amazing video from. I have all of your Udemy courses and they are the best things I've bought on Udemy in the last decade. Would you consider making a course going into the details of asyncio starting right at the beginning? That's one part of Python I am not completely comfortable with 😅

[@mathbyteacademy]

Glad you like them!

[@samuellerner4174]

Thank you Fred. where can i find, example for running async progrems, for none web app

[@mathbyteacademy]

I'm working on an async course right now, but won't be out till end of the year. I have a video showing an example of using async with queues, but that's not a general/broad concept async video. I would search for something on KZbin - in particular this series by @EdgeDB is really good: kzbin.info/aero/PLhNSoGM2ik6SIkVGXWBwerucXjgP1rHmB

[@samuellerner4174]

@@mathbyteacademy thank you

[@szlu]

Hi, if one thread paused and gave control back to main loop, but it must still wait and handle the callback of the I/O, right? dosen't it mean the the thread must still run somehow?

[@mathbyteacademy]

there are no callbacks - when the thread resumes, it checks to see if the I/O op completed or not (if not, it will just wait and eventually get switched out)

[@szlu]

@@mathbyteacademy thanks for the explanation

[@fatalsg92]

The real question is if you're going to optimize for performance, why use Python at all?

[@mathbyteacademy]

Sure, you could just choose to write in C, Rust, etc. But then you'd lose out on packages such as PyTorch, TensorFlow, Scikit-learn, Keras, Theano, FastAPI, Pydantic, etc - basically the Python package ecosystem. (and many of those packages *are* written in C/Rust/etc so from a pure performance perspective using Python does not give up much).