Multiprocessing in Python: Logging

[@davidgolembiowski4275]

Thanks for another great contribution, @LucidProgramming.

[@LucidProgramming]

No problem, glad you enjoyed! :)

[@sudarsandm]

Please do a video series on Design patterns involving Python. That would be of great help.

[@LucidProgramming]

Will put it on my list. Thanks for the suggestion!

[@talbarak8861]

Few comments: A. It worth mentioning that multiprocessing has its own specific logger, to which the multiprocessing module writes its own log entries, as opposed to the general logging module which you can use to set your own logger and write your own log entries. B. If I'm not mistaken, log_to_stderr() calls get_logger by itself, and then returns a logger, so calling get_logger again is unnecessary. C. It is also worth mentioning that log_to_stderr also automatically set the logging format (to '[%(levelname)s/%(processName)s] %(message)s'). So, the bottom line is that log_to_stderr, does the following: A. Calls get_logger and returns a logger object. B. Add an handler to redirect the output to standard error. C. Set the logging format to '[%(levelname)s/%(processName)s] %(message)s'

[@LucidProgramming]

Good points, thank you for mentioning those!

[@GelsYT]

THANK YOU SO MUCH FOR THIS! I LEARNED A LOT!

[@LucidProgramming]

Cheers, and thanks for watching!

[@haytamdz1157]

useful information ___thanks

[@LucidProgramming]

Thanks as always for your feedback, Haytam! Cheers, and thank you for watching!

[@haytamdz1157]

I hope you do a lesson about Multiprocessing in Python with selenium

[@LucidProgramming]

That's a great idea, I'll definitely add that to my list. Thanks for the suggestion!

[@scienceblossom6197]

This is great tutorial. Thanks. But I had to go through a whole tutorial to realize what logging does, lol. :) As far as I could understand, the logging in this video is specific to multiprocessing. But I'm not sure how it's really doing the "logging" since I don't see any logger.info(msg) or logger.error(msg) or etc.

[@LucidProgramming]

Thanks. If the series of videos was on logging and it took you to the last video, I could understand the frustration. But this video is only on logging, so it would make sense that this is the video that covers that topic, right? :). If you want more info on this, the logging docs are very well-written.

[@michielvg8298]

Thank you for this video. However, when I run the code in my Anaconda Prompt, I get the following error message: AttributeError: module 'logging' has no attribute '_acquireLock' Do you know what might be wrong? I get the message on both Python 2.7 and Python 3.5 environments.

[@LucidProgramming]

Can you confirm that the code you're running matches the code on my GitHub?

[@michielvg8298]

@@LucidProgramming Yes, I use exactly the same code as on your GitHub. If I run it from my IPython console (Spyder), I don't get any error message but neither do I get the output as you show in your video. The error appears when I run the code in my Anaconda prompt..

[@LucidProgramming]

@@michielvg8298 Might be running a different version of Python in your Anaconda instance. It's hard to say without knowing more.

[@michielvg8298]

@@LucidProgramming When I open my Python 3.5 environment, I get the same error message in Anaconda as when I run the code in my base python 2.7 environment. Do you have any suggestions on that? :)

[@LucidProgramming]

@@michielvg8298 Wait. I'm confused. I thought you mentioned when you run in the IDE you don't get an error, but when you run in Anaconda you do.