Asynchronous Tasks in Python - Getting Started With Celery

[@chikwang241]

"Straightforward" is what the world needs. Thank you.

[@REBUTTELER]

This is a beautiful tutorial. I've bought a Udemy course specifically for Celery and read multiple pieces of documentation and they were laced with needless information. This summarizes the bare essentials that I really needed to know. Thank you!

[@stephanschlogl8592]

Thanks for this video. As always very helpful. An in depth example using celery within django or flask and also covering how to configure different workers and queues for various tasks would be great!

[@ChrisHalden007]

That was quite a timing. Needed an overview of Celery right now ;) Great video. Thanks!

[@gopesh97]

Finally a celery video that makes so much sense!! Thank you!!

[@salimkachemela]

Great explanation. It would of much awesome if you could explain it with a more concrete example with, say may be a django project, may be sending and receiving data to/from an external API. That's the part that trips people a lot.

[@ConsuelaPlaysRS]

+1 to this. Would also like some explanation about when to use a dedicated MQ vs database and why/how this is different from threading.

[@rudeadyet1992]

Thanks, Anthony. Also would like to know more about Chaining, Grouping and Chording of the tasks in Celery.

[@TechWithSabri]

thank you so much for your time and it still works in 2022, for beginners i advice you to go with documentation of Celery and then check these videos

[@ericsalesdeandrade9420]

Really nice video and top quality. Thanks. What screen recording software do you use? Is this on a 4K monitor?

[@q44444q]

Excellent overview, thank you! Would be awesome if you added a video about how to communicate progress for longer running tasks.

[@JFromAcc]

Phenomenal video. Got me up and going when I was stuck.

[@stevewinters5653]

100% agree!!!

[@SaiGollapudi]

Wow. simple and clear. Thanks for making and sharing the video

[@PrickyToTheMoon]

Thank you for this video. Exactly what I was looking for.

[@yan200go]

The best video about celery

[@StudyStreamPlus]

Thanks for this. Solid introduction.

[@ejay4032]

Awesome, straight forward video.

[@CesarContreras13]

if I would want to send an email one week after some user do something, for instance, should I use Celery? great video btw

[@OboriNN]

Thank you! Easy, clear, fast.

[@sinahariri6623]

thank you for smooth explanaition.

[@jetra_h]

your videos are good, but as newbies, we can't follow. if you could include how to set up rabbitmqp as well. And if your video is about scheduling sending post or email. would be great!

[@entity5678]

very helpful video..thank you sir

[@vitorsilva-or1dj]

I LOVE YOU BRO!!!!! THANKS, BRAZIL HERE

[@TheAremoh]

Nice introduction. What's the difference between send_task and delay method?

[@bashirabdelwahed40]

straight to the point! I love this video

[@DaniloSilva-pl3sq]

SUCH A GOOD EXPLANATION!!!!!!

[@harshitsantosh825]

A great video. It would have been better of you could shown where we can use it. The example was really straightforward.

[@cynthia7000]

Great video! One question - I always hear these terms in System Design -- put the task/job in the queue and execute later, so is it a string/function/or other things that we put in the queue?? Thanks!!👍👍👍👍👍

[@rishabh.malviya]

This was awesome!

[@Ahmed-hv9bt]

So basically when we call .delay method on any task, celery throws that task into the task queue from where celery worker fetches the tasks to execute. In this example, queue was at cloud. If Internet stops working(for the sake of example) after calling the .delay method on task, celery worker won't be able to fetch the task and execute the task. Correct?

[@SviatoslavKalina]

Thank you for good explanation.

[@marcelogrsp]

Confusing method name “delay”! It could be “enqueue” or am I getting the wrong concept of delay method?

[@SP-db6sh]

Remember this channel as Wiki-Tube !

[@AshikG]

great and simple explanation.

[@maikhanhchi4479]

so touching for an excellent video

[@ksradau]

perfect explanation! thanks a lot

[@gaby1491]

this was clear and to the point. thank you!

[@calvinnicxon]

This is great mate! I wonder how can we run the worker in the background. I've read that some documentation to run the worker as a daemon. But I still don't understand it fully.

[@lfnkf]

Just got my sub. Thanks for sharing it!

[@Ekosusiloharjo]

Thank you Anthony, can you make tutorial for howto manage queuing in post message

[@jpgarcia90]

Hi Anthony, thanks for the video. Would you still recommend to use Celery or go for Flask 2.0 async capabilities?

[@jeffz7310]

Beautiful printed

[@MrGarg10may]

Very nice explanation

[@kilbeam99]

I have a website running on Flask that calculates travel times between appointments in Google Calendar. The calculation of these travel times can take up to 1 minute, so I want to push it to the background with celery. Your video has really helped me grasped the basics, but I have a few questions. The process won't return anything, other than say "it's done". In other words, when a user starts the calculation, I want them to be redirected to a "waiting" page, and be redirected again to a "success" page when it is done. How can I have Flask redirect a user from the waiting page to the success page as soon as the process is done? Do I need to have Flash check the status of the process every few seconds?

[@kvedia15]

you can have use setInterval in javascript and send a request to you backend every minute to check the status of the celery worker, if its done you can redirect the user to the results page?

[@Firiyuu]

Hwo did you make celery work on windows?

[@pascholatti]

Great, that really helped

[@zhenhuanSupport]

This is great if u can use flower together it will be more presentable

[@cassiosalvador7961]

Thanks for this video, it helped me a lot!

[@danswaney4134]

How do you push status_update() to take effect before returning?

[@mystackquest]

Hai Anthony... Your videos are helpful for me. But I am stucked on Flask factory pattern since Celery don't have init_app method. It makes import issues. How can I solve this issue? Thanks in advance.

[@TheWellington1997]

hello! Can you explain how to prioritize tasks with redis backend?

[@deepamgupta8011]

Pretty Explained

[@iqbalhonnur4451]

Why can't we use rabbitmq itself as a task queue and also as mb instead of celery?

[@shatandv]

Nice and clear, thanks!

[@dheerajthodupunoori7431]

i want to create a celery task , and inside that task i am creating two processes using multiprocessing module in python . Will that work fine?

[@gautamrishi5391]

does celery.delay() takes time. if it does how to minimize that?

[@akshatagrawal819]

Amazing tutorial!

[@storiesshubham4145]

Amazing Amazing Amazing 🎉

[@prettyprinted]

Thanks for watching!

[@EnglishRain]

Thank you this was excellent!!

[@Furyki]

Hi @Pretty Printed, can u create a tutorial how to use Redis Version 6 with Celery in python ? , tnx in advance.

[@WaldoTheWombat]

Ok thanks, but when i do it in a python file then the print statement doesn't execute until the the the reverse function is finished (not happening asynchronously): from tasks import reverse reverse.delay("anthony") print("something")

[@SkimFelBon]

great video, very helpful

[@Furyki]

Hi @Pretty Printed , can u create a tutorial how to use celery on django? , tnx in advance!!

[@codedjango]

Thank you Anthony

[@now1313]

Thank you for the tutorial. We are testing apps which use celery and now I’m actually starting to get what was going on :(

[@ganeshdabral8963]

thanks it's very helpfull

[@praveeniyer4294]

I have a requirement, to develop a celery based scheduling service which dynamically call a url for every 5 minute / 15 minutes/ 1 hour

[@danielschmider5069]

you didnt actually run multiple asynchronous tasks tho, kinda missing the point this way... How does this compare to just using asyncio, which is built-in into python, doesnt require a broker, or redis and sqlite dbs and sqlalchemy?

[@rblr46]

Asyncio uses green threads/coroutine for concurrency, using only one thread hence once CPU. Asyncio is for I/O bounds process, that includes a lot of waiting. If we have a lot of CPU bound task that we want to do asynchronously on different processes, we can send them for a celery worker to process. Be careful not being confused with concurrency (asyncio)/parallelism (celery)

[@GregWoodsLancs]

@1:01 when not using Heroku, where do I get the AMQP URL? Looking in the RabbitMq Web Management interface, I can't see any trace of it

[@rutujpande4816]

@@GregWoodsLancs can you please share your source docs. would be helpful.

[@KrishnaManohar8021]

continue this series...

[@Johnbin89]

Can you use it on a function that takes a form object as an input? My guess is a no as i had big trouble in a django project using Django_Q, but has anyone done it with celery?

[@rogueriver]

What is the difference between celery and asyncio?

[@bennguyen1313]

As a beginner, I like all the quick tips you casually mention.. like reversing a string using text[::-1], or the use of Heroku to run python in the cloud, or sqlite3 / sqlalchemy for the database! Not sure about the decorator part, but I like how you can use import your custom function using "from tasks import reverse" How does Celery differ from import threading / TaskThread() ? How does RabbitMQ / Redis task queues, differ from python's queue? Seems alot of people use Celery with Django for web applications.. like web scraping instead of using curl?

[@adityanjsg99]

20 hrs of work condensed in to 10 mins of video

[@CrashLaker]

great thank you

[@mingli9563]

Awesome

[@Anshegar]

then i try to use DB , celery not writing in db , but no errors.

[@IllevensKO]

You're saying that "celery needs task queue" but the description of celery says it IS a task queue itself. I usually love all your tutorials, but this moment was very confusing.

[@onesky4343]

Thanks ynohtnA

[@praveeniyer4294]

Can you please help me

[@yuhechen7258]

like a breeze

[@jafarOTS]

hi, I use celery with redis on my local machine but anytime I try to run the celery worker i get the error [2021-04-21 11:09:52,283: ERROR/MainProcess] consumer: Cannot connect to redis://localhost:6379//: Error 10061 connecting to localhost:6379. No connection could be made because the target machine actively refused it, how do i resolve it please?

[@DenzelHooke]

Change your port. Sometimes the default localhost ports aren't available and you have to go higher. 8080 usually works.

[@myevar84]

Thanks a lot. I am trying this example on Window but I'm getting tesk received, not secceed "[2024-09-10 12:26:24,835: INFO/MainProcess] Task tasks.reverse[c662f373-1f2d-434d-bf27-0019e3795b20] received". I tried "celery -A tasks worker --loglevel=DEBUG --without-gossip", but nothing changed !! Maybe can someone help me.