SNS vs SQS Comparison? Whats the difference? | Learn with a practical example

In this video I explain the key differences between SNS and SQS. I started by going over the features of both services, followed by a practical example.
Looking to get hands on experience building on AWS with a REAL project? Check out my course - The AWS Learning Accelerator! courses.beabet...
00:24 Feature Comparison of SNS vs SQS
02:57 SNS vs SQS Example
🎉SUPPORT BE A BETTER DEV🎉
Become a Patron: / beabetterdev
📚 MY RECOMMENDED READING LIST FOR SOFTWARE DEVELOPERS📚
Clean Code - amzn.to/37T7xdP
Clean Architecture - amzn.to/3sCEGCe
Head First Design Patterns - amzn.to/37WXAMy
Domain Driver Design - amzn.to/3aWSW2W
Code Complete - amzn.to/3ksQDrB
The Pragmatic Programmer - amzn.to/3uH4kaQ
Algorithms - amzn.to/3syvyP5
Working Effectively with Legacy Code - amzn.to/3kvMza7
Refactoring - amzn.to/3r6FQ8U
🎙 MY RECORDING EQUIPMENT 🎙
Shure SM58 Microphone - amzn.to/3r5Hrf9
Behringer UM2 Audio Interface - amzn.to/2MuEllM
XLR Cable - amzn.to/3uGyZFx
Acoustic Sound Absorbing Foam Panels - amzn.to/3ktIrY6
Desk Microphone Mount - amzn.to/3qXMVIO
Logitech C920s Webcam - amzn.to/303zGu9
Fujilm XS10 Camera - amzn.to/3uGa30E
Fujifilm XF 35mm F2 Lens - amzn.to/3rentPe
Neewer 2 Piece Studio Lights - amzn.to/3uyoa8p
💻 MY DESKTOP EQUIPMENT 💻
Dell 34 inch Ultrawide Monitor - amzn.to/2NJwph6
Autonomous ErgoChair 2 - bit.ly/2YzomEm
Autonomous SmartDesk 2 Standing Desk - bit.ly/2YzomEm
MX Master 3 Productivity Mouse - amzn.to/3aYwKVZ
Das Keyboard Prime 13 MX Brown Mechanical- amzn.to/3uH6VBF
Veikk A15 Drawing Tablet - amzn.to/3uBRWsN
What is SNS? • What is AWS SNS (Simpl...
📚 References:
- SNS Playlist - • AWS SNS Guides - Every...
- SQS Playlist - • AWS SQS Guides - Every...
- How to set up SNS + Lambda - • AWS SNS to Lambda Tuto...
- How to set up SQS + Lambda - • AWS SQS to Lambda Tuto...
- How to set up SNS + SQS - • AWS SNS to SQS Tutoria...
- Getting started with AWS: • Introduction to AWS | ...
- Great stackoverflow discussion - stackoverflow....
☁Topics covered include:
- SNS
- SQS
- SNS vs SQS
- SNS to Lambda
- SNS to Lambda Retry Policy
🌎 Find me here:
Twitter - / beabetterdevv
Instagram - / beabetterdevv
Patreon - Donations help fund additional content - / beabetterdev
#AWS
#SNS
#SQS

[@SergioBerlinches]

I came looking for copper and found gold. Thanks.

[@BeABetterDev]

Thank you sergio for such a kind comment!

[@a_maxed_out_handle_of_30_chars]

same feeling :)

[@shaziamuskaan1987]

same!

[@neidsonsouza]

I am felling the same.

[@gomes8335]

Much precious than gold

[@TomerBenDavid]

I really like how you don't just repeat documentation bus get to the core of the thing! Another masterpiece!

[@BeABetterDev]

Thanks tomer!

[@sf-spark129]

Good explanation!! As an active user of AWS myself, I would like to add one thing here. SQS is not error-proof/fault-tolerant by itself in the event of a failure. It guarantees to deliver all messages to the next microservice by having a back-up option, called DLQ(Dead Letter Queue). When the SQS fails to deliver a message to the next microservice whether due to a source side issue or a destination side issue, it sends that message to the DLQ(it is basically another SQS). Then, you get to re-drive(re-play) that message once you locate and resolve the issue in the system. One caveat is that there is a maximum 14-day message expiration period in DLQ. Also, SNS can be subscribed by a streaming service like Kinesis FH.

[@mikehulbert4411]

Great explanation and love the fact that you explain the “why”...

[@scottscott232]

2:16 - 2:47 - That was a penny dropping moment for me. What an excellent way to describe the difference. Many thanks.

[@BeABetterDev]

So glad I was able to help you "get it" !

[@ayeayyiu]

@@BeABetterDev You should be proud of yourself, you really do explain very clearly :)

[@busyrand]

Brilliant explaintion of the reason why the service is used/relevant. Way to close strongly...

[@stevencastro2238]

I can not thank you enough, for this video. This single video might be the reason i get my certification, when I do I promise to come back and make a generous donation your way. Thank you sir

[@BeABetterDev]

You're very welcome Steven! I hope you do well on your exam. Thank you for your support, I really appreciate it!

[@koikahi]

Gold indeed!!...so articulate and to the point..in 10 minutes..wow!

[@BeABetterDev]

Thanks Rahul!

[@ahmedsalim784]

Thanks for the effort put into this video to make it easier for students to understand.

[@oscarzuniga.personal]

The best explanation for this two services. You rock!!

[@BeABetterDev]

You're very welcome!

[@HunterStanley-kv3je]

I'm a student studying for my Solutions Architect exam. I narrowly failed the first attempt and have been studying material and realized I didn't fully grasp the concepts and differences between the two. This video did so much that the AWS Academy did not in this regard, and I really appreciate that.

[@dwaynem2523]

Finally a great video that fully explains the differences with a concrete use case. Thanks

[@BeABetterDev]

Glad it was helpful!

[@monitumsgd]

Thank you for this clear explanation with practical example. Thumbs up!

[@BeABetterDev]

Glad you enjoyed Monit!

[@yt.arunthakur]

Wow you really made it so easy to understand

[@BeABetterDev]

Thanks Arun! Glad you enjoyed :)

[@serreealhamwi6393]

your explanation is perfect

[@BeABetterDev]

Thank you Serree!

[@wasimbadsha4342]

You did it smoothly. ☺️

[@BeABetterDev]

Thank you!

[@krishnar6749]

Good Info; Better than many paid courses

[@BeABetterDev]

Thanks Krishna!

[@jefffrederick258]

Subscribed. Clearest example I've seen on SNS vs SQS

[@BeABetterDev]

Thanks Jeff! Glad you enjoyed :)

[@shailendrasawant1454]

Simply excellent. Well explained. Thank you 😊

[@BeABetterDev]

Thank you so much for the kind wrods!

[@zubkat5196]

Awesome explanation as usual

[@BeABetterDev]

Thanks Zubka!

[@user-ec4vi9ho1m]

Hey! Great explanation of SNS and SQS. I love you credit card transaction example since not better place than a transactional system to understand those concepts.

[@krishnapraveen777]

Real life examples are gold. Thanks brother.

[@BeABetterDev]

Thanks Krishna! Glad you enjoyed :)

[@yashpanicker256]

This is the best video I have seen on SNS and SQS. The practical example was especially helpful.

[@BeABetterDev]

Thank you Yash! Glad you enjoyed

[@hamoudsk8972]

Pretty good format and just exactly what i wanted , clear explanation good use case examples , just perfect . Thank you

[@BeABetterDev]

You're welcome!

[@StarContract]

My search for the best tutorial stops here

[@alpha_ray_burst]

FANTASTIC video, holy geez man. Brain expanded. Like... I just came here because I wanted to know about SQS, but I was taught about SQS, SNS, and proper application architecture in a way that I will actually remember it. DAYUM. Thank you! Can you do a video about Origin Access Identities?

[@BeABetterDev]

Thanks Adam, really glad you enjoyed! I'll look into a video on OAI - cheers!

[@pauls60r]

This is the best explanation and practical example of SNS/SQS!

[@BeABetterDev]

Thanks so much paul!

[@MightyMike55]

Great explanation and example

[@BeABetterDev]

Thanks so much Michael!

[@davidalexander8786]

SNS is a stateless message service and sqs is a state-full service that queue messages to decouple big APIS into a distributed system that can be resilient to lots of recurrent tasks

[@ajayvishwakarma6943]

best explanation of SNS and SQS

[@BeABetterDev]

Glad you enjoyed!

[@erekriccobuano6141]

Awesome explanation. Now I get it.

[@BeABetterDev]

Glad it helped!

[@vctorroferz]

incredible great explanation ! thanks for such wonderufl content!

[@BeABetterDev]

You're very welcome Victor!

[@bagyalakshmi72]

Thank you for the explanation with example and telling about the pros and cons of each method :)

[@anuragsoni2256]

Thanks for this good practical example.

[@BeABetterDev]

Glad it was helpful!

[@nirmesh44]

best explanation ever.

[@BeABetterDev]

Glad it was helpful!

[@alcap6145]

Best explanation ever. I wish I would have found this video before I studied and passed my Solutions architect LOL

[@BeABetterDev]

Glad you liked it!

[@jasongodmere9882]

Fantastic job, I was about ready to throw my laptop trying to get a solid use case for these tools

[@BeABetterDev]

You're very welcome Jason!

[@preetbenipal1034]

wow explanation one of best explanation of use case of SNS SQS in such a short time ..fully recommended ..thank you :)

[@BeABetterDev]

Glad it was helpful!

[@joswayski]

Great example thank you

[@BeABetterDev]

You're very welcome Jose!

[@glennadams7047]

Really helped me to understand how/why SNS. Nice slide too.

[@BeABetterDev]

Thanks Glenn! Glad I was able to help.

[@glennadams7047]

@@BeABetterDev Studying for the AWS Dev Cert, and these vids reinforce what I read in the documentation :-) Thanks again.

[@samikshasharma3544]

What a clear demonstration it is!!!

[@Cusifaii]

Very clear explanation. The use of practical cases is key, thank youi for that.

[@BeABetterDev]

Glad it was helpful!

[@chrisone8283]

Great explanation thank you!

[@BeABetterDev]

You're very welcome!

[@ericz8086]

Fantastic explanation for both services, thank you!

[@aldnav]

Best explainer vid by far.

[@cazino4]

Great video, clear concise and informative. Would like to see a video that compares SNS to Kafka....

[@janithmalinga5765]

Very good practicle example.

[@jasimali2467]

pure gold, very nicely explained

[@BeABetterDev]

Thanks Jasim! Glad you enjoyed.

[@vivrd]

i loved the use case which clears the picture of the usage of both types of services. thanks.

[@BeABetterDev]

Thanks Ritesh!

[@taraprasaddash4011]

Very clear explanation. Thanks for your good work.

[@BeABetterDev]

Thanks Tara! Really appreciate the support.

[@kazimir9576]

Great example, thanks for this video

[@BeABetterDev]

You're very welcome!

[@jhonnyyamaniha6033]

Thank you! Great explaination and great example!

[@markuspxpx]

Thank you very much !

[@mr_phamtastic]

i really enjoy your explanation and practical examples!

[@BeABetterDev]

Thanks Paul!

[@saeedshazad9223]

you are awsome. never understood SNS /SQS till this lecture. you need to be Amazon Instructor

[@BeABetterDev]

Thank you! One day :P

[@shilpthapak7823]

This is Gold!! Thanks for explaining.

[@BeABetterDev]

You're very welcome Shilp!

[@pemessh]

Damn this literally is the best video for this topic. Loved it.

[@BeABetterDev]

Thanks Pramesh! Glad you enjoyed.

[@MartinPerez-mi1ty]

I am so glad that i discovered your channel

[@nirmaltripathy3226]

Awesome explanation

[@BeABetterDev]

Glad you think so!

[@innocentmutyavaviri8205]

Well explained example

[@BeABetterDev]

Thanks!

[@SuperCapitalt]

This is amazing explanation!!! Thank you so much!

[@BeABetterDev]

You're very welcome Nuni!

[@emilehoffman8425]

Very Good and well presented.. Gracis!!!

[@BeABetterDev]

Glad it was helpful!

[@Laserstube]

Very good explained 👍

[@BeABetterDev]

Thanks!

[@mousumisinha4039]

Ok now I can definitely say what my application needs 🔥

[@babusivaprakasam9846]

Clear explaination

[@BeABetterDev]

Thanks babu!

[@avinashch3359]

Quite a good Explanation with example.

[@BeABetterDev]

Glad it was helpful!

[@hdang1997]

You just gave me a final year project idea. Gracias!

[@virunpatolankitkunchai4179]

This is awesome! The example is well explained. Thank you so much for doing this!!

[@BeABetterDev]

You're very welcome!

[@harshverm776]

Excellent Explaination....

[@BeABetterDev]

Thanks Harsh!

[@yulia0g]

awesome video, very clear and well explained

[@srinivasprs]

Excellent video. Cleared my basics on SNS and SQS before going to my AWS SA Exam in next two days. Thank you :)

[@BeABetterDev]

You're very welcome sriniva! Good luck!

[@TheKiteDiary]

Great one. The example helps a lot! Thank you

[@BeABetterDev]

You're so welcome!

[@worldofafrontenddeveloper9187]

Thanks for making this video 👏

[@BeABetterDev]

You're very welcome Rimika!

[@rohitdhankar360]

@8:00 - When we process a certain message from the SQS Que --- we delete that Message so that No other POLLERS can receive it .

[@LuisRivera-mh7gv]

Heyyyy!!! Appreciate you sharing this!!! I was having a hard time digesting it! This is clearer thanks to you! Subscribed already!

[@BeABetterDev]

You're very welcome Luis! Thanks for your continued support :)

[@widadaid]

Great explanation, thanks! :)

[@BeABetterDev]

Thanks so much Juara!

[@user-tn9py4kx8n]

This is really useful. Thanks!

[@wenzwenzel2529]

Perfect. Super helpful.

[@BeABetterDev]

Glad to hear it!

[@girishmallya9950]

Nice explanation!

[@BeABetterDev]

Thanks Girish!

[@AlvinC-sz3li]

A fun fact is you can unsubscribe an SNS with a URL link, without any auth. For example, if you post the URL to Slack, Slack will try to load the preview by clicking it, then you have the SNS unsubscribed.

[@BeABetterDev]

Great point G O. I feel like this is a bit of an oversight by the AWS team. Unsubscribe URLs should really require some kind of authorization.

[@oguzhan1191]

Great one. Thank you. I have a question for you. Should we use SQS in a Lambda Function? For example, SNS invokes a lambda and lambda uses sqs.

[@BeABetterDev]

SQS -> Lambda is typically a better choice since it provides fault tolerance and easy recovery in case your Lambda starts erroring out. This can't be guaranteed using SNS -> Lambda.

[@oguzhan1191]

So you mean, Sqs should invoke the lambda right? What is the best way to implement SQS, I mean for example we can use SQS in a WorkerService(www.stevejgordon.co.uk/what-are-dotnet-worker-services) is it a better approach?

[@shashikantdivekar7839]

Very nicely presented and made things clear. Thank you Sir.

[@AbyssWiZ4rD]

Very clear explanation, thanks for sharing!

[@rohitdhankar360]

@6:00 - Transaction Analytics service on EC2 becomes aware that an EVENT has been added to the SQS Que . .... excellent content thanks :)

[@HeavensMeat]

Not sure I understand 8:40 mark, you're saying if a lambda is subscribed to SNS, you can potentially lose the message if there is a problem with your logic whereas in SQS you do not... So what is the advantage to lambda? I'm guessing that it is that lambda runs right away vs waiting for some service to poll it to send that reminder service (which would take longer) Another question I have is, how do you ensure a message gets processed when it is decoupled? Let's say one of them didn't process, then wouldn't you have to repub the SNS topic which would send it to all the other processes subscribed and then you would have duplicate messages sent to the ones that didn't mess up which would just be a different assortment of issues?

[@BeABetterDev]

Hi HeavensMeat, Good questions! Regarding the first one (message loss via SNS -> Lambda): As per aws.amazon.com/sns/faqs/#Reliability - "If Lambda is not available, SNS will retry 2 times at 1 seconds apart, then 10 times exponentially backing off from 1 seconds to 20 minutes and finally 38 times every 20 minutes for a total 50 attempts over more than 13 hours before the message is discarded from SNS." Effectively this means your message could be potentially lost if your lambda starts failing. Regarding ensuring a message gets processed: You are quite right that if one of your subscribers fails, you potentially would need to republish to the source SNS which can cause problems for other clients as you described. In order to prevent this, clients should always be able to handle message de-duplication either by using timestamp comparisons or some kind of versioning system to ensure they can handle this situation. There are of course other options such as invoking the affected client manually through some kind of script with the backlog of data that they failed to process.

[@HeavensMeat]

@@BeABetterDev That was very informative, thanks so much for responding!

[@BeABetterDev]

No problem!

[@yumlive5698]

wow, nicely presented and explained!

[@BeABetterDev]

Thanks John! Glad you enjoyed :)

[@jivanmainali1742]

aws sns seems to be same as that of kafka and rabbit mq

[@LeonidasPapoulakis]

An excellent example, keep up the good work! We need more videos like this!

[@BeABetterDev]

Thanks Leonidas! More to come!

[@SemenAlexndrovich]

Thank you so much, sir! Great video!

[@BeABetterDev]

You're very welcome Semyon!

[@bharatpatidar3693]

You are a Gem Brother

[@BeABetterDev]

Thank you my friend :)

[@sowellmemo]

Thank you. Well explained.

[@BeABetterDev]

Glad you liked it!

[@muhammadyaqoob9777]

nicely explained!! thanks and really appreciate you sharing this!

[@BeABetterDev]

You are very welcome!

[@markusfeljofsen8345]

What an awesome explanation! Love it.

[@vinayaknawale1015]

True very simple and nice explanation ni was looking for and finally got it here and SUBSCRIBED !!?

[@BeABetterDev]

Welcome aboard!

[@vimalm2064]

Thank you Sir, Awesome explanation

[@justfair4181]

Best explanation. Claps

[@BeABetterDev]

Thank you!

[@VaisakhParannattilCherul]

Really useful video I should admit, Keep rocking with such amazing content!

[@cheribgh275]

You are really Awsome!!!! thanks a lot for the informative videos about AWS.

[@BeABetterDev]

Thanks Shahrzad! And you're very welcome!

[@NP96]

Thanks, really helpful to me

[@islamh6042]

A very defined real Credit Card Transaction example, thanks a lot man. I hope I know your name : )