AWS SQS Overview For Beginners

Рет қаралды 110,803

Күн бұрын

Amazon SQS or Simple Queue Service is an important tool that helps developers queue and process messages in a distributed fashion. In this video, I overview Amazon SQS including what it is, how it works, why it's useful, walk through some practical examples of how its used, and discuss common patterns that integrate SQS.
Looking to get hands on experience building on AWS with a REAL project? Check out my course - The AWS Learning Accelerator! courses.beabetterdev.com/cour...
Check out PART 2 (Console Walkthrough) here: • AWS SQS Console Walkth...
🎉SUPPORT BE A BETTER DEV🎉
Become a Patron: / beabetterdev
📚 MY RECOMMENDED READING LIST FOR SOFTWARE DEVELOPERS📚
Clean Code - amzn.to/37T7xdP
Clean Architecture - amzn.to/3sCEGCe
Head First Design Patterns - amzn.to/37WXAMy
Domain Driver Design - amzn.to/3aWSW2W
Code Complete - amzn.to/3ksQDrB
The Pragmatic Programmer - amzn.to/3uH4kaQ
Algorithms - amzn.to/3syvyP5
Working Effectively with Legacy Code - amzn.to/3kvMza7
Refactoring - amzn.to/3r6FQ8U
🎙 MY RECORDING EQUIPMENT 🎙
Shure SM58 Microphone - amzn.to/3r5Hrf9
Behringer UM2 Audio Interface - amzn.to/2MuEllM
XLR Cable - amzn.to/3uGyZFx
Acoustic Sound Absorbing Foam Panels - amzn.to/3ktIrY6
Desk Microphone Mount - amzn.to/3qXMVIO
Logitech C920s Webcam - amzn.to/303zGu9
Fujilm XS10 Camera - amzn.to/3uGa30E
Fujifilm XF 35mm F2 Lens - amzn.to/3rentPe
Neewer 2 Piece Studio Lights - amzn.to/3uyoa8p
💻 MY DESKTOP EQUIPMENT 💻
Dell 34 inch Ultrawide Monitor - amzn.to/2NJwph6
Autonomous ErgoChair 2 - bit.ly/2YzomEm
Autonomous SmartDesk 2 Standing Desk - bit.ly/2YzomEm
MX Master 3 Productivity Mouse - amzn.to/3aYwKVZ
Das Keyboard Prime 13 MX Brown Mechanical- amzn.to/3uH6VBF
Veikk A15 Drawing Tablet - amzn.to/3uBRWsN
🌎 Find me here:
Twitter - / beabetterdevv
Instagram - / beabetterdevv
Patreon - Donations help fund additional content - / beabetterdev
#AWS
#SQS

Пікірлер: 94

@sureshbabu8794 5 ай бұрын

Your AWS videos are far better than paid courses. Very clear explanation. Thank You!

@user-ry3ko3vh6p 2 ай бұрын

You are AMAZING!!! I've not had a single video explain anything as clearly as you do. Please keep doing what you're doing and MORE of it, because you are a natural teacher of the best kind.

@lanatimmo3686 Жыл бұрын

I was always scared of the SQS/SNS, and could never really understood them😅. Thank to your videos I do now! Very grateful for your great content and very neat and clear explanation, thank you a lot!☺

@jude3926 2 жыл бұрын

You really don't understand how this video just saved me stress. Thank you. Love the visual explanations and the details such as common use cases, etc... keep it up

@BeABetterDev 2 жыл бұрын

Thanks so much Jude and glad you found it helpful!

@rajendrawarrier7274 5 ай бұрын

Elegant way of explaining - simple and crisp - no fancy show business. Great job!

@marklautman4853 7 ай бұрын

Superb. The clearest description of SQS that I've come across.

@miguelviamonte8041 Жыл бұрын

Men! I can't appreciate all your videos enough. They had guided me on from zero to "hero" on my serverless journey in my new job (I started 6 months ago). I have a whole notification system for AWS Backup using SNS / SQS / Lambda running right now!

@himanshuagrawal2014 9 ай бұрын

Thanks a TON for such a tremendous , easy to digest video. Quiet explanatory at the same time. LOVED your pace of teaching and explaining the concepts. Stay Blessed Brother !

@BeABetterDev 9 ай бұрын

Glad the video helped and thank you so much for the kind words!

@islamtoghuj Жыл бұрын

I think this is the best channel to get a great overview of AWS.

@jamolkhonumarov5188 Жыл бұрын

one of the best explanation out there and it's free. Good job man

@BeABetterDev Жыл бұрын

Glad you liked it!

@islamh6042 8 ай бұрын

Great illustration, thanks for your efforts. Much appreciated!

@vijji8942 6 ай бұрын

Thanks for sharing comprehensive understanding of SNS. Appreciate your efforts!!

@ktapython600 Жыл бұрын

Hey Better dev, Just wanted to thank you for the tremendous time you spend on putting all these materials together and then compiling them for the great and educative videos you produce for all. You are a true leader, a role model, and a trendsetter for many. Keep up the good work because you are impacting lives worldwide, and I want to thank you for your selfless sacrifice to the human race. Jah, Rastafari!!!

@Room3102 Жыл бұрын

Another clear, straightforward, awesome video!! Thanks, man!!

@BeABetterDev Жыл бұрын

You're very welcome Clerton!

@kino-xw4xg Жыл бұрын

This video has been extremely helpful with my studies for SAA, just wanted to thank you so much for this

@BeABetterDev Жыл бұрын

Glad it was helpful!

@bishnuprasadmishra1733 3 ай бұрын

Excellent introduction to SQS! Thank You!

@16beat41 Жыл бұрын

This is the best tutorial video ive seen for SQS

@arrecky 9 ай бұрын

great, thanks for explaining it in a really simple way

@Hiroki-Takahashi Жыл бұрын

Excellent video as always!

@bouzie8000 Жыл бұрын

Thoroughly appreciate this video. You have no idea

@milanvarma4120 10 ай бұрын

Amazing tutorial loved it

@SemenAlexndrovich 2 жыл бұрын

Your videos are amazing! Thank you so much!

@BeABetterDev 2 жыл бұрын

You're very welcome Semyon!

@et4493 Жыл бұрын

Top notch content man. Thanks!

@alizadasaleh2291 3 ай бұрын

Very Clear Explanation!

@sergiojuradolozano 8 ай бұрын

very well explained. Thanks!

@andrewmcburney4425 Жыл бұрын

You're a great teacher - thank you for the video

@BeABetterDev Жыл бұрын

Thanks so much Andrew! Glad you enjoyed :)

@lholhofox Жыл бұрын

Thanks for this video!! Keep it up!!

@ulricha.abiguime7918 2 жыл бұрын

thanks for putting all this information short for us, lazy ones

@Radekk225 Жыл бұрын

Great explanation thanks!

@chris0628 Жыл бұрын

Awesome content…saved me hours of google and reading through documentation 👌🏽

@BeABetterDev Жыл бұрын

Glad it helped!

@markcaro4419 Жыл бұрын

Excellent introduction to SQS!

@BeABetterDev Жыл бұрын

Thanks so much Mark!

@ahmadfahmi5129 Жыл бұрын

Thank you for this fancy explanation

@np8688 Жыл бұрын

Simply explained, thank you ! Keep up ;)

@BeABetterDev Жыл бұрын

You're welcome!

@malikmubashar5040 5 ай бұрын

thank you so much for this

@Nabilliban14 Жыл бұрын

Thanks for this great overview! Quick question, as part of the "at least once delivery" that standard SQS provide, can I assume that duplicates will have the same messageID? Also, even though it is "at least once delivery", I can assume that there won't be two versions of the same message in a queue at the same time, thus respecting the visiblity timeout you mentioned at 11:20, right?

@mayankparmar8155 9 ай бұрын

Hi @BeABetterDev , 1). Can SQS accept an Event Published from a System (example : Salesforce - Events) ? 2). What is the count of messages that an SQS can accept from an external System (i.e, Published Message Count from System -> Amazon_SQS ) ? 3). Can SQS accept Bulk Messages / Events ? Please let me know. Great video, Clarified in a single go.

@stayingaliveable 8 ай бұрын

thank you for this video!

@pythonbrothersandfamily 8 ай бұрын

PURE GOLD. Thanks a loooooot Be A Better Dev is my shepherd; I shall not want. He maketh me to lie down in green pastures: he leadeth me beside the still waters. He restoreth my soul: he leadeth me in the paths of righteousness for his name's sake.

@Erica-up2xm Жыл бұрын

Great Explanation. Have a quick question. I have multiple queues where the poller should be fetching the messages from all of them based on some priority. And the priority would be like this - for example 1st queue having only 2 messages, 2nd queue having 100 messages and 3rd queue having 1000 messages then I want the poller to initially poll the queue which has less number of messages i.e here the poller should initially poll 1st queue then the 2nd and then the 3rd. How can this be achieved.

@sreejithsreedhar05 2 жыл бұрын

Indeed the video is very informative ,Thanks for sharing . I have a small doubt ,similar to query parameters in API how we incrementally poll messages from SQS queue. I would need to poll messages based on a particular timestamp.

@samikshasharma3544 7 ай бұрын

Amazing video

@triminhtran2470 10 ай бұрын

Thank you so much

@StraightCoding Жыл бұрын

Very Good explanation, i like it👌

@edwinmarrima6476 2 жыл бұрын

Perfect explanation

@BeABetterDev 2 жыл бұрын

Glad it was helpful!

@as180697 6 ай бұрын

Thanks!

@eiderarango5863 2 жыл бұрын

Thanks bro, nice video. Keep it up.

@BeABetterDev 2 жыл бұрын

You're very welcome and thank you!

@saragasmichalis2177 2 жыл бұрын

Great video !

@BeABetterDev 2 жыл бұрын

Glad you enjoyed it!

@m.e10150 Жыл бұрын

Thank you very much

@surajthallapalli4227 2 жыл бұрын

Legend !!

@r_mani41 11 ай бұрын

U R A WONDER

@totsubo2000 2 жыл бұрын

Great video. What are the downsides/tradeoffs of using SQS vs. SNS? In my mind SNS can do everything SQS does and more (i.e. supports multiple subscribers). Also you mention that the consumer sets the consumption rate. How would that work with something like having a Lambda as the consumer? I'd imagine Lambda would spin up as many instances are required to process as many SQS messages as quickly as possible.

@BeABetterDev 2 жыл бұрын

Hi Jean, I have a video that compares the two check out the link below. kzfaq.info/get/bejne/o76bY7B_z9KzZ3U.html

@munteanionut3993 Ай бұрын

Lovely AWS tutorials. Kudos to you and I hope you will keep it going! Could you please better explain the beginning? 00:00:42.160 in the past when two services had to 00:00:44.399 communicate with one another one service 00:00:46.559 would perform an api call to inform the 00:00:48.960 other service that something changed or 00:00:51.039 some kind of event occurred on its side 00:00:53.680 now using sqs this contract has changed 00:00:57.039 instead the producing service of the 00:00:59.359 event or the notification can 00:01:01.359 asynchronously notify the consumer that 00:01:04.080 something changed in its system I do not understand what you were trying to imply.. by how I interpret it & how the above text is phrased; you say - in the past: one service had to inform the other something changed on its end through an API call - now: the contract changed, id: the service in which something changed (same as above till now) can asynchronously notify the consumer that something changed in its system... how do the above differ? did you mean API calls in the past were always "blocking" instead of "async"? is this what you meant? I do not follow, sorry..

@AbdelhameedG 2 жыл бұрын

Thank you

@BeABetterDev 2 жыл бұрын

You're welcome!

@BijanHoomand 2 жыл бұрын

Great video. Quick question: when you mention cross account patterns, do they also support cross partition data transfer? For example if I have an AWS account in China and another in USE1, can I publish from my SNS queue in China into my SQS queue in USE1?

@BeABetterDev 2 жыл бұрын

Hi Bijan, Cross region sns to sqs works for all cases except involving the china region. I found this post on the topic if you're interested: stackoverflow.com/questions/69061869/is-it-possible-to-publish-sns-messages-from-global-aws-account-to-sqs-queues-in Hope this helps

@BijanHoomand 2 жыл бұрын

@@BeABetterDev LOL, thanks heaps for checking it out. Yeah, unfortunately it seems it is not possible. I am investigating if there is a way to make that happen; IAM seems to be out of the picture; I am thinking of using temporary security credentials with SQS: docs.aws.amazon.com/AWSSimpleQueueService/latest/SQSDeveloperGuide/sqs-using-temporary-security-credentials.html ; will keep you posted if I could somehow pull it off

@amineelmhamdi3576 Жыл бұрын

Thanks

@BeABetterDev Жыл бұрын

Thank you so much for your generosity!!!

@the80scyborgninja39 Жыл бұрын

Would this be ideal for returning a dictionary from a lambda as a message to be consumed by other lambdas?

@foobarbecue Жыл бұрын

25:24 I guess Clodudwatch is for monitoring failures to launch (duds)

@chessmaster856 6 ай бұрын

Sqs has a limit of 10 messages and 256kb message size. That sounds something very obsolete technology not really modern high performance

@BR-lx7py 2 жыл бұрын

What happens in a FIFO if a consumer could not correctly handle a message and it is requeued? Does it block other messages being processed, since it's a FIFO?

@BeABetterDev 2 жыл бұрын

Hi B R, great question. I couldn't find any direct answer to this on the AWS documentation but here is something insightful. From here, under "FIFO queues": docs.aws.amazon.com/AWSSimpleQueueService/latest/SQSDeveloperGuide/sqs-dead-letter-queues.html "FIFO queues provide exactly-once processing by consuming messages in sequence from a message group. Thus, although the consumer can continue to retrieve ordered messages from another message group, the first message group remains unavailable until the message blocking the queue is processed successfully." I feel like based on this it probably blocks the queue from processing messages in the same message group. However to know for sure its probably worth a quick experiment.

@BR-lx7py 2 жыл бұрын

@@BeABetterDev I played around with it and FIFO-s are blocking. Inserted 3 messages into a FIFO with send-message, then the first receive-message returned the first inserted one, but then calling receive-message again didn't return anything. Had to do a delete-message with the receipthadle of the first message to get the second one inserted. You'd better handle your exceptions in the code that processes the messages.

@potatoman2602 2 жыл бұрын

Thanks for all these videos. Do you have a video on local dev environment with aws - I couldn't find one? How do you approach this? Do you test against another dev aws environment or do you spin up everything locally with mocked/faked services like localstack?

@BeABetterDev 2 жыл бұрын

Hi Potato Man! Check out this video on my setup: kzfaq.info/get/bejne/ea1zoZOTmayzlqc.html I haven't made one for IDE / plugins but if you think it would be useful I can make one. Cheers

@rishiraj2548 Жыл бұрын

Gratitude

@tomasesber6056 Жыл бұрын

Nice. My question is: what are the drawbacks of this continual "polling" being done by Service B in your minute 17:30 example? Suppose your service A does not send messages to Service B for months on end, is this "polling" costing anything (i.e., computational cost in terms of site performance, AWS fees)?

@tomasesber6056 Жыл бұрын

Should have finished the video before asking... it seems like Long Polling avoids the need to continually poll for messages. Still curious about the drawbacks of this, though.