Throughput vs. Latency: How To Debug A Latency Problem

Рет қаралды 16,618

Күн бұрын

Imagine you’re on call for the service you work on and you get paged in the middle of the night. Phone blaring, you stumble out of bed, sleepily turn on your computer, and look at your metrics. Looks like request latency went up a lot and users are getting errors. How do you figure out what’s going on? In this video, we’ll answer this question by looking at the relationship between throughput and latency, subtypes of latency like queuing latency, and techniques for debugging high latency. All you need is a little familiarity with software engineering. Let’s go!
00:00 Intro
00:28 Servers & Threads
00:53 What Is Latency?
01:24 What Is Throughput?
01:46 Ice Cream Analogy
02:19 Max Throughput
03:32 Queueing Latency
04:36 Server Simulation (don't miss this!)
07:17 Summary
07:58 How To Debug High Latency
08:33 Things Can Be Even More Complicated

Пікірлер: 35

@mykhailo_klym 2 жыл бұрын

man, these videos you make on programming, they're amazing ! Keep it up !

@user-qr8gx2kx9q 2 жыл бұрын

Agree 100%, this channel is a gem

@arber10 2 жыл бұрын

Very nice explained and excellent animations with the graphs. I like this channel. 10/10

@user-cl7ev6xm9s Жыл бұрын

this is the best video i have ever seen on this topics , thanks bro

@scottk3292 Ай бұрын

I wonder how two other illustrations might illustrate issues which can arise with servers. One: the counter clerk at the ice cream store is doing fine until one of the ice cream buckets runs empty, so they have to go get another from the freezer, and a line forms. Two: Now the customers are angry about the line, and each one wants to register a complaint, which decreases the intrinsic throughput. So the process of getting another bucket and any decrease in throughput from the hard-frozen data (I mean ice cream) along with complaints, ends up creating bigger and bigger issues.

@aysubetin-can6435 5 ай бұрын

Great video series, please do more

@saurabhman 4 ай бұрын

Good work Alex!

@kokolingga9673 Жыл бұрын

This is very helpful. Thank you Alex!

@radub6436 2 жыл бұрын

Excellent video!

@Y3arin 2 жыл бұрын

Great video, thanks! I'd recommend you consider getting rid of the background music though, it's really distracting :(

@StudyingWithAlex 2 жыл бұрын

Sorry about that! I've noticed the music sounds completely different depending on the speakers you're using. What speakers do you use? Does it sound loud if you listen to it on a computer or with headphones?

@Razwizz 2 жыл бұрын

@@StudyingWithAlex eiiii yooo :))

@shashink5923 2 жыл бұрын

On the contrary, I really like the background music. Makes it more engaging!!

@SamarthSoni-qo8je Жыл бұрын

Please more videos like this. Ready to join this channel too if you're activating the join or membership kinda thing

2 жыл бұрын

Excellent video. I’m surprised it didn’t get many likes.

@shashink5923 2 жыл бұрын

This video is dope AF!!. Thank you

@mostinho7 Жыл бұрын

Thanks for making this! Where can I learn more about this topic? Any good resource recommendations?

@PradeeshKumarshow 27 күн бұрын

Did you find any?

@cale7306 8 ай бұрын

a good example to add is intrinsic latency is very important for gaming where to data packets are relatively small, but you want it it get to destination and back fast.. there concept difference between downloading a file vs live streaming or gaming.., Cable Internet have bad intrinsic latency..

@user-xo4rr5en3e 9 ай бұрын

thanks man

@1Lightest 3 ай бұрын

nice content

@Saikumar_vgs Жыл бұрын

Hi @StudingWithAlex, Loved your videos and great animation with right context. Can you make a video or any guide to make videos like this... Thank You 😃😃

@thehimanshukeshri Жыл бұрын

well explained

@Razwizz 2 жыл бұрын

Clockwork hell yeah!

@nihar108 3 ай бұрын

Why did you stop making videos? Please restart if you can!

@LioPrime 10 ай бұрын

i watch these for entertainment lol

@cvramankishore4u Жыл бұрын

nice videos

@krishnasai4742 2 жыл бұрын

does throughput care about the correctness of the output? or only churning out the date ?

@blucky_yt 2 жыл бұрын

Throughput is only a metric of how fast the work is done, not how good it is done, it doesn't care if it's wrong, only if it's fast. It's like in that dumb joke: -I am the fastest counter in the world -what's 2+2 -5 -that's wrong -but fast