Whoop Strap 3.0 Scientific Review: Accuracy (Sleep, Heart rate)

Рет қаралды 45,515

Күн бұрын

I tested the sleep tracking and heart rate accuracy of the Whoop Strap 3.0.
👇 $30 off any new WHOOP membership, affiliate* (paid) link, supports the channel!👇
join.whoop.com/QuantifiedScientist ($30 off any new WHOOP membership)
*My opinions are completely my own. However, I do earn a small commission if you purchase any of these devices via my affiliate links. It does not cost you any more money if you use these links.
Instagram: / quantified_scientist
Twitter: @QuantifiedRob
Website: www.robterhorst.com
The EEG tracker I used is called the Hypnodyne ZMax: hypnodynecorp.com/ from @HypnoDyne Corp
📹First Garmin Venu Sq Video📹
• Garmin Venu Sq Heart R...
📹Oura Ring videos📹
Sleep Test: • Oura Ring Scientific S...
HRV Test: • Oura Ring Review: Hear...
Temperature Test: • Oura Ring Ultimate Tem...
📹Apple watch videos📹
Test: • Apple Watch 6 Accuracy...
📹Fitbit Sense videos📹
First look review and test: • Fitbit Sense Accuracy ...
Heart rate: • Fitbit Sense Heart Rat...
📹Withings Scanwatch videos📹
Unboxing and first review: • Withings Scanwatch Rev...
Sleep test: • Withings Scanwatch Sle...
Heart rate test: • Withings Scanwatch Hea...
Q&A with Withings: • Scanwatch Q&A: Answers...
⏱️This comparison is part of a larger project where I spend over 11 hours a week tracking everything in my life. If you'd like to know more:
• This mad scientist sca... ⏱️
Timestamps:
00:00 Intro / Experimental Setup
01:45 Sleep Test: Night Overview
05:43 Sleep Test: Stages Compared
08:12 Heart Rate Test: Overview
09:59 Heart Rate Test: Examples
12:04 Conclusions and Limitations
🎵Music🎵
(1) Not Without the Rest by Twin Musicom is licensed under a Creative Commons Attribution license (creativecommons.org/licenses/...)
Artist: www.twinmusicom.org/
(2) Wonders by JVNA
(3) Can’t Sleep (KZfaq Audio Library)
(4) Classique (KZfaq Audio Library)
(5) Blurry Vision (KZfaq Audio Library)

Пікірлер: 126

@sandipmukhopadhyay8505 3 жыл бұрын

These videos are the best! No one else is reviewing sleep trackers with this kind of detail. Great work man!

@m-618 3 жыл бұрын

Excellent analysis, as always. Thank you. It is always a pleasure to watch your videos.

@joelboyd-skinner1981 3 жыл бұрын

Man you are truly brilliant. I wish you all the best.

@ilias2841 3 жыл бұрын

Impressive comparison ! Thank you you have answered many of my questions !

@ore0sareg00d 3 жыл бұрын

Thanks for the video. So much value, appreciate your efforts.

@TheRPlazas 3 жыл бұрын

Awesome video! I have been waiting for the whoop video series!

@TheQuantifiedScientist 3 жыл бұрын

More to come!

@falcopunch14 3 жыл бұрын

Fantastic videos! Giving the people reliable and transparent reviews. Subscribed super fast (y)

@Lofty2908 3 жыл бұрын

Thanks for this, I’ve been looking at switching to the Apple Watch from the whoop strap and you’ve definitely made up my mind! It certainly explains why whoop’s calorie count is always so much lower than others as it’s missing those spikes in heart rate.

@Gcman0274 3 жыл бұрын

Just discovered your channel, great vids & very thorough. thank you for taking the time to do these as it really talked me off the edge of wasting my money on a Whoop strap with real information. I'll stick to my Wahoo Element HR strap and sleep and recovery the way I always have & keep my money :) I am however looking forward to future review with once you receive the sleep data from Whoop.

@ArabMongoose 3 жыл бұрын

Awesome video as always! I look forward to the follow up. Keep up the great work!

@TheQuantifiedScientist 3 жыл бұрын

Thanks a bunch!

@pavelefimkov1805 3 жыл бұрын

Awesome got to whoop! Will be waiting for exported data review. ;) To see how it will perform.

@antoniocampos3067 2 жыл бұрын

Awesome video. What I loved the most is that beautiful X220.

@AmericanPTstuttgart 3 жыл бұрын

Great video man! Super pumped to cancel my membership to Whoop! 😂😂

@ryanredman8377 3 жыл бұрын

I"m done with Whoop after 1 year, inaccurate sleep scores are not good for the psyche.!

@AmericanPTstuttgart 3 жыл бұрын

@@ryanredman8377 ya! Totally. Read my other comment I left in more detail there. The Whoop is sadly pretty worthless

@maxrey4055 3 жыл бұрын

why? it's a consumer device that is not perfect but still useful. @ Conclusions and Limitations

@maxrey4055 3 жыл бұрын

@D R yep, I caught that as well. After reading some of these negative reviews I was also considering not ordering but after really deep diving and knowing that a lot negatives are taken out of context I decided to move forward.

@rodas4yt137 3 жыл бұрын

You deserve my like as always sir

@JoeWhite42 3 жыл бұрын

Great video man!

@sol029 3 жыл бұрын

Thank you for bringing some science to this. So appreciated.

@leventemolnar1805 3 жыл бұрын

I love your videos as they are very comprehensive! Do you have any news when can we expect the huawei watch fit sleep testing? Thanks!

@andyryan9852 3 жыл бұрын

Love your videos! Great work. I have a whoop and find it good overall. It tries to be alot, so there are bound to be limitations. Its helpful as a broad gauge of the days when you should push yourself or take it a bit easier when exercising. Would you recommend any products to add together in order to get more accurate results, in place of the whoop. i.e. constant heart rate monitor, sleep tracker , HRV trackers etc...?

@resistcrew1149 3 жыл бұрын

Thanks for this! Great review!, can we see something from Samsung and polar?

@surfreadjumpsleep 3 жыл бұрын

Great video. I've been waiting for this video. Are you going to share your polysomnograph device design as well?

@johnmanley4528 3 жыл бұрын

Nice review. The Apple Watch seems to have had the most accurate heart rate tracking for activities that I have seen in your videos.

@samstruyven2299 3 жыл бұрын

Well done!

@simplyme9336 3 жыл бұрын

I think whoop states t that you have to wear it for at least 2 weeks for the ai to get adapted to you before having accurate results

@Tiamo1519 3 жыл бұрын

Nice Video again! Keep on going. Thanks for your work. Will the Apple Watch Video come next?

@TheQuantifiedScientist 3 жыл бұрын

Hi Tim! Yes, I plan to look at the "Pillow" app next weekend :-D

@Phaseish 3 жыл бұрын

did you do this for the apple watch? love your work man thank you for the science!

@Brahvooo 3 жыл бұрын

Your videos are great, I’m just stumbling upon your channel now! Are you able to do an accuracy comparison of the Whoop 3.0 to the Fitbit Sense? I’m currently wearing both but I don’t have access to a medical grade sleep tracker to track accuracy. From what I’m seeing, it’s possibly the Whoop overestimates on REM and Deep though, would this be a correct assumption?

@HawkMcDork 3 жыл бұрын

as a user of whoop for the last 6 months or so, i'm super skeptical about it and have had many occasions months after starting that make me question it's accuracy. the findings of this video are not very surprising to me. thanks for making it. had i not have opted to save money for the subscription for paying more upfront i probably would've cancelled by now.

@marvtheandroid 3 жыл бұрын

This illustrates my biggest issue with Whoop: that they only gauge your "recovery" stats based on what they believe to be your deep sleep. Great analysis!

@TheQuantifiedScientist 3 жыл бұрын

Thanks for the feedback!

@garluis23 3 жыл бұрын

Oh wow, first. Excellent videos

@TheQuantifiedScientist 3 жыл бұрын

Hey, thanks!

@jasonthillman5852 3 жыл бұрын

Awesome content, subscribed. I got the Whoop strap a month ago and I'm disappointed to hear it's not quite as good for sleep tracking as I hoped. I'm curious to see your conclusions based on the larger dataset? Any idea when you'll publish that video?

@christopheralix8554 2 жыл бұрын

"Those data" ... finally someone who uses the PLURAL word "data" correctly..ill sub

@bluespeck9119 3 жыл бұрын

I'm somewhat surprised you're not constantly grinning in your sleep as well.

@TheQuantifiedScientist 3 жыл бұрын

Haha, I was too when I saw the footage. I guess the muscles in my face also need some rest ;-)

@bluespeck9119 3 жыл бұрын

@@TheQuantifiedScientist That's the thing, I thought smiling WAS your face's resting position. :P

@seuncoker 3 жыл бұрын

Haha lol 🤣

@bluespeck9119 3 жыл бұрын

@Jordan Kai DO NOT Google comments from 2 day old YT accounts with no uploads. YOU WILL GET SCAMMED. Both comments reported.

@depfeffel6455 3 жыл бұрын

@@bluespeck9119 there's so many of these, two comment scams. Both same person

@AN-zg3sr 2 жыл бұрын

Thanks for all your efforts I appreciate ...Can u review beddr sleep app??

@limpybiker 3 жыл бұрын

To export data from whoop you could use the HR broadcast function of the strap.

@connectionrejection 3 жыл бұрын

After doing analyses on both Whoop and Oura, which one would you recommend in terms of the highest accuracy & precision? Thanks!

@BasiliskSmith 3 жыл бұрын

Hey man, you've probably made your decision already, but having watched the majority of these now, it's pretty clear that the budget option is a fitbit (~72% accuracy) and the Dreem 2 (~84% accuracy) is the pricey option. The Oura ring is surprisingly inaccurate for the price.

@glenbergman9040 2 жыл бұрын

thanks for your analysis. What device did you use to record heart rate from the Polar H10 strap?

@MartyGold 3 жыл бұрын

Yes, wear it on your wrist just above the wrist bone.

@johnl7857 3 жыл бұрын

Any plans on retesting the fitbit sense heart rate with the latest update?

@djgarrett21 3 жыл бұрын

Great video! If you do a follow on video could you look at the accuracy of the HRV measurements? Whoop relies on HRV more than any other metric to determine their recovery score. When you get the data export from Whoop I'd be curious to know how they determine the HRV value that the app displays. The measured HRV Whoop displays can change pretty dramatically if I modify the start/end times of my sleep. I'd be curious if HRV is a single point measurement or if it is averaged in some way. I suspect they are using a single point and if that is true maybe the data you get from Whoop will show at what point in the night your HRV was measured. I've got about 6 months of Whoop data I can share if you'd like. I've worn my Fenix 5X along the Whoop almost the entire time. So I have HR and sleep data from both devices. I also have about 50 cycling activities where I've worn the WHOOP and another optical HR sensor to compare against as well.

@sarahbethdippel6705 3 жыл бұрын

Yes! Please check into this. I'm glad I'm not the only one frustrated by the fact that my HRV can be HUGELY different if my sleep time changes. On one occasion, my recovery went from 27% to 96% simply but changing my sleep end time.

@pray4liberty 3 жыл бұрын

Pps contact me. I am wearing Garmin Fenix - now Quantix for 6 years. Now I wear Oura and Whoop together and hesitate which one to keep. I prone to Whoop but watched this video I am about to return. Thx. Cheers. Marian

@San37815 3 жыл бұрын

Could you try checking the accuracy of the sleep phaser v2 from Urbandroid?

@cblad1406 3 жыл бұрын

Hey, can you test the Withings BPM Core, good thing to have i Covid-19 times. Regards Claes

@eddieleos9664 3 жыл бұрын

This great man, always wanted to see how accurate the Whoop strap was! I've been wearing it for 3 years and have sort of trusted it 😅 do you have any videos regarding any of the Samsung watches?!

@TheQuantifiedScientist 3 жыл бұрын

Glad I could help! At some point I hope to test Samsung for sure!

@TechShmoo 3 жыл бұрын

Surprised to see that Whoop sleep tracking was so off, despite their lofty claims. I've been interested in Whoop due to the appearance that they have interesting data analysis, but if the data is off, what's the point? Anyways, continuing to use my Fitbit Charge 4. Although I'm hoping that the Sense receives update(s) that improve heartrate accuracy.

@cknackna8207 3 жыл бұрын

Could you replace the biceps curls with burpees? With adjusting the burpees amount for a set, like: (7 Burpees + 40 seconds rest) x 5 and playing with the tree numbers, you could reverse engineer the step response delay. A HIIT example... instead of dicusing the form, of your curls...;-)

@greenyankee 3 жыл бұрын

Please review AutoSleep for Apple Watch 6!!!

@onlineservices2050 3 жыл бұрын

Just purchased the new Amazon Halo. It also does detailed sleep tracking. I would love if you reviewed this device as well. It’s available now for $100 on Amazon

@TheQuantifiedScientist 3 жыл бұрын

Hi! Indeed! Unfortunately I think we cannot get it in Europe yet...

@therichieconway Жыл бұрын

I'd love to see you send the "Biostrap" through the ringer!

@PhotosByRicardo 2 жыл бұрын

How do you extract the whoop data to overlay it? I can only seem to do it with polar

@localbear 3 жыл бұрын

Weird question but where are your glasses from?!

@brawlstargamer1427 3 жыл бұрын

I think that Fitbit has updated this issue, I beg you to make a video about if it is so. Then I can buy it .

@InkaVukovic 2 жыл бұрын

Hi, I see this is a video from Dec 27 2020, which is not so old but the sleep phases results are quite different than results that you presented in the latest video (Whoop Strap 4.0 Announced! But, how good is the Whoop Algorithm? ) and I'm just wondering what is the cause? Is it possible that they improved the algorithm or did you had some different methodology in measuring? Thank you so much for the answer and for the all of the valuable insights you provide!

@TheQuantifiedScientist 2 жыл бұрын

Hi Inka. I have been wondering that myself. I think it could be several things: (1) For the new analysis I used much more data, which makes it less likely to get random bad nights (2) It could be that the algorithm improved (3) It could be that they use some kind of dynamic algorithm that gets more personalised and improves over time> I am not sure. I just present the data as I have them ;-) Cheers, Rob

@InkaVukovic 2 жыл бұрын

@@TheQuantifiedScientist thank you Rob for this super fast response!!

@nurikmen000 3 жыл бұрын

Nice

@vickytaylor6192 3 жыл бұрын

According to you, what’s the best fitness tracker for a martial artist interested mainly in recovery, heart rate and sleep monutoring?

@tahirahmed33 2 жыл бұрын

Is whoop better than oura ring 💍 / Biostrap EVO

@ioannispolitis7244 3 жыл бұрын

We are waiting for the Apple Watch sleep tracking accuracy!!

@den15423 3 жыл бұрын

I have been waiting for a long time

@TheQuantifiedScientist 3 жыл бұрын

The plan is to release the first video the coming weekend. I analyzed about 70% of the data I would like to include already, but want to collect 2 more nights of data to be sure. The first video will be Pillow or Sleep Cycle (I am leaning towards sleep cycle at the moment). Thanks for waiting 😄

@ioannispolitis7244 3 жыл бұрын

@@TheQuantifiedScientist happy to have a response to my first ever post in KZfaq (almost 40 years old). PhD in transport engineering with love in data analytics! So happy to see your scientific approach on measuring accuracy of the devices! Well done, keep the (research oriented) work!!

@Bepartofthepanacea 3 жыл бұрын

@@TheQuantifiedScientist looking forward to hearing from you soon, much love and thanks 😊🙏

@KelpieMindTricks 3 жыл бұрын

So..how do you know your reference device is accurate?

@behappy60103 3 жыл бұрын

I am curious why it's 2 LEDs in the bottom instead of 1?

@TanyaThalia 3 жыл бұрын

So do you think it would have been a lot more accurate if you wore it around your wrist how they recommend? Because I wear it around my wrist always and never higher!

@Greeksy 3 жыл бұрын

I am also wondering about this

@ElohimEssaim 3 жыл бұрын

It is generally agreed that the higher up your arm the band is, the more accurate Readings you'll get, this is why some shoot for getting the bicep band instead of the wrist strap for more accuracy

@supracurious 3 жыл бұрын

Any luck with getting your data back from whoop?

@onlineservices2050 3 жыл бұрын

What is sleep ‘alignment’???

@mboiko 3 жыл бұрын

Wow...I think I'll stick with my Mi Band 5.

@maxrey4055 3 жыл бұрын

I was expecting you to totally slam the Whoop but after listing to the Conclusions I see that the data still is useful considering this is a consumer device. People need to manage their expectations and learn how to use limited data accordingly.

@stankidofu5829 3 жыл бұрын

considering that according to measurement intensity, for movements at least, awake has the most, then light sleep, then deep sleep, then rem... why dont you plot it that way on your charts? that would explain the misinterpretations by most of these sleep trackers much better i assume?

@konicky 3 жыл бұрын

Any update on the Apple watch sleep apps testing ?

@TheQuantifiedScientist 3 жыл бұрын

Hi! Thanks for the comment. I was actually wearing the Apple watch during these nights too. Had some issues with data collection because my iphone died and I had to get a new one, which took a bit of time. However, I have a few days worth of data, and I plan to make the video next week about one of the apps, probably "Pillow". Unfortunately these apps also do not have great data export possibilities, so it takes some effort to manually copy the stages ;-)

@konicky 3 жыл бұрын

@@TheQuantifiedScientist Great, thanks for all the work that you are doing. I would think that videos on the Apple sleep apps will be a great way to get your views and subscribers up, given the many millions of people who use them. We could link them to forums on MacRumors and others.

@bardam830 3 жыл бұрын

@@TheQuantifiedScientist i think AutoSleep is a better app for sleep tracking if you can test it one day cheers ☺️

@APR702 3 жыл бұрын

Can you try wearing the whoop on your wrist so you know it’s where it should be ? Maybe that made the sleep and HR shitty lol

@RohitSriSai369 3 жыл бұрын

Hai scientist

@keeoone87 3 жыл бұрын

I think it takes a few days to calibrate correctly to each person. I wonder if you wore it for a month and if it would be more consistent?

@hdominguez17 3 жыл бұрын

Will you do a second video on whoop?

@TheQuantifiedScientist 3 жыл бұрын

Hi Hugo! I hope so. I have been waiting several months now for Whoop to process my data export request...

@AmericanPTstuttgart 3 жыл бұрын

I am a sports physical therapist and I noticed some issues with my Whoop strap a few months after starting my membership. I will briefly explain in my opinion why this video is so bad for Whoop 1. If the high rate that is quick to go up and then drop our missed by Whoop, then this strap is not accurate for Crossfit workouts and will grade the daily strain wrong. I noticed this when a CF WOD would put me at a 6 on strain, yet a brisk 5K in the part brought my strain to a 12. In return, that means the entire algorithm for my personal daily health is off since strain is one of the major factors. 2. The Quantitative Scientist has Videos factually showing the Oura ring is not as accurate as it should be with the different sleep stages. It matches my Whoop data almost 100%. It was even more damming when he said (in this video) that the Oura ring was a little more accurate. Thus, meaning the difference was in Oura’s favor. 3. Why is there data locked off? I find it very odd that he had to write them requesting the ability to download his own stats. It makes me wonder if they follow a very typical business practice in the states. Have a ok product, great marketing, and membership. 4. Membership. Personally, I feel if a company wants to have a membership based platform and continually charge for a service that it’s competition does not, then the product must warrant the the simple fact it will end up costing 10x the price of the others. In conclusion, if my strain and sleep is miscalculated then 2 out of 3 sections of Whoops algorithm is calculated off of poor data. If I were to pay for the product one time then maybe it would be justified. However, a monthly sub only to receive poor data?

@user-gu9fo4rn6d 3 жыл бұрын

I think that the current gadgets in which there is a sleep analysis function are not yet accurate ... in general, sleep is a very difficult thing and even scientists have not really figured it out ...

@pvwg 3 жыл бұрын

I wonder why the WhoopStrap has no oxygen sensor, while several other tracking devices these days do? To me, this makes the device useless for sleep measuring, as the oxygen level during the day and especially during the night is crucial for me.

@TheQuantifiedScientist 3 жыл бұрын

Hi! I guess they felt they did not need it for their most important measurements. But I suspect the Whoop Strap 4.0 will have it, even if it is just to keep up with the competition. Have a great day!

@chrisogrady28 3 жыл бұрын

Great video, but you can't trust anyone that goes to bed before midnight

@sankadayananda3769 3 жыл бұрын

Can you do a review on Samsung galaxy watch 3 accuracy as well

@Snowmans.Cradle 3 жыл бұрын

Garmin sleep test! Garmin sleep test! Garmin sleep test! Garmin sleep test! :)

@hussla28 3 жыл бұрын

And you have to pay a monthly a subscription for this thing? I don't think it is worth it.

@richjlaw 3 жыл бұрын

Shame you didn't review the HRV/recovery part of Whoop since that's mainly why people wear it. (Whoop say themselves that you should get the upper-arm strap for weight-lifting/cross-fit tracking)