AutoSleep App Review: Apple Watch Sleep Science Test

Рет қаралды 139,492

Күн бұрын

I tested the sleep tracking of the AutoSleep App on my Apple Watch Series 6 against a scientific EEG device. For updates subscribe to my weekly Newsletter(!) on www.robterhorst.com
Instagram: / quantified_scientist
Twitter: @QuantifiedRob
👇Amazon Affiliate* (paid) links. Supports the channel, doesn't cost you any more!👇
Apple Watch 44mm: geni.us/7Dom
Apple Watch 40mm: geni.us/0gNGeO
*My opinions are completely my own. However, I do earn a small commission if you purchase any of these devices via my affiliate links. It does not cost you any more money if you use these links.
The EEG tracker I used is called the Hypnodyne ZMax: hypnodynecorp.com/ from @HypnoDyne Corp
📹Apple watch videos📹
Sleep Cycle App: • Sleep Cycle App Review...
Steps: • Apple Watch 6 Step Cou...
Test: • Apple Watch 6 Accuracy...
📹First Garmin Venu Sq Video📹
• Garmin Venu Sq Heart R...
📹Oura Ring videos📹
Sleep Test: • Oura Ring Scientific S...
HRV Test: • Oura Ring Review: Hear...
Temperature Test: • Oura Ring Ultimate Tem...
📹Fitbit Sense videos📹
First look review and test: • Fitbit Sense Accuracy ...
Heart rate: • Fitbit Sense Heart Rat...
📹Withings Scanwatch videos📹
Unboxing and first review: • Withings Scanwatch Rev...
Sleep test: • Withings Scanwatch Sle...
Heart rate test: • Withings Scanwatch Hea...
Q&A with Withings: • Scanwatch Q&A: Answers...
⏱️This comparison is part of a larger project where I spend over 11 hours a week tracking everything in my life. If you'd like to know more:
• This mad scientist sca... ⏱️
Timestamps:
00:00 General intro
00:51 Test Setup and AutoSleep
03:16 Test Results: 12 Nights Compared
07:21 Test Results: Overview Analysis
09:51 Test Results: Compared to Sleep Cycle App
11:05 Test Results: Correlation Analysis
13:15 Conclusions
15:20 Limitations
🎵Music🎵
(1) Not Without the Rest by Twin Musicom is licensed under a Creative Commons Attribution license (creativecommons.org/licenses/...)
Artist: www.twinmusicom.org/
(2) Wonders by JVNA
(3) Can’t Sleep (KZfaq Audio Library)
(4) Classique (KZfaq Audio Library)
(5) Blurry Vision (KZfaq Audio Library)

Пікірлер: 259

@markyt9203 Жыл бұрын

Can we revisit this app after the recent release of the series 8?

@adriannasui8627 Жыл бұрын

I would think the recent WatchOS 9.x changes profoundly improve the way autosleep works with regard to tracking stages - as they claim to use the values provided from Apple Watch. Would love an update ☺

@adriannasui8627 10 ай бұрын

@@smolcomputeI am not the app's creator. The autosleep algorithm unclear to me aswell, and there are even some inconsistencies/bugs that I have reported with no success. What I observed is that if you activate sleep stages inside Autosleep, then the sleep score relies heavily on the apple watch biometrics data ("sleep" data inside "health" app). It adds some extra computation but I don't think it tries to improve upon the 'raw' sleep data coming from the watch, more like what you said, a 'repackaging'

@evtyler 2 жыл бұрын

EXCELLENT video! Thanks so much for all the hard work that went into gathering, compiling and presenting this data!

@dmitryagafonov9096 3 жыл бұрын

Thanks, Rob! Very useful. The media is clearly missing this type of comparison.

@TheQuantifiedScientist 3 жыл бұрын

Thanks for the compliment Dmitry!

@felixwhise4165 3 жыл бұрын

once again, super excited for the final results of all 4 apps

@FranzTRUTRU 3 жыл бұрын

Thank Rob for your excellent testing, through the prism of science. I look forward to the test on the PILLOW app. Thanks to you.

@missFatimah97 3 жыл бұрын

Thanks Rob! awesome content

@hugosantiagohernandezlimas9085 Жыл бұрын

Great video!!! Thanks for the work you put

@derksenjenny 3 жыл бұрын

I use auto sleep for around two years , I love the app , maybe it’s incorrect I never had a way to test it .but I love that it shows heart rate and sound during the night .

@RafaelLudgero 2 жыл бұрын

Your work is just amazing!!

@sayuugao5891 3 жыл бұрын

Thank you for making these videos, such a informative channel!! Was trying to find an accurate app for sleep tracking on apple watch.

@heshanmithuranga4462 2 жыл бұрын

Amazing as always!

@TheQuantifiedScientist 3 жыл бұрын

*Subscribe to my weekly Newsletter(!)* on www.robterhorst.com Instagram: instagram.com/quantified_scientist/ Twitter: @QuantifiedRob 👇Amazon Affiliate links, support the channel!👇 Apple Watch 44mm: geni.us/7Dom Apple Watch 40mm: geni.us/0gNGeO Of course, only buy it if it makes sense for you!👍

@BrianJones-wk8cx Жыл бұрын

Interesting analysis, appreciate your work!

@mikhailratner7091 3 жыл бұрын

Great vid, especially the comparison to Sleep Cycle!

@tommiel6740 3 жыл бұрын

Thanks again Rob, very insightful !!

@TheQuantifiedScientist 3 жыл бұрын

Thanks Tommie!

@resistcrew1149 3 жыл бұрын

Such an underrated channel, what an analysis!....cant wait for the samsung galaxy watch 3 or active 2.

@danielf5794 Жыл бұрын

Thank you very much for your effort to produce such a highly interesting video!

@gymstuffonly2944 2 жыл бұрын

Fantastic job. Thanks and congrats!

@sobhhi 3 жыл бұрын

The confusion matrix around 9:00 I think was one of the best visual tools for understanding the results. Thanks for doing this.

@thantawanjanpoom9592 3 жыл бұрын

Thank you Rob. I have big data for you to analyze if you want because I had used this application for more than 1 years 😊

@neelsn007 2 жыл бұрын

Thanks for this great insight into this app

@markymark8472 3 жыл бұрын

Looking forward to seeing the next sleep app video

@yarineoung7852 3 жыл бұрын

Excellent review, appreciate your experiments :)

@katty5953 Жыл бұрын

Thank you! Very helpful!

@mussabgasmelseed5079 3 жыл бұрын

Love ur content they very informative

@johndauz6575 3 жыл бұрын

I love your videos! hope you can do a video on post-calibration of auto sleep and compare it again to the EEG.

@dienal-hakim8649 11 ай бұрын

This is the first Fitbit I have used. It has some new features kzfaq.infoUgkxbkrje8Y7BaqRkAjimw-55ajvVo7RbcIp and I like the information that it gives me.I think the phone app could be designed to be a bit more accommodating, as it can be confusing to use. The rubber band is comfortable, and normally I do not like rubber bands for my watches, but this is comfortable.I am looking forward to seeing if this helps me stay accountable in my fitness endeavors!My only gripe is the box was very damaged when it arrived, however, the tracker is performing perfectly!

@EljinRIP 3 жыл бұрын

Great video! I personally use Pillow app which also uses the apple watch. I would love you to test this app! Keep doing these videos, I love them! Edit: I just saw on your sleep cycle video you are testing other apps, including pillow. I can't wait.

@NewDBZSagas 3 жыл бұрын

Thank you so much for this 😊

@johnmanley4528 3 жыл бұрын

Very nice review. I’m about to get the Apple Watch and am interested in seeing which app you like best!

@gossumx 8 ай бұрын

Subscribed to wait for the update on the app with the Ultra 2.

@rayden1717 2 жыл бұрын

From Tunisia north africa thank you a lot we appreciate your effort , your are really helping peoples around the worlds may god bless you or nature or whatever energy contrôle this words Respect and encouragement

@Peppzzzz 3 жыл бұрын

Thanx, I use the AutoSleep and use the sleep button for when I really want to go to sleep. Anyways I think I will be waiting for your final tests to buy a new app as this one is clearly not good. Thank you for your work!

@michaelbluecastlestudio665 3 жыл бұрын

Very interesting comparison. I experienced the same without going this deep into the apps. In my opinion SleepCycle is more accurate. It shows what i feel in the morning. Thanks for the Video.

@kimlord7369 2 жыл бұрын

Hi Rob- Thank you for this video. I have been using the auto sleep app for over a year now, and have been pretty happy with it, although I do think that it's somewhat complicated to read and understand. My husband has been having sleep issues so we bought him an Apple watch and he started using the Auto Sleep app. His results have been horrible! Last night, for example we both went to bed at the exact same time. In the morning, his results showed his sleep beginning 3-1/2 hours AFTER we both went to sleep. It didn't show AWAKE, it just started measuring his sleep cycle 3-1/2 hours after he was actually sleeping. We emailed the app developers and hope to hear from them. I think based on your review, we will also try out the Sleep Cycle app. Hopefully it will be easier to use and understand. Thanks!

@SpiderslidePics 3 жыл бұрын

Bedankt!

@Omidan 3 жыл бұрын

Really interesting video! Thank you for sharing the results. I'm curious how you calibrated the app?

@MichaelToub Жыл бұрын

Great Video!

@rodrigorios3271 3 жыл бұрын

Thanks for the video. May I ask you what calibration settings you have used?

@elvisthepelvis99 3 жыл бұрын

Excellent analysis, before watching your videos, my thoughts were that the app was too generous with deep sleep and no so good when detecting awake stages. In general, i think mi band 5 is better for tracking sleep than this app. I’ll try sleepcycle. Thanks a lot for this kind of videos.

@marek4698 3 жыл бұрын

Great video as usual Rob! Testing out the Whoop band at the moment, I saw earlier you also got yourself one. How do you like it so far?

@julieta203 Жыл бұрын

In iOS 16 and Watch OS 9, Apple has released additional sleep stage metrics. The good news is that you have the choice to elect which sleep data you wish to use in AutoSleep

@InsightCreationz 3 жыл бұрын

Great job! Adding a request Garmin. Tons of us that do sports or fitness rely on our Garmin and it’s body battery.

@KurtUhlir 3 жыл бұрын

Great review. Would love to see your analysis of Sleep++ app as well.

@ann-kathrinschretter7921 3 жыл бұрын

Hey - thank you so much for the in-depth information - when will the video with the fourth app come?

@christine7851 2 жыл бұрын

Thanks, i find the autosleep app detects sleep when i am awake. Please re analyze after using the calibration feature to “adjust” what you believe actually occurred to see if the correlation is much improved.

@samuelneubourg8584 11 ай бұрын

Hey I love your videos and think they're the best out there to actually check on devices, apps and so on and see how good they actually are! Would you also like to do a video about the rise sleep app? Best from Tübingen!

@kenrussell5937 3 жыл бұрын

Hey Rob, One view and I am now your biggest fan. Deep sleep is so important in maintaining BDNF and HGH in the aging population. The nightly feedback and tweaking variations in the daily feeding-drinking metrics (with AutoSleep deep sleep metrics) gives this 71 year old geezer the ability to successfully incorporate lifestyle changes to routinize average deep sleep outcomes greater than 3 hours.

@kenrussell5937 3 жыл бұрын

I once had a an afternoon caffeine overdosing accident. That night I experienced an AutoSleep verified tortuous night in bed with no sleep recorded. LOL

@vikasgupta1828 2 жыл бұрын

Thanks

@MrLuigi-oi7gm 9 ай бұрын

This was an interesting video. Thanks for the data driven analysis. It would be interesting to see if AutoSleep's performance has improved since this review with software and hardware updates. BTW, I never use the Auto sleep detection feature of AutoSleep. I find it very easy to just tap the "Lights Off" start sleep button. And that removes all the issues associated with the feature. And yes, I understand it sounds crazy to not use the Auto sleep detection feature for an app called AutoSleep. 🤣🤣🤣

@anders_dahlberg 2 жыл бұрын

I have the same experience as you. Most annoying is that Autosleep is bad at detecting when I am awake during night. I do not use Autosleep any more.

@ERadicator49 2 жыл бұрын

Subscribed! Thx you, I didn't waste my money 🧐

@HughTomlinson 3 жыл бұрын

Thanks for an intriguing overview Rob. I have just switched from a Fitbit Blaze to Apple Watch 6& I’m already missing the sleep tracking. I have been trialling the AutoSleep app but remain very unimpressed. It recently scored me the best sleep ever for a night that, at best, I dozed for an hour. I also find the charts confusing & hard to get any meaningful data from.

@helenalovelock1030 2 жыл бұрын

It’s really confusing. I don’t think it’s a good app. Just too many settings and the calibration adjustments etc changes everything.

@DavidMartinez-kc9nz 2 жыл бұрын

This video was beautifully crafted my god. I’m commenting even though I never do to help you with the algorithm

@jessejones1102 3 жыл бұрын

Thank you!

@TheQuantifiedScientist 3 жыл бұрын

Welcome!

@joslatbarcelona Жыл бұрын

Thanks for sharing, really awesome and in-depth review! Question: for sleep & fitness coaching - which I currently use the Whoop 4.0 for, would you recommend switching to Apple Watch? if so what apps would you recommend for this? Thanks!!

@Arhey 3 жыл бұрын

Love your videos! Finally some tests which are completely objective and also are supported by data! Can't wait to see more videos from you :) Seems like apple watch is pretty bad for sleep tracking somehow.

@smilebot484 3 жыл бұрын

He was testing autosleep not the apple watch per se.

@dunar1005 Жыл бұрын

I use this app for about 5 years. I can export you the data via Advanced date range csv exports if you want. Did you do the calibrations the app provides? They are have huge impact on how the data is interpreted. Early false sleep tracking is one of them. You can also link the app to apple home, so it knows when you turned of the lights for sleep, and the watch app can be used to manually start sleep tracking when you are about to sleep

@riyadh.albehairi2916 3 жыл бұрын

Thank you for sharing this video Rob a compared between auto sleep app and our ring app you are correct always the deep sleep on auto sleep coming with more time than our so I will sleep cycle starting from this week to compare with oura

@CrueLoaf 2 жыл бұрын

Apple are putting a similar app directly on the watch in the new update. 👍🏻 I like AutoSleep but it took a while to customise so it gave me a truer reading.

@Ariegi854 3 жыл бұрын

I just got 99-100% in all ratings in Autosleep. My blood pressure was better than usual, I feel that it was one of the best night sleeps I measured, so I think that Autosleep is very accurate. I had few nights ago the 3 hours of awake time while trying to sleep, so the app could be fooled by my hand in one position etc. but it wasnt, it shows 3 hours in a row of awake. For me, works great.

@minyalilukumay6611 3 жыл бұрын

Really I have learnt nice

@Tiamo1519 3 жыл бұрын

Thanks rob! I used the app over a year. Actually the app is more or lese useless in my opinion, because it displays none of the stages even a bit correct. It is only Good in detecting the amount of sleep.. keep going!!

@Jampper 3 жыл бұрын

Thx for this. Thought about buying it but i’ll pass. Waiting on reviews of other sleep apps :)

@FirstSkyWalker Жыл бұрын

The part that is missing, is the version of the app. Can you add this next time, for future comparisons (updates). Thanks in advance.

@lolo2lolo491 7 ай бұрын

its been 2 years since you did the app review... could you do a new review based on the latest version and technology from apple watch 9 series and iphone 15 to see how this app preform today ?

@AbdullahAbdulrahman7 3 жыл бұрын

Thank you so much! Waiting for Huauei Watch fit sleep tracking review

@TheQuantifiedScientist 3 жыл бұрын

Coming soon Abdullah!

@AbdullahAbdulrahman7 3 жыл бұрын

@@TheQuantifiedScientist Many many thanks dear!

@DZSlasher 3 жыл бұрын

Thank you for the great work. Really interesting as a regular AutoSleep user. I would love to see a similar analysis of the whoop band.

@TheQuantifiedScientist 3 жыл бұрын

Thanks! There is already a first look at Whoop if you are interested: kzfaq.info/get/bejne/g52AZM6nmMvbdHU.html

@DZSlasher 3 жыл бұрын

@@TheQuantifiedScientist I will definitely check it out! Thank you.

@aniccadance13 2 жыл бұрын

Great review, subscribed! Yes, the cycles are not accurate, I don't have deep sleep for 8h as the app shows..

@AAAAAA-fj3dh 3 жыл бұрын

Dear Rob, I value your data and opinion and follow your channel so thank you. I am wondering what's your opinion about the cheaper solutions like xiaomi or honor or some other cheap solutions specifically for sleep tracking (IMHO the Honor Band 6 is currently the #1 choice). Also the Honor Watch ES or equivalent for a more accurate next step sleep tracking over the cheaper solutions. Again thank you for the videos.

@ZUTF1025 Жыл бұрын

Really appreciate your videos! Can you compare the tracking accuracy between AutoSleep and the watchOS 9 built in Sleep app?

@daniel_lisbona 3 жыл бұрын

Who is this friendly guy?.... must subscribe

@julbears1675 3 жыл бұрын

I've been using Auto Sleep tracker for just a week. I find it captures the times I wake up during the night well - but that may be because I'm also getting out of bed to head to the bathroom. I do find that it gives me credit for light sleep when I know I'm awake but resting in a still state (when I'm first in bed). I think DEEP SLEEP tracking is over-rated. I don't understand the "Readiness" dial which is almost always low even when I've had a great night's sleep. Can you explain that? My heart rate averages around 56 bpm which is about right. Last night it said my HRV was 9 below baseline at 23 ms (??) while my Waking was 2 below baseline at 51 bpm. I have no clue what this means or what to do to improve this. Any thoughts there?

@jeffadams5413 3 жыл бұрын

This is a very good video with a lot of information, maybe too much. I am a 65 year old male and although I have a good understanding on modern electronic devices I find it difficult to understand and decide on which is a good sleep app. I want to track my sleep and try to make changes in my life to improve my sleep. Not sure I need the amount of information being provided in the Auto Sleep app. Help Please

@vladimir7651 3 жыл бұрын

Hi Rob, Yet another great video, thanks a lot. Your scientific approach is quite appreciated. I use AutoSleep for several month and as people say here, calibration is quite an issue. In the beginning the app was not accruate at all, but after some short period and calibration exercices it detects correctly the time I fall asleep and morning waking up time. Awake peaks are properly detected only if there is a lot of movments or walking. Indeed, sometimes it detects sleep when I just stay in the sofa, ~30% of those cases are true naps. Waiting for your next videos on other apps. Maybe it will make me change ? Thanks again for your great videos!

@lyubomirhristov418 2 жыл бұрын

Hi mate how can I calibrate mine app because is count less sleep or too much awake.

@tedportnay4086 3 жыл бұрын

Would love to see a comparison of sleep and HRV tracking of data from Apple Watch vs Whoop vs Oura. Thanks

@TheQuantifiedScientist 3 жыл бұрын

Thanks for the suggestion Ted!

@mariezurie7828 5 ай бұрын

The AutoSleep (AS) app has a "lights out function" to decrease awake vs asleep errors. Like watching this video before going to sleep😅. The problem with AS was more of a negative psychological impact. If I felt like I slept great-like the old "bright eyed" etc., but AutoSleep app says my readiness score is terrible-it has a negative impact on me. Also, AS doesn't understand that people naturally will change position while sleeping. AS marks ANY movement as restless. (We won't even discuss how AS treats you when you ask or question a result.)

@tristanjones1845 3 жыл бұрын

You should do a review with the “S+ by ResMed” with your EEG thing. It does rem sleep all the sleep patterns I think.

@ytt4401 3 жыл бұрын

Asking ourselves why people are using these apps might help to provide better analysis. Is it to feel well when we wake up, to know when we should go to bed to have enough cycles or other. Smart alarms need a reliability on light sleep ; cycle detection need to be accurate. I don’t see any reasons why we would want these apps if they are that unreliable. Great review, keep to progress 😉

@ferologics 2 ай бұрын

will you do another review of this?

@Realworlddummy 3 жыл бұрын

Hey Rob, can you make a video about a scientific approach to sleep paralysis??

@zingodongo 3 жыл бұрын

hey rob could you do more about mi bands? i think its very potential

@RockTheCage55 Жыл бұрын

I wonder if this has got any better with series 7 or 8. I know apple did a lot of work on their sleeping app. Is autosleep worth the money over the default app now?

@fog1014 Жыл бұрын

Do you think the accuracy would have changed with the watch OS 9 including more data?

@zakmorgan9320 3 жыл бұрын

Love how little fluff you have in your video, straight to the point and good timestamps.

@electrotech7767 3 жыл бұрын

Can you review and test honor band 6 please?

@MrJPVERCETTI 6 ай бұрын

Hello! Very informative video! I was wondering if this app can record naps during the day. I'm currently using the default Apple Watch sleep app however this doesnt register naps during the day. I want an app that can record naps.

@jamesjacobi9044 3 жыл бұрын

Interesting. Thanks. I found auto sleep to be very inaccurate for me. I came over from Fitbit to Apple Watch and the one thing I missed was the sleep tracking which I thought was quite good on Fitbit. I ran Fitbit (versa 2) auto sleep and pillow together for 3 nights (then was fed up with wearing 2 devices - so this is just based on that) and found pillow and Fitbit matched quite closely and they both “seemed” reasonably accurate eg matched memories of waking, matched time to go sleep quite well (I know roughly how long I was reading before sleep). So I settled on pillow. I still don’t like it as much as Fitbit but It seems reasonably accurate to me. Looking forward to your assessment.

@gcama 10 ай бұрын

Hi. Great Video, Do you have now the review of Pilow App?

@reamsel 2 жыл бұрын

I use AutoSleep to see How long I sleep for and how my heartrate is. This video is over a year old, but for me now I think the app is really accurate.

@garluis23 3 жыл бұрын

Thank you so much Rob, excellent as always!! I was wondering if maybe you could keep a rank of the top sleep trackers in your opinion, that would be just incredible, I would love that and I'm sure a lot of people too. Thanks again Rob, take care

@TheQuantifiedScientist 3 жыл бұрын

Thanks Garluis! I was planning on making such a video once I've tested a few more trackers :-D . Cheers!

@paskoh 3 жыл бұрын

@@TheQuantifiedScientist looking forward to that Rob. One other sleep tracker that would be also interesting to compare is the sleeptracker (by fullpower tech). It was designed by the inventor of the first camera phone and a ledge in Silicon Valley- Phillippe Kahn. I’ve found it more accurate than the Nokia sleep. It uses more big data and AI and claims much higher accuracy

@PamPawz 3 жыл бұрын

@@TheQuantifiedScientist Any update yet?

@eustachozord89 2 жыл бұрын

@@TheQuantifiedScientist update ?

@MushroomKidable 2 жыл бұрын

@@TheQuantifiedScientist update?

@atis1 3 жыл бұрын

Great! You have to test sleep as android! It's the best sleep monitor app! Can use with polar h10

@Sator810 3 жыл бұрын

I have used it for a while. What I find useful is the histogram over how much sleep i got, when I got to bed, and average HR during sleep. I also tried the smart alarm, but found it consistently disturbed me during REM sleep, so I have stopped using that function.

@TheQuantifiedScientist 3 жыл бұрын

Thanks for sharing Kai! Seems to match my findings

@brawlstargamer1427 3 жыл бұрын

I think that Fitbit has updated this issue, I beg you to make a video about if it is so. Then I can buy it .

@drsus0 3 жыл бұрын

Supper curious how auto sleep “readiness” score compares to things like garmin “body battery” or a whoop band for helping you asses your body’s readiness for training . Ive yet to find they one device that can encompass all the best of each into one. Apple Watch with a good score for readiness would tick that final box and i wouldnt need my garmin anymore.