Withings Sleep Analyzer: Science Test (2021 Review)

[@bskilla4892]

This channel deserves more subscribers. Keep making vids and we'll keep watching.

[@TheQuantifiedScientist]

Thanks, will do!😊

[@arnolfinilmf]

for sure!

[@tinokaartovuori]

I would like to see the scanwatch performing again after the new updates! Especially the HR and sleep detection accuracy! Thanks for your scientific reviews Rob!

[@trutela9210]

Man, just respect. The quality of your work is amazing. I love the way which you are presenting the data, it is very well laid out, laic-friendly. The most basic graphs, not taking attention from what matters. The way you speak is very friendly, inviting, and nice to listen to. I like the curiosity. I certainly agree with the common opinion what is that you deserve way much more subscribers. I am really happy that I found your channel. Keep up your great work, from your czech neigbour.

[@ChipAndCrinkle]

A Sunday afternoon is always made better by a new Quantified Scientist video; I've been looking forward to this one!

[@TheQuantifiedScientist]

Thanks so much!! Glad you enjoy it!

[@ViktorHristovvv]

Wow, wow, wow! That's what I call an in-depth scientific analysis! Brilliant video, super informative, I was really surprised to see that Fitbit devices did so well!

[@Liface]

I bought the Withings Sleep Analyzer based on this video a month ago and I'm extremely happy with it. So nice not having to put on something external to track my sleep and naps.

[@haroldbridges515]

Thank you, Mr. Quant. You are the only reviewer who makes a careful evaluation of the accuracy of these devices, which is the only worthwhile analysis. On the strength of your evaluation I did buy the Sleep Analyzer, which wasn't easy since Withings would not ship it directly to me, since it has not been approved as a medical device in the country where I live. I had to have it shipped to a friend in Germany who forwarded it on to me. Last night was my first night sleeping on top of the Withings. Like the sleep reports from the watches I have used, the Sleep Analyzer cannot distinguish between lying awake without moving and actual sleep. So they all overestimate the hours of sleep. Nevertheless, that's the state of the art at the present time.

[@gnampfff3469]

I love your channel. Reviews with real data and made with know-how and care should be the standard on KZbin, not just for health-tech products!

[@johnnyyoung8460]

Rob is a legend.

[@TheQuantifiedScientist]

Thanks Johnny!

[@stevenr5149]

My fitbit stopped giving my my data and customer service took 4 months to return my emails-so I got the Withings in the meantime. I have been blown away. I still am amazed by the accuracy(I test it with my polor H20 strap). I am skinny and have bounding peripheral pulses. I often felt like I had a very different night sleep from what the fitbit showed. The Withings is scary how spot-on it is. I can toggle to a month view and see my past sleep quality-with green, yellow, and red dots for basic quality of sleep. I just got 16 green dots last month! Often, getting to bed 25 minutes earlier can lock in a green dot. My goal to get green for an entire month. So it actually has helped me improve my sleep habits already.

[@KenTakahashiYT]

This channel is such a good reviewing channel. Every sleep tracker being reviewed. Keep going

[@florian3889]

In part, the scary grinning face got a little too close for my liking, but it was worth it! Well-documented mini-experiment, which allows insights into whether the manufacturer's promises are also kept. Many thanks for this!

[@guiwald]

When I stay in bed on the week end (I like to make a coffee, and go back to my bed while having it with a croissant), the Sleep Analyzer often think I am back to sleep. It usually detects that I am awake, but then will show me being back to sleep. Usually light sleep, sometimes REM. I am trying to track the moment I wake up manually the morning, but I don't always remember to do it. I always track during the night manually when I wake up (I use a simple timestamp app for that) and it seems that the Sleep Analyzer is pretty accurate for that. Thanks a lot for all these videos. You're my new favorite self-tracking stuff channel (the only one I know actually so far :p ). I own a oura Ring that unfortunately stop working, battery issue just after the end of the warranty. Huge battery issue, that started actually before the end of the warranty, but I took too long to contact the support. I won't replace it for a similar ring because of this problem. Finally, it's a pity that you don't have a blog :) Your videos are great, but sometimes I would like to know more details about the data, or the different hardware and processes you are using -- for instance what is the IR camera you are using, what tracking app you are using, more detail about the data extraction/API (I found OURA API very limited, not providing raw datapoints but already processed data, am I missing something?). Do you know any self-tracking forum/community? Thanks a lot for your work and for sharing it to everyone!

[@tyronedeshauer8284]

Thanks for another great video, I can't wait for the pillow app sleep test

[@TheQuantifiedScientist]

Thanks Tyrone!

[@AlexR-el2js]

This is the channel I've been waiting for!

[@adrienforbu5165]

Incredible work ! Frankly it's such an impressive work to do the comparaison between the different devices (and you have an actual estimation of the accuracy of each device for each sleep mode ...). As someone who have sleep apnea and don't know what to choose, it's stunning to see someone who have put such work to analyze every device.

[@benjaminfox7105]

Heya! First time I've come across your channel. What a pleasant surprise! Fantastic analysis from an evidence based perspective. I'm looking forward to watching more of your content. Take care and thanks again mate!

[@lucasj7577]

Thank you for this. This is very detailed and way more trusting than an average review.

[@dimitrioskyranas6455]

So from what l understand the main advantage of the fitbit is that the misclassification errors it makes are evenly spread across the categories of sleep - and it's also much better at detecting awake time.

[@TheQuantifiedScientist]

Hi Dimitrios! The Fitbit is slightly better overall I would say, but it is mostly better at light sleep and awake detection indeed. Have a great day!

[@dimitrioskyranas6455]

@@TheQuantifiedScientist Can we use your confusion matrices as a crude starting point to try to infer the 'real' amount of light/deep/rem sleep we get e.g over the course of an entire week using the Total Probability Theorem?

[@jeremybuckets]

@@dimitrioskyranas6455 not really. You don't really know 1. if those error rates are consistent over time and 2. if your sleep data skews the same way that Rob's does.

[@AlexSasikaran]

this channel is something special, good job man!

[@dimitrioskyranas6455]

I don't think I've ever asked for something on youtube and gotten it that fast :p. Echt leuk!

[@stevehoge]

Yeah, put in my plug for the latest Withings mat review last week and voila!

[@Esoxxie]

love it

[@TheQuantifiedScientist]

Thanks everyone!

[@travis5173]

Could you confirm that this test was completed after the most recent firmware update on the Withings Sleep Mat? Thanks!

[@den15423]

Best channel of wearables and smart health devices reviews!

[@ronderksen]

This was almost exactly what I was looking for. I’m very skeptical of these sleep tracking devices, but I’m interested in the Withings sleep analyzer because it can also be used as a switch device in home automation. Seeing actual scientific results compared to the Withings product and see that it does hold up to some extent is quite reassuring. Also, great presentation and production! Your presentation style reminds of Rodney Smith from “Watch it played” here on KZbin. Was he an inspiration by any chance?

[@andriyurenov7215]

Just bought this device after your video). Thank you so much mate, you make a great, exclusive job.

[@matthewschwarz4812]

Very interesting and thorough review. I appreciate it. Have you shared your findings with Withings? Wondering whether they agree and have indicated whether they are tweaking their firmware.

[@aileenmartinez9241]

😍 Daghang salamat (thanks heaps) for this in-depth review. I can only imagine the time and effort you've put into this. I was planning to buy one and saw this. Such a good one. Looking forward to more reviews from you. Again, salamat (thank you).

[@000GunterGabriel000]

Perfect! Exactly what i was looking for. Thx!

[@walt_artist]

Please make a follow up test, this is one of the rare devices for sleep tracking that doesn't require monthly subscription so there should be a lot of interest for buying one!

[@adrianazashen]

I'm here from your Garmin Vivomove Sport video. I didn't know this exist! How interesting and now considering getting one lol

[@lorodz]

Impressive. Thanks for keeping us educated. Love you! ❤

[@sjp8024]

Now that fitbit locked sleep information behind a premium subscription, I'm looking for alternatives. Thanks for the in-depth info!

[@nigelatkinson2939]

Thanks for the video; interesting to know how it determines the sleep states. My experience: - I have lots of light sleep. It tends to identify deep sleep only in the first two hours of sleep. I also tend to stay still if I wake during the night and it therefore doesn't notice - The apnea and snoring were both high when I started using the device, and have both reduced as I lost weight in 2020. - It can get confused if my wife goes to bed first. Our double bed has two separate mattresses and it seems fine provided she stays on her side. When we are both in bed it does notice when I get up, but can then decide I'm back in bed if she moves. Overall I'm happy with the results - especially confirmation that I now rarely snore. I don't do anything with the sleep data other than reflect on whether a high/ low sleep score reflects how I feel in the morning. There is a reasonable correlation between data and perception.

[@aowowow-no1xe]

Hey would love a follow up in case the algorithm has changed!!

[@timmydineen1]

Very Very Very Very Very good review

[@georgesabikhalil186]

Great job as usual, I really love your hard work with these reviews. I wish if you can also review the Samsung Galaxy Watch 3. And if you can also review the Withings BPM Core and the Withings Body Cardio (Wi-Fi Smart Scale with Body Composition & Heart Rate).

[@TheQuantifiedScientist]

Hi! I am testing the Samsung Fit2 first, I have to see about the others :-) . There is also some limitation with money, since buying so many wearables is not cheap ;-)

[@georgesabikhalil186]

@@TheQuantifiedScientist Oh sorry I thought that they are sending you some kind of review samples or something like that.

[@TheQuantifiedScientist]

@@georgesabikhalil186 Haha, no worries 😊. Hopefully I'll get to that stage at some point. For now I am just having fun with it (but still working hard😉)

[@whirlpoolvalley]

@@TheQuantifiedScientist One day your channel will grow so much that you'll never have to worry about spending money. Wish you all the best!

[@devrerffs]

Both samsung and fitbit have worked together with national sleep foundation I think. I've heard samsung is supposed to be on par with fitbit when it come to sleeptracking.

[@fbicking]

Thank you for the review. Wondering with this review being two years old how would you compare it to the current Apple Watch’s?

[@Martianmars1]

Very detailed analysis! Great job 👏

[@ricoasche7140]

U do exactly what i searched for Thank you man

[@TheQuantifiedScientist]

My pleasure!

[@daandebree250]

Great review, super informative, and good quality! Sub earned

[@TheQuantifiedScientist]

Dankjewel Daan!

[@georgesebastian6306]

Thanks. This was a great evaluation of the device. My personal disdain for fitbit makes this my device of choice. I wish they could get a certification for apnea in the US.

[@manologarcia8368]

Brilliant reviews, would be amazing a review of the Withings BPM core. Thank you for your videos.

[@ReviewsAndHowTos]

Great review! You totally nerded out! Loved it! 🤓 😍

[@svoidkugan]

Your work is amazing! So impressive!!

[@boostedhub]

Really good content man! I have watched pretty much all of your videos, and I want to hear your thoughts on which budget consumer level gadget would you say is the best for fitness tracking all in all(accurate HR, HRV and sleep) if comfort and ergonomics was not important.

[@christiankasermann7266]

Hi Rob - thx for the very informative tests. What would be very intersting (to me), would be a test of it's apnea detection capability, since this is a rather unique feature all (?most?) other devices don't provide. This would be the main reason for me to buy one, since I already am happy with the other sleep results provided from my apple watch.

[@sierraread1443]

Thank you for making this video! Super helpful!

[@user-ex4qr3ki5t]

Do you know if Withings is going to release a watch with better sleep tracking? I am stuck with the Withings ecosystem, because I don't like the digital watches from ftibit/apple etc.. However, Withings sleep tracking has never been great (as I learned from you), so it's good to see that they're improving. I might actually buy this sleep analyzer (and use your amazon affiliate link if I do). The quality of your videos is always amazing. I really appreciate the time and effort you put into making these videos.

[@TheQuantifiedScientist]

Thanks so much!

[@mfahlers]

607 positives to 1 negative review says it all. With these kind of numbers it is only a matter of time before you hit the big time. as long as you keep up the quality. The timestamps and amazon links to alternative products are great.

[@420_FORTNITE]

When are you releasing your SleepWatch science test? I'm looking forward to it!!

[@Legolad]

Thank you so much for this video. I have an 81-year-old aunt who recently started having difficulty sleeping. There is a LOT of bad information on the internet, but this video was VERY helpful. I plan to get the sleep analyzer for her because she always sleeps in the same bed and she does not want to wear a device. If you do not mind, is there any advice you can give me for how to find/select a sleep specialist for my aunt. We live in the US and I don't want to take her to someone who doesn't practice good science.

[@romaingirardlamamy]

Great video rob, Could you please test the accuracy of the snoring features and the sleep apnea features? Could you please also compare it to the oura ring, I am curious to know which one would be better? I own a withing sleep myself

[@TheQuantifiedScientist]

Hi Romain! I think the Oura ring is a bit worse for sleep tracking. From what I remember this was especially bad at REM stages, which made it difficult to track my sleep cycles. The Oura ring is good at other things, check out this video for a full overview: kzbin.info/www/bejne/f2PTnmaYr6ioeck

[@mrrishibhatia]

thank you for putting out some amazing content. Can you please test the biostrap as well from a sleep tracking perspective ?

[@SimonMarchand2015]

Love your work. Clear, to the point, perfect! I'm wondering if pairing the Sleep Analyzer with a Scanwatch, for example, would make a difference. Do both devices communicate and provide more accurate results when used in pair?

[@michaelpatara94]

Brilliant review! Thank you very much :)

[@Wolfennsteinn]

Somehow you look like Pewdiepie..... but hey awesome detailed review of the product . Also i love all of your detailed reviews for the past 2 years .

[@BetaBuxDelux]

Dude, you are a hero.

[@postbreak]

I have this unit, it actually does a great job with snoring detection too, spot on. With my cpap machine I can also verify the results. I don't look at the results and take them as 100% true, but just a very good estimate as to my sleep data.

[@Andy-mj5je]

What an awesome video. I just subscribed. Thanks!

[@strategiccompanysale]

Love what you do. Thank you.

[@gtxgtx1903]

Excellent🎉

[@saudqawam9835]

The only place to go if you actually want accurate sleep testing, your vids are so helpful. Have you heard of/have any thoughts on the new amazon halo fitness tracker?

[@TheQuantifiedScientist]

Hi! I wish I could test it, but as far as I know it is not available in Europe... Does your profile picture have anything to do with your interest in the Halo?😉

[@saudqawam9835]

@@TheQuantifiedScientist aw that's a shame, and yes that is what my profile is from good spot :D

[@Asi32]

Great work!

[@Anastasia-tl7te]

We want a video about the amazfit Gts 2

[@TheQuantifiedScientist]

Subscribe to my weekly Newsletter(!) on www.robterhorst.com, Instagram: instagram.com/quantified_scientist/ Twitter: @QuantifiedRob 👇Amazon Affiliate links, support the channel!👇 Withings Sleep Analyzer: geni.us/w9kUJ Fitbit Charge 4: geni.us/wjAfjU Fitbit Sense: geni.us/CSfYQE8 Fitbit Inspire 2: geni.us/iZHlb

[@ShadowSwitch777]

Great Video! Can you do one analyzing the sleep, steps heart rate of the galaxy watch?

[@irabel01]

Thanks for doing this.

[@tehyosh]

are you going to make a video about the PSG setup that you're doing with openBCI? i'm interested in building one as well

[@kim15742]

Wow, that's exactly what I have been looking for! I'm curious at what university are you are and what you studied before the PhD

[@kim15742]

Oh, it's MedUni + medicine, right?

[@fernandoalvarez2846]

Hello! Really enjoy all your videos! I purchased the Inspire 2 thanks to you!!! Just had a quick question in the fitbit dashboard settings for my device, I notice that my fitbit is toggled to have sleep sensitivity to normal, was wondering whether you had it on normal or did you select sensitive when performing the studies that you did for your of your inspire 2 video.

[@Lucas-ku2bw]

I just got this sleep analyzer, I wear both the Apple Watch and use this mat and the the sleep analyzer seems to detect up to 1h + of deep sleep !

[@dudebro777]

which one do you like more?

[@paralipomeni100]

Thanks for your video. Excellent channel! Just a question: as regards sleep tracking and heart rating accuracy, what's the best device between Fitbit Inspire 2 and Fitbit Charge 4? I saw your reviews and they both seem good, but I must choose one of them... Please, help me. Thanks!

[@ibhero8465]

It would be lovely if you could also read other whithings products!!

[@hikyungjin]

Thanks for the review - it was very helpful. Do you have a plan to review body cardio/ weight product accuracy as well? eg withings body cardio, omron, inbody, etc. Thanks!

[@joppedijk]

Thanks for your indepth videos. It would be nice if you could test the accuracy of the withings sleep analyzer in combination with the withings scanwatch. I wonder if that would improve the results.

[@brianjohnson758]

One question does it work with the scanwatch too combined? That would be interesting and thanks for the video damn nice

[@TheQuantifiedScientist]

Hi Brian! I don't think they combine this data. You can see the separate results in the app 😀. Have a great day!

[@brianjohnson758]

@@TheQuantifiedScientist alright thanks would be nice if they combined them keep up that great work love it

[@nurikmen000]

Hi Rob 🖐️. Good job. what earplugs do you use when you sleep? 13:44

[@TheQuantifiedScientist]

Thanks! I just use standard earplugs. Foam ones that you push together and they expand in your ear 😄

[@travis5173]

Could you confirm that this test was completed after the most recent firmware update on the Withings Sleep Mat? Thank again, Rob for all your work! Cheers

[@xylophoneglockenspiel6511]

Just noticed your channel looking at info on the Withings Sleep + Aura thanks an interesting video, this one too. I wonder if you've heard of EmFit QS as would be good to get your take on it and its HRV accuracy for example.

[@andrewhwang2910]

Do you have a sense of whether different types of mattresses would produce significantly different accuracy? For instance, it seems like a thick memory foam mattress might have less accuracy than a thin innerspring mattress. I noticed you asked Withings a similar question re: the Scanwatch--that is, how to get more accurate measurements. Curious if you guys spoke about this with regard to Withings Sleep Analyzer too? Thank you for your fantastic work Rob!

[@drees84]

great review. question: do the algorithms improve over time after a product like this is released? the video has been online for a while and the sleep analyser is still being sold. if it's better now, i'm happy to buy one otherwise maybe not.

[@imsergiohere]

Amazing Video! I don't like Withings one because leaks of biological's alarm optimization. Could you consider reviewing Sleepon Go2sleep? Seems very interesting, Special Edition has a silicon adapter for the finger.

[@alexands1]

My Withers Sleep analyzer reports that I barely get any deep sleep whereas my Garmin Fenix 7 reports a lot. Both the sleep analyzer and the Garmin Fenix 7 are midrange in their ranking (i.e. not bad) so I am not sure what sense to make of them being so far off from each other.

[@BogumiUcherek]

Really interesting and helpful!!

[@jphit6194]

When does the Sleep Analyser Withings system emit waves WiFi or Bluetooth. Does it during our sleep. What are the respective different functions of wifi and Bluetooth in the data transmission.

[@Hanna-yn5ou]

Hello and thanks for this video! Very impressed! How can I use this, to improve my sleep though? I haven't bought it yet, but I'm thinking about it.

[@lgnfve]

could you test the samsung Galaxy Fit 2. i have the Galaxy fit 2 and the fitbit inspire 2. have worn both for sleep tracking and I like the Galaxy Fit 2 better but would love your analysis. i usually sleep for a few hours, wake up for up to an hour, and then go back to sleep for the rest of the night. my inspire 2 does not get both sleep groups often while the samsung always gets them both. the samsung then gives information on the nights sleep with all my sleep groups put together. total sleep. thank you in advance

[@TheQuantifiedScientist]

Thanks! I am actually testing it as we speak 😊

[@MarkDiSciullo]

Does the phone need to be in the same room as the tracker? We want to track our child's sleep activity, but don't want to leave a phone in their room

[@jasonk8311]

Will you please examine the sleep tracker offered by sleepme? It's a similar pad design also measuring movement, HR, HRV, and BR. Thank you for the consideration.

[@neilcameron434]

Still the best sleep device today for me. I don't have to wear a ring or watch or charge it. And it doesn't cost thousands.

[@stevehoge]

Nice to have my experience with the 2020 Withings mat validated here. I was most interested in tracking long periods (>1 hr) of wakefulness in the middle of the night and the Withings was pretty much a #fail for that. Now I know that their algorithms may have missed my waking periods because I am consciously doing slow deep breathing exercises and remaining very still in an effort to fall back to sleep. Back to Amazon it goes!

[@TheQuantifiedScientist]

Thanks for the info Steve! Makes sense

[@GCZHardturm]

I wonder if HR and movement data from the likes of Pulse HR and ScanWatch are integrated with the Sleep Analyzer data to improve phase prediction.

[@mkleng]

Thanks, man.. What about the Apple WAtch?!

[@chusti1054]

Hello Rob. Would you chose withings analyzer against the emfit qs2? It looks the same... I sold my oura ring 2 and I'm looking for a substitute. The muse s looks interesting also

[@derecckkk]

Very good video 👍 thx

[@manuelmolina4271]

Is it still a good choice in 2024?

[@MXb7R]

Hi dr! Would you mind testing the spovan blade? They claim they got an sleep apnea specific function also ecg profesional chest sticker, it would be an interesting product to test

[@davidecerri]

I can confirm that the awake detection is bad. I had a period of bad sleep, and was often waking up in the middle of the night, getting up to take a glass of water and going back to bed but not managing to fall again asleep for sometimes one hour or more... and the Withings was just detecting as "awake" the brief time I was not in bed, and not the following hour (which was detected as light sleep). What I find quite strange is that it seems to be good at detecting the time when I fall asleep at the beginning of the night (if it takes long before I can fall asleep, I can see it), but it totally fails to detect it correctly after I get up shortly in the middle of the night.

[@TheQuantifiedScientist]

Hi Davide, good to hear that your experiences match mine 👍

[@alexanderwegner]

Danke. Ich werde mir wohl den Sleep Analyzer besorgen. Hast du bei Gelegenheit mal Lust den Sleep Phaser V2 von Sleep as Android oder nur die App zu testen?

[@TannerChung]

I noticed the scanwatch on the outro. Is that the 38 or 42mm? The rim makes it look like it's the 38. If so why did you choose the smaller version?

[@alotan2acs]

What infrared camera did you use? Resolution looks really good.