A step towards better sleep science: a large sleep-wake scoring benchmark
Published in Healthcare & Nursing
We spend a substantial part of our lives sleeping and among many different types of activities sleep is one of the keys for our overall mental and physical well-being, especially for those living with a chronic health condition. One of the challenges for humanity to tackle in the 21st century is the spread of diseases linked to our busy and stressful lifestyle.
Technology can be a human ally in this fight. Although nowadays, we have a plethora of gadgets to monitor sleep and physical activity, we are facing many technical challenges for the analysis of sleep data, including the harmonization on how sleep data can be analyzed. That is the main motivation behind our research.
It is well-studied (for example, in this paper) that short and poor sleep contributes to chronic diseases such as obesity, insulin resistance, and diabetes. Naturally, in order to reach such conclusions, researchers need to conduct studies monitoring and measuring people's sleep quality.
The most well-known method to study sleep is called polysomnography (PSG). Although PSG provides accurate and detailed information, a person that undergoes PSG has to sleep the whole night with a large number of wires and sensors attached to them as depicted below.
PSG provides, among other results, information whether a person is sleeping or awake in a given window of time (typically 15 or 30 seconds). This information is important to diagnose sleep disorders and to measure sleep quality. However, this can be obtained instead easily from wearables, such as smartwatches and actigraphy devices. Wearables are an attractive alternative to PSG because apart from being cheaper and unobtrusive, they allow doctors and researchers to study people's daily activity data for an extended period of time compared to studies made in sleep labs that only monitor one single night.
Wearables, however, need to be "calibrated" correctly, i.e., they need an algorithm to match the activity information captured by them to the sleep-wake states measured by PSG.
Many algorithms were developed in the past decades to determine whether a person is sleeping or not in a given time interval considering only the activity measured by the device. However, an existing challenge for actigraphy studies is comparing the performance of different algorithms due to the lack of standardized datasets. Our paper provides such standardized large dataset by exploring the data created in the MESA study. Such dataset aims to make the research in sleep science more accessible to researchers, as it fosters the creation and validation of new algorithms. The data from MESA can be downloaded, upon approval, at sleepdata.org Website, and after a preprocessing step with our code, researchers are can readily use and improve state-of-the-art algorithms for this task.
P.S. The publication of this article was funded by the Qatar National Library
Follow the Topic
-
npj Digital Medicine
An online open-access journal dedicated to publishing research in all aspects of digital medicine, including the clinical application and implementation of digital and mobile technologies, virtual healthcare, and novel applications of artificial intelligence and informatics.
Related Collections
With Collections, you can get published faster and increase your visibility.
Artificial Intelligence in Emergency and Critical Care Medicine
Publishing Model: Open Access
Deadline: Jan 10, 2026
Evaluating the Real-World Clinical Performance of AI
Publishing Model: Open Access
Deadline: Jun 03, 2026
Please sign in or register for FREE
If you are a registered user on Research Communities by Springer Nature, please sign in