Automated Assessment of Quantitative REM Sleep without Atonia for Diagnosis of REM Sleep Behavior Disorder
Article information
Abstract
Objective
This study was performed to determine the diagnostic cutoff value of quantified tonic and phasic rapid eye movement (REM) sleep without atonia (RSWA) automatically calculated from chin and limb muscle electromyograms (EMG) for diagnosis of REM sleep behavior disorder (RBD).
Methods
Nocturnal video polysomnographic data of 57 patients diagnosed with RBD and 29 age- and sex-matched controls were reviewed. Tonic activity was measured using submentalis EMG, and phasic activity was measured using submentalis and bilateral anterior tibialis EMG. The proportion of epochs with tonic and phasic activity during the entire REM sleep period was quantified using a self-developed automated algorithm.
Results
The RBD group showed significantly more tonic activity compared with the control group (28.87±36.92% vs. 12.94±31.69%, respectively, p<0.001). The diagnostic cutoff value of quantified submentalis tonic RSWA for RBD showing the best optimal sensitivity and specificity was 0.99% [sensitivity, 77.2%; specificity, 79.3%, area under the receiver operating characteristic curve (AUC), 0.76]. Cutoffs of phasic RSWA were 47.53% when assessed in the submentalis only (sensitivity, 1.8%; specificity, 100%; AUC, 0.46), 0.10% in the anterior tibialis (sensitivity, 66.7%; specificity, 55.2%; AUC, 0.55), and 0.10% in both the submentalis and anterior tibialis (sensitivity, 70.2%; specificity, 51.7%; AUC, 0.53).
Conclusion
This study provided evidence for the diagnosis of RBD using an automated method by assessing RSWA. Tonic activity in the submentalis muscle showed better sensitivity and specificity for diagnosis of RBD than did phasic activity.
INTRODUCTION
Rapid eye movement (REM) sleep behavior disorder (RBD) is a disorder characterized by the loss of muscle atonia that normally appears during REM sleep and the resulting body movements. RBD is associated with alpha-synucleinopathies, such as Parkinson’s disease, Lewy body dementia, and multiple systemic atrophy [1], and recent studies have shown that the degree of REM sleep without atonia (RSWA) predicts alpha-synucleionpathies [2,3]. Therefore, early detection of RBD is becoming increasingly important.
According to the American Academy of Sleep Medicine (AASM) diagnostic criteria, a diagnosis of RBD requires repeated behaviors during REM sleep, and tonic activity in the chin or phasic activity in the chin or limbs during polysomnography (PSG) must be observed [4]. However, as cutoff values for evaluating the presence or absence of tonic activity or phasic activity were not specified, the clinician’s judgment is important for diagnosis. Fully automated methods to quantify RSWA and accurately diagnose RBD would greatly reduce the time and cost required for early diagnosis and treatment of the condition.
A number of studies have attempted to quantify RSWA in PSG to diagnose RBD. In 1992, Lapierre and Montplaisir [5] quantified RSWA by manual scoring in sleep PSG. In 2008, Ferri et al. [6] calculated the REM atonia index using an automated method. Most subsequent studies regarding the diagnosis of RBD have used automated algorithms following Ferri’s method. However, unlike visual scoring, the REM atonia index algorithm evaluates baseline electromyogram (EMG) activity without conforming to the typical tonic/phasic system and a 30-s epoch and 3-s mini epoch system used by AASM as diagnostic criteria, making it difficult to compare with human-rated diagnosis according to AASM. Jeppesen et al. [7] used a semi-automated algorithm to quantify and compare tonic and phasic activities, but their method requires manual removal of all of the epochs with artifacts prior to analysis to ensure high diagnostic accuracy [area under the receiver operating characteristic (ROC) curve (AUC)=0.940 (tonic), 0.975 (phasic), and 0.978 (any)]. There have been no previous studies of the accuracy of tonic or phasic RSWA calculated using a fully automated method for the diagnosis of RBD. According to recent reports, tonic and phasic RSWA have different clinical implications in RBD. It was suggested that phasic activity was related to the violent expressions of dream-enacting behaviors whereas tonic activity was more closely related to disease progression to synuceinopathies [3]. It is expected that different aspects of RBD could be analyzed by calculating and quantifying tonic and phasic respectively.
Moreover, most previous studies that used automated methods measured RSWA in RBD only in the chin muscles. Previous studies using visual scoring reported that the sensitivity and specificity for the chin muscles were significantly lower than those for the limb muscles in predicting phasic motor activity during sleep [8-10]. In those studies, the diagnostic accuracy of phasic activity increased significantly when limb muscles, especially the flexor digitorum superficialis and extensor digitorum brevis, were evaluated along with the chin muscles. Therefore, in the AASM guidelines, when evaluating phasic activity, clinicians are instructed to evaluate chin EMG as well as limb EMG. To establish a more accurate method for automated quantification of RSWA and diagnosis of RBD, it is necessary to compare the diagnostic accuracies of tonic and phasic RSWA measurements in the chin and limb according to the AASM diagnostic criteria.
In this study, we attempted to quantify tonic RSWA and phasic RSWA according to the AASM diagnostic criteria using an automated method, and to obtain the optimal RSWA value that accurately predicts RBD. Tonic RSWA was measured in the chin muscle only, and phasic RSWA was measured in both the chin and limb muscles. RSWA values derived using these methods were compared to determine which method predicts RBD most accurately.
METHODS
Participants
We retrospectively reviewed the medical records of patients >50 years old who underwent nocturnal video PSG (v-PSG) at the Sleep and Chronobiology Center of Seoul National University Hospital between January 1, 2016, and May 31, 2019. The exclusion criteria were 1) current or historical major psychiatric illnesses (schizophrenia, schizoaffective disorder, bipolar disorder, and major depressive disorder) or neurodegenerative diseases, including α-synucleinopathies; 2) current signs or symptoms of parkinsonism; 3) any current or previous serious medical illness, including ischemic heart disease, arrhythmia, or diabetes mellitus; 4) apnea–hypopnea index >15; and 5) periodic limb movement index >15.
Fifty-seven patients (36 males, 21 females) who underwent v-PSG during the study period were diagnosed with RBD at the sleep clinic of the psychiatric department according to clinical evaluation and v-PSG based on International Classification of Sleep Disorders-3 [11] and who did not meet the exclusion criteria were enrolled in the study. The control group consisted of participants who underwent v-PSG during the same period but who did not have a diagnosis or clinical suspicion of sleep disorders including RBD, obstructive sleep apnea (OSA), or restless leg syndrome (RLS) and who did not meet the exclusion criteria. We selected 29 ageand sex-matched healthy controls (18 males and 11 females) from among those who met the criteria for the healthy control group.
This retrospective study was approved by the Institutional Review Board of Seoul National University Hospital (approval no. H-1809-080-97). All procedures were performed in accordance with the ethical standards of the research committee and were implemented in accordance with the 1964 Declaration of Helsinki and subsequent amendments.
v-PSG
At the Center for Sleep and Chronobiology of Seoul National University Hospital, data from overnight v-PSG (Profusion3; Compumedics, Charlotte, NC, USA) consisting of electroencephalograms (electrodes at F3, F4, C3, C4, O1, and O2, using A1 and A2 as reference sites), bilateral electrooculograms, a single-lead electrocardiogram (lead II), submentalis and bilateral anterior tibialis EMG, airflow measurement via a nasal pressure transducer and oronasal thermal sensor, a respiratory inductance plethysmography band to monitor the movements of the chest and abdomen, and a finger pulse oximeter were analyzed. Polysomnographic data were scored by experienced technicians and physicians in accordance with the AASM recommendations [4]. The parameters apnea–hypopnea index, periodic limb movement index, time in bed, total sleep time, sleep efficiency, wake after sleep onset, sleep latency, REM latency, and percentage of sleep in each stage were calculated and recorded.
RSWA analysis
In principle, the scoring method in this study followed the standard of RBD scoring method based on AASM as possible in a fully automated way. First, EMG signals from the submentalis and bilateral anterior tibialis muscle were digitally band-pass filtered at 10–100 Hz to exclude artifacts. Then, RSWA was quantified as proposed by Lapierre and Montplaisir [5] by dividing the entire PSG into epochs and mini-epochs and calculating the rates of tonic epochs and phasic mini-epochs among all epochs and mini-epochs. Here, we defined epochs as 30 s and mini-epochs as 3 s based on the AASM scoring manual [4,10]. According to the AASM manual, tonic activity was measured using chin EMG, whereas phasic activity was measured using chin or limb EMG. In previous studies, phasic activity was measured 1) only in the mentalis or submentalis muscle [5,12], 2) in the bilateral anterior tibialis muscle and the mentalis or submentalis muscle [13], or 3) in other limb muscles, such as the flexor digitorum superficialis, biceps brachii, or extensor digitorum brevis muscles, in addition to the mentalis or submentalis and bilateral anterior tibialis muscles [9,10,14]. No submentalis or bilateral anterior tibialis EMG data were available for 12 of 57 participants with RBD and 24 of 28 control subjects in our study; therefore, we assessed only the submentalis and bilateral anterior tibialis to detect phasic activity.
In the present study, when an epoch of REM sleep had an EMG amplitude >10 µV in the submentalis EMG channel during at least 50% of the duration of the epoch, it was defined as an epoch with tonic activity. On the other hand, when determining phasic activity, a 30-s epoch of REM sleep was divided into 10 sequential 3-s mini-epochs. When at least five (50%) of the mini-epochs contained bursts of transient muscle activity with a burst duration >3 s and amplitude >10 µV in the submentalis or anterior tibialis EMG channel, the epoch was defined as having phasic activity. The cutoff amplitude of tonic and phasic activity was set to 10 µV (rather than 2× and 4× the stage R atonia activity, as defined by the AASM) because the background EMG activity of the samples could not always be determined easily [10]. The RSWA of tonic activity was defined as the rate of tonic epochs of all the epochs of REM sleep, and the RSWA of phasic activity was defined as the rate of phasic mini-epochs of all the mini-epochs of REM sleep.
Statistical analysis
To summarize the demographic, clinical, and polysomnographic variables, descriptive statistics were used. The Mann–Whitney U-test was used to compare continuous variables and Fisher’s exact test to compare categorical variables to assess the demographic, clinical, and polysomnographic differences between groups.
We used ROC curves to display the true positives and false positives, regarding the diagnosis in medical records according to International Classification of Sleep Disorders-3 as the gold standard. We measured the AUC, which indicates the accuracy of automatically calculated RSWA for diagnosis of RBD. The optimal cutoff value of RSWA that maximizes the sensitivity and specificity of the diagnosis was calculated using Youden’s index [15]. Statistical analyses were performed using the Statistical Package for the Social Sciences version 23.0 (IBM Corp., Armonk, NY, USA). In all analyses, p<0.05 was taken to indicate statistical significance.
RESULTS
Demographic and clinical characteristics
The demographic and polysomnographic characteristics of the RBD and control groups are shown in Table 1. There were no significant differences in sociodemographic or clinical characteristics between the two groups. As the RBD and control groups were matched for both age and sex, there were no statistically significant differences in age (67.11±6.56 years vs. 67.18±6.08 years, respectively, p=0.87) or sex [21 of 57 (36.8%) females vs. 11 of 29 (37.9%) females, p=0.92] between the two groups. There were also no significant differences between the two groups in terms of polysomnographic variables, including the percentage duration of each sleep stage, except for the percentage of stage N2, which was lower in the RBD group than the control group (52.02±12.48% vs. 56.57±7.79%, respectively, p=0.046).
Comparisons of phasic and tonic RSWA
Comparison of RSWA between the RBD and control groups indicated a statistically significant difference only in tonic RSWA (Table 2). Tonic RSWA was significantly higher in the RBD group than the control group (28.87±36.92% vs. 12.94±31.69%, respectively, p<0.001). Phasic RSWA was not significantly different between the two groups when measured in the submentalis only, the anterior tibialis only, or both muscles.
Construction of ROC curves and calculation of the AUC
ROC curves were constructed for tonic and phasic RSWA to determine the cutoff value with the highest sensitivity and specificity to distinguish RBD patients from controls (Figure 1). For tonic RSWA measured in the submentalis muscle, the optimal cutoff value was 0.99% (sensitivity, 77.2%; specificity, 79.3%; AUC, 0.76). Meanwhile, the optimal cutoff value of phasic RSWA was 47.53% when assessed in the submentalis muscle only (sensitivity, 1.8%; specificity, 100%; AUC, 0.46), 0.10% in the anterior tibialis muscle (sensitivity, 66.7%; specificity, 55.2%; AUC, 0.55), and 0.10% in both the submentalis and anterior tibialis muscles (sensitivity, 70.2%; specificity, 51.7%; AUC, 0.53) (Figure 1).
DISCUSSION
The present study was performed to assess the diagnostic accuracies of tonic and phasic RSWA calculated using a fully automated method, with the diagnosis by clinicians according to the conventional visual scoring method used as the gold standard. This is the first study to compare the accuracy of RWSA for detecting RBD by calculating both tonic and phasic RSWA using a fully automated method. It is also the first study to evaluate RSWA in chin muscles as well as limb muscles using a fully automated method in RBD. However, the diagnostic accuracy of RSWA evaluated using AUC values was lower in this study than in previous studies.
Unlike Jeppesen’s semi-automated method [7], our study used a fully automated algorithm, and manual screening and exclusion of artifacts were not performed before RSWA analysis. However, this method could not fully correct artifacts, including sleep-apnea related events and dream enactment behaviors. Artifacts may have remained in our study after filtering at 10–100 Hz, making it difficult to obtain a constant baseline stage R atonia EMG amplitude. We defined tonic and phasic RSWA as an EMG amplitude >10 μV instead of using the conventional criteria of 2× and 4× the amplitude of stage R atonia for tonic and phasic activities, respectively [4], which may have been responsible for the reduced specificity of the test.
In addition, in a significant number of controls, tonic or phasic RSWA was detected at a level capable of diagnosing RBD despite the absence of the disease, which led to a further decline in accuracy. In fact, RSWA in controls was observed in previous studies evaluating the diagnostic accuracy of tonic and phasic RSWA measured in the chin muscle [16,17]. Even in normal REM sleep, brief phasic activity may appear in the form of twitching [18], which may have contributed to a reduction in the diagnostic specificity of phasic RSWA in the present study. Moreover, in older subjects, even without a history or symptoms of RBD, the tendency of REM atonia to decrease with age as a result of degenerative processes was reported [19,20]. The age of the participants in the present study (67.11 years in the RBD group and 67.18 years in the control group) was the highest among studies reported to date quantifying RSWA using automated methods. It is possible that the diagnostic value of the test declined as RSWA in the control increased as a result of aging. In addition, as RSWA showed a relatively continuous distribution among the participants in both groups, it is possible that the control group included subjects who had not yet been diagnosed or shown manifestations of RBD. Moreover, the RBD cases in the present study consisted of idiopathic RBD without neurodegenerative diseases, such as Parkinson’s disease, and thus the symptoms were likely to be relatively mild, which may have led to even smaller differences in RSWA from the control group than in previous studies. Considering the risk of falls during sleep or future transition to alpha-synucleinopathies, the need for more active screening and diagnosis of RBD is suggested.
In this study, tonic RSWA showed higher diagnostic accuracy than did phasic RSWA. In previous studies using visual scoring in patients with Parkinson’s disease, tonic activity showed superior diagnostic accuracy compared with phasic activity [21]. In other studies, tonic rather than phasic RSWA was associated with more specific findings of RBD, such as higher neurodegeneration rates, and the authors suggested that degeneration of the sublaterodorsal nucleus, which is a characteristic of RBD transition to alphasynucleinopathy, may be correlated with tonic RSWA [22,23]. The reason for the difference in the diagnostic accuracy between tonic and phasic RSWA in our study is not clear, but considering that RBD is considered an early manifestation of alpha-synucleinopathy [24], tonic rather than phasic RSWA may be related more directly to the core clinical features of RBD. However, this interpretation must be evaluated carefully, as other studies showed no difference in diagnostic accuracy between tonic and phasic RSWA [7,17,25].
Tonic RSWA showed relatively good sensitivity and specificity for the diagnosis of RBD, but the cutoff value was lower than those in previous reports using the manual method (0.99–30%) [16,17,20,21] and similar to that in a previous study using a semiautomated method (2.2% for tonic) [7]. The automated method appeared to detect small changes in RSWA more sensitively than did the visual method, so the disease could be diagnosed even when using a lower cutoff. On the other hand, the sensitivity of phasic RSWA measured in the chin was only 1.8%, which is not acceptable as a sole diagnostic tool, but the diagnostic accuracy was improved by also evaluating phasic activity in the limb muscles. It is expected that phasic RSWA will show better accuracy in future studies using a combination of upper limb muscles that have been reported to show superior accuracy, such as the extensor digitorum brevis or flexor digitorum superficialis [8-10,21]. Moreover, AASM requires a duration of 0.1–5.0 s to diagnose phasic activity. In contrast, this study applied a stricter standard by requiring phasic RSWA to last for the entire mini-epoch (3 s), which would have further reduced the sensitivity of phasic RSWA.
Meanwhile, the diagnostic accuracy of the quantified RSWA in this study was even lower than that of previous studies using the fully automated method. This is thought to be because the previous studies minimized the effects of artifacts using the REM atonia index, which might be useful in that the effect of artifacts could be reduced without manual inspection, but could not calculate tonic and phasic activities separately. In our study, we calculated tonic and phasic activity respectively, which could extract quantified RSWA with higher clinical value but might have lead to the increase in the effect of artifacts and decrease in the diagnostic accuracy.
This study had some limitations. First, 57 patients with RBD was an insufficient number to establish a diagnostic method for the disease. However, it is still a relatively large sample size compared to previous studies that attempted to derive diagnostic cutoff through quantified scoring of RBD. This is the highest number except for the Ferri’s study in 2012, which analyzed 74 RBD patients [19]. Second, the possibility of selection bias cannot be excluded because all participants were tested at a single sleep clinic. Third, it is difficult to estimate the diagnostic value in young patients by limiting the target to participants over 50 years old. Finally, although we performed filtering to exclude artifacts, we did not perform manual inspection of artifacts, thereby reducing the diagnostic accuracy. Due to the limitations mentioned above, the diagnostic accuracy of the AUC curve presented in current study might have decreased. However, this study, which quantified RSWA through a fully automated method with a relatively large sample size, has clinical and exploratory significance in proposing an alternative automated method for scoring of RBD to the conventional manual scoring method.
In summary, we quantified tonic and phasic RSWA using fully automated techniques in RBD patients and normal controls, thereby evaluating RSWA accuracy for diagnosing RBD. Tonic RSWA showed greater diagnostic accuracy than that of phasic RSWA, which showed better accuracy when measured in limb than chin muscles. To improve the diagnostic accuracy, further prospective studies in more population of various age groups with effective filtering of artifacts are required.
Acknowledgements
None
Notes
The authors have no potential conflicts of interest to disclose.
Author Contributions
Conceptualization: Jeong Hun Yang, Yu Jin Lee. Data curation: Jeong Hun Yang, Sang Ho Choi, Mi Hyun Lee, Seong Min Oh. Formal analysis: Jeong Hun Yang, Sang Ho Choi. Investigation: Jeong Hun Yang, Jae-Won Choi. Methodology: Jeong Hun Yang, Kwang Suk Park. Project administration: Jeong Hun Yang, Jee Eun Park. Resources: Jeong Hun Yang, Yu Jin Lee. Software: Jeong Hun Yang, Sang Ho Choi. Supervision: Yu Jin Lee. Validation: Jeong Hun Yang, Mi Hyun Lee. Visualization: Jeong Hun Yang, Seong Min Oh. Writing—original draft: Jeong Hun Yang, Jae-Won Choi. Writing—review & editing: Jee Eun Park, Yu Jin Lee.