Idiopathic rapid-eye-movement (REM) sleep behavior disorder (iRBD) is most likely the earliest sign of Parkinson's Disease (PD) and is characterized by REM sleep without atonia (RSWA) and consequently increased muscle activity. However, some muscle twitching in normal subjects occurs during REM sleep. There are no generally accepted methods for evaluation of this activity and a normal range has not been established. Consequently, there is a need for objective criteria. In this study we propose a full-automatic method for detection of RSWA. REM sleep identification was based on the electroencephalography and electrooculography channels, while the abnormal high muscle activity was detected from the electromyography channels, in this case the submentalis combined with left and right anterior tibialis. RSWA was identified by considering it an outlier problem, in which the number of outliers during REM sleep was used as a quantitative measure of muscle activity. The proposed method was able to automatically separate all iRBD test subjects from healthy elderly controls and subjects with periodic limb movement disorder. The proposed work is considered a potential automatic method for early detection of PD.