Abandoned and stolen object detection is a challenging task due to occlusion, changes in lighting, large perspective distortion, and the similarity in appearance of different people. This paper presents real-time detection methods of abandoned and stolen objects in a complex video. The adaptive background modeling method is applied to stable tracking and the ghost image removing. To detect abandoned and stolen objects, the methods determine spatio-temporal relationship between moving people and suspicious drops. The space first detection method measures the distance between a moving object and a non-moving object in spatial change analysis. The time first detection method conducts temporal change analysis and then spatial change analysis. The potential abandoned object is classified as a definite abandoned or stolen object by two-level detection approach. The time-to-live timer is applied by adjusting several key parameters on each camera and environment. In experiments, we show the experimental results to evaluate our proposed methods using benchmark datasets.