Detection of parking slots occupation is a crucial task for parking assistance, automatic parking, and autonomous driving systems. This paper proposed a novel method, called Temporal Difference of Inverse Perspective Mapping Difference (TD-IPM), without explicit 3D reconstruction or objection detection. In this method, temporal images from monocular camera are first inverse perspective mapped (IPM) onto the ground plane based on camera calibration results. Second, we proposed an algorithm, called Block Consensus based on Rotation Invariance Phase-Only Correlation (BC-RIPOC), for fast and robust motion estimation. From the estimated motion, we can align these two IPM images and generate IPM difference map. Third, the IPM difference map is segmented and filtered to generate a binary map that can distinguish objects on the ground plane or not for occupation detection. The obstacle is readily localized from the difference map as well. The proposed TD-IPM method has been validated in both underground and outdoor parking lots. Experimental results demonstrate that the proposed TD-IPM method can successfully detect various occupation objects, such as vehicles, cones, lockers, and others, with 97.9% average detection accuracy and speed of 17.5 frames per second (fps). The proposed method suggests an effective and low-cost solution to intelligent parking systems.