Near-field acoustic levitation (NFAL) is a method that levitates an object or group of particles using the ultrasonic force. It is observed that, when a circular piston type of source is employed, stability problems can occur which makes the object position unpredictable. For example, a thin, circular planar object wobbles to lateral direction like a pendulum when its center is not precisely coincident with the center of source. In this study, the motive force, which makes the levitated object swivel through the center of source, is investigated by varying the sizes of the object and the source. To this end, a visualization of the sound field in the micro gap between the levitated object and source is made by using a photo view of the motion of fine powder scattered inside. The result is compared with the calculation result by BEM. A further investigation is experimentally made on any relation between the temperature distribution on the surface of the levitated object and the acoustic force. The experimental visualizations and numerical modeling results suggest that one may have a model describing the instability of the levitated object in NFAL, if a proper simplified mathematical model is set up in the further study.