As an evaluation method for evaluating the habitability to building vibration, the ISO 2031 series of international standards defines the VDV for transient vibration, in which the vibration duration is considered by time integration. The evaluation method for non-stationary-like vibrations in the guidelines for the evaluation of habitability to building vibration of the Architectural Institute of Japan (AIJ) also specifies a method to consider the effect of vibration duration on the evaluation. In this paper, laboratory experiments using an electrodynamic shaker were conducted to investigate the relationship between the subjective response regarding occupant habitability and the horizontal vibration of buildings caused by external vibration sources such as road traffic and railways. Binomial logistic regression analysis was used to quantify the effects of acceleration magnitude and vibration duration on the exposure-response relationship. The comparison of models with different proportions of occurrence (cutoff values) of subjective responses showed different effects of acceleration magnitude and vibration duration.