Abstract Virtual try-on technology (VTO) in virtual reality (VR) and augmented reality (AR) has been developed for years to create novel shopping experiences for users by allowing them to virtually wear fashion products. Compared to garments or facial accessories, fewer studies have focused on virtual footwear try-on, regardless of user study or technical development. Thus, it is necessary to examine the effectiveness of existing VTO applications on the user's affective responses. In this study, we compared the user experience of three different footwear try-on methods (real, VR, and AR) with both physiological and psychological measures. Subjects conducted a try-on experiment on different pairs of sneakers. Each subject’s gaze trajectory was recorded using an eye tracker and analyzed to show his/her visual attention in each method. Afterward, the subjects completed questionnaires to assess the sense of presence, usability, and the user experience score for the try-on processes, and subsequently attended a think-aloud procedure to express their thoughts. The analysis results of the collected data showed that the user experience produced by the VR and AR try-on is not comparable to that of the real environment. The results also revealed factors that negatively affect the quality of the user's interaction with the processes. These findings may provide insights into further improvements in VTO technology.