Virtual technologies such as haptic devices and virtual try-ons have been developed to bring more certainty to the non-touch shopping experience; however, they are still no substitute for the in-person experience. In order to resolve the current limitations of haptic technology, it is necessary to carry out fundamental research on the ways in which humans perceive and discern different tactile properties. This study investigated how vision and physical touch affect the evaluation of the tactile properties of knitwear and discovered factors that affect tactile evaluation in a non-touch environment. The result of this study proved that humans can perceive tactile properties similarly when they are able to physically touch the fabric, whether their vision is obstructed or not. However, participants were unable to accurately perceive the tactile properties of knitwear when they evaluated fabrics using only visual materials, especially stretchiness and flexibility. It is confirmed that a surface haptic experience could increase the accuracy of stretchiness and flexibility evaluations, but it did not help in the evaluations of fabric thickness and heaviness. Findings from interviews suggested that the shape, width and number of folds, density, and thickness of the yarn are all major factors that influence the tactile perception of knitwear when participants could only evaluate properties through on-screen visual materials. Findings from this study contributes to the improvement of the consumer experience in the contact-free shopping environment and can be used as a fundamental guide to human perception of clothing, which can support technologies such as haptic devices.