The way in which humans deal with physical objects has been formed by extensive interaction and, according to the theory of embodied cognition, has led to conceptualization and interpretation that is grounded in physical interaction of the body with elements in the environment. Digital objects are immaterial and cannot show similar external properties as physical objects, and further, they are representational in nature. Specific problems related to their immaterial nature are those of permanence, location, and ownership. In this paper the differences between material and immaterial objects are analyzed with respect to human interaction. Three issues are highlighted: the lack of transparency of digital document handling, security of digital information and accessibility of digital information. It is concluded that the importance of the distinction between direct physical objects and immaterial objects has been vastly underestimated, at the cost of usability, trust and security.