This research is part of the “Ancient Xuzhou Houses in China: Cultural Memory, Symbol and Process Reconstruction in the Context of Rural Revitalization” project. Traditional houses contain a large amount of cultural value, literacy role, and historical memory. In order to sort out the transfer process more clearly between memory and people, this study set three research objectives. First, spatial memory transmission and literacy role needs to be studied and analyzed. Then, on this basis, we will further study the method of spatial memory transmission and literacy role. Finally, the appropriate medium for spatial memory transmission is analyzed. This study used descriptive analysis to summarize and discuss the results. The results show that spatial memory transmission and literacy is a process of maintaining and transmitting social and cultural values through the use and evolution of architecture and spatial design over time. Symbols in the memory space of residential buildings are containers for storing memories, just like a mobile hard drive that records relevant memory information. Residential buildings and people are like two devices that convey information and communicate through symbols. After comparison, in the dimension of cultural memory, symbols are more social and cultural and are more suitable as a medium for transmitting spatial memory and literacy role under cultural identity. This article explains the relationship between symbols and spatial memory, through spatial memory transmission to describe how common memories are shared and reproduced among collective members through cultural memory, literacy role and symbolic translation. It can transmit cultural and historical memories between different generations and acquires the importance of spatial positioning and environmental interaction in transmitting cultural memory.