This article examines how visual representations may mediate the teaching and learning of mathematics over time in Japanese elementary classrooms. Using the Zone of Proximal Development Mathematical Learning Model (Murata & Fuson, 2006; Fuson & Murata, 2007), the process of mediation is explicated. The tape diagram, a central visual representation used in Japanese mathematics curriculum, is explored for its roles and the student learning that is intended to be mediated over time, illuminating aspects of the process. The study argues that the consistent and coherent use of one representation can bridge student understanding over time, focusing on mathematical relationships and problem-solving processes. The study also suggests different instructional approaches between U.S. and Japanese curricula that are reflected in the uses of representations.