The classic Simon effect refers to the phenomenon that responses are faster when the task-irrelevant egocentric stimulus location is on the same side as the response hand than when not. However, the spatial location of an object often varies according to which reference frame the object location was represented in, e.g., egocentric versus allocentric reference frame. It has been unknown, however, whether and how the Simon effect based on the egocentric and the allocentric reference interact, and whether the potential interaction between them is affected by task demands. To investigate these questions, we orthogonally crossed the stimulus-response compatibility induced by the egocentric and the allocentric positions during the Simon effect. Moreover, the irrelevant egocentric and allocentric positions were either explicitly represented via interleaving spatial and non-spatial tasks in Experiment 1 or not in Experiment 2. The results suggested that the Simon effect based on the egocentric locations occurred irrespective of whether the egocentric representations were explicitly coded based on current task demands or not. The Simon effect based on allocentric locations, however, seemed to occur only when the allocentric representations were explicitly induced. Moreover, the egocentric and allocentric Simon effect interacted in a similar way irrespective of task demands, with significantly delayed responses when both the egocentric and the allocentric locations were incongruent with the response code.