Although the Industry 4.0 vision proposes a seamless integration of several modern concepts and technologies, such as the Internet of Things (IoT), artificial intelligence, or robotics, the human is still indispensable in different manufacturing activities. One area where humans are still in the center and where the ideas of Industry 4.0 have hardly been implemented is the construction industry, in particular the area of construction machinery. Progressive digitization could here (i) avoid dangerous and health-endangering situations, (ii) make work more attractive, make it easier or (partially) automate it, and (iii) create additional business areas. To meet these challenges, new concepts for human-machine interaction systems must be developed that bring the digital construction site closer and make work safer and more efficient.As a first step in this direction, this paper presents an approach for the remote control of an excavator. Besides the actual control, the focus is on which user interface components are needed for efficient and safe control. For this purpose, we present the results of a user study conducted within the framework of the Human Centered Design approach. Based on these initial findings, possible next steps and visions will be discussed to get closer to the vision of the digital construction site.