In this paper, an intelligent interface system for a wheelchair robot with an arm is described. The human interface system is comprised of an interface device and a signal processing module. An original idea of the authors, the interface device, which is a combination of a joystick, a Position Sensitive Detector (PSD), and a CCD camera, can realize threedimensional measurement in addition to performing the basic functions of a joystick. A principle for measuring three-dimensional positions and a method of presenting information by means of a Graphical User Interface (GUI) to verify and understand the instructions are proposed. To demonstrate the effectiveness of the intelligent operating system, a basic experiment is done.