The next generation of manufacturing system calls for feasible solutions with high efficiency and flexibility. Thus in recent years, Human-Robot Collaboration (HRC) research attracts many attentions worldwide since it unites the repeatability and accuracy of robots and the adaptivity and intelligence of human operators. In this paper, the system architecture of an HRC solution is presented, together with the novel method of vision sensing and controlling towards a smart solution with high accuracy and fast speed. The proposed method is demonstrated through implementations in the real robot cell, and evaluated by quantifiable measurements. Future research outlooks are addressed at the end of the paper.