Hand physiological tremor of surgeons can cause vibration at the surgical instrument tip, which may make it difficult for the surgeon to perform fine manipulations of tissue, needles, and sutures. A zero phase adaptive fuzzy Kalman filter (ZPAFKF) is proposed to suppress hand tremor and vibration of a robotic surgical system. The involuntary motion can be reduced by adding a compensating signal that has the same magnitude and frequency but opposite phase with the tremor signal. Simulations and experiments using different filters were performed. Results show that the proposed filter can avoid the loss of useful motion information and time delay, and better suppress minor and varying tremor. The ZPAFKF can provide less error, preferred accuracy, better tremor estimation, and more desirable compensation performance, to suppress hand tremor and decrease vibration at the surgical instrument tip. Copyright © 2016 John Wiley & Sons, Ltd.