In rotary machines vibration is an inherent phenomenon which has the tendency to affect required performance. Amongst the different parameters that affect vibration, selection of appropriate bearing is the most critical component. In this work the effect of different types of bearing on vibration in rotary machines is studied and the magnitude of vibration produced by use of different set of bearings under the same condition of loads and rotational speeds were investigated. Bearings considered in this work were ball bearing, tapered roller bearing, thrust bearing and shaft material considered is of mild steel. From experimental result, it was noted that tapered roller bearing gives the highest amplitude of vibration among all the three bearings whereas the ball bearing gives least amplitude under similar operating conditions.