Interferometric synthetic aperture radar (InSAR) processing techniques have been widely used to derive surface deformation or retrieve terrain elevation. Over the development of the past few decades, most research has mainly focused on its application, new techniques for improved accuracy, or the investigation of a particular error source and its correction method. Therefore, a thorough discussion about each error source and its influence on InSAR-derived products is rarely addressed. Additionally, InSAR is a challenging topic for beginners to learn due to the intricate mathematics and the necessary signal processing knowledge required to grasp the core concepts. This results in the fact that existing papers about InSAR are easy to understand for those with a technical background but difficult for those without. To cope with the two issues, this paper aims to provide an organized, comprehensive, and easily understandable review of the InSAR error budget. In order to assist readers of various backgrounds in comprehending the concepts, we describe the error sources in plain language, use the most fundamental math, offer clear examples, and exhibit numerical and visual comparisons. In this paper, InSAR-related errors are categorized as intrinsic height errors or location-induced errors. Intrinsic height errors are further divided into two subcategories (i.e., systematic and random error). These errors can result in an incorrect number of phase fringes and introduce unwanted phase noise into the output interferograms, respectively. Location-induced errors are the projection errors caused by the slant-ranging attribute of the SAR systems and include foreshortening, layover, and shadow effects. The main focus of this work is on systematic and random error, as well as their effects on InSAR-derived topographic and deformation products. Furthermore, because the effects of systematic and random errors are greatly dependent on radar wavelengths, different bands are utilized for comparison, including L-band, S-band, C-band, and X-band scenarios. As examples, we used the parameters of the upcoming NISAR operation to represent L-band and S-band, ERS-1 and Sentinel-1 to represent C-band, and TerraSAR-X to represent X-band. This paper seeks to bridge this knowledge gap by presenting an approachable exploration of InSAR error sources and their implications. This robust and accessible analysis of the InSAR error budget is especially pertinent as more SAR data products are made available (e.g., NISAR, ICEYE, Capella, Umbra, etc.) and the SAR user-base continues to expand. Finally, a commentary is offered to explore the error sources that were not included in this work, as well as to present our thoughts and conclusions.