Bright-field light microscopy and related phase-sensitive techniques play an important role in life sciences because they provide facile and label-free insights into biological specimens. However, lack of three-dimensional imaging and low sensitivity to nanoscopic features hamper their application in many high-end quantitative studies. Here, we demonstrate that interferometric scattering (iSCAT) microscopy operated in the confocal mode provides unique label-free solutions for live-cell studies. We reveal the nanometric topography of the nuclear envelope, quantify the dynamics of the endoplasmic reticulum, detect single microtubules, and map nanoscopic diffusion of clathrin-coated pits undergoing endocytosis. Furthermore, we introduce the combination of confocal and wide-field iSCAT modalities for simultaneous imaging of cellular structures and high-speed tracking of nanoscopic entities such as single SARS-CoV-2 virions. We benchmark our findings against simultaneously acquired fluorescence images. Confocal iSCAT can be readily implemented as an additional contrast mechanism in existing laser scanning microscopes. The method is ideally suited for live studies on primary cells that face labeling challenges and for very long measurements beyond photobleaching times.