The applications and researches of the aerogel in the field of building materials and building energy conservation had been widely concerned due to its excellent thermal insulation properties. However, it has not been paid attention that the potential application values for excellent CO2 adsorption properties of aerogel in building materials. The CO2 adsorption properties of aerogel and the research progress on utilizing SiO2 aerogel in building materials had been reviewed. And the application prospect of the technologies that exploit the CO2 adsorption properties of aerogel and the carbonization technology to prepare SiO2 aerogel-based low-carbon building materials was discussed. It was shown that the type, morphology, and pore structure of aerogel significantly affect the resulting carbon adsorption performance. Amino modification was an effective method for improving the carbon adsorption capacity of aerogel. The performance of aerogel-incorporated cement-based composites could be optimized by improving the performance of binder materials, modifying the aerogel, or preparing new aggregates by loading aerogel into porous materials with higher strength. In addition, it was feasible to prepare new green low-carbon building materials by using aerogel as thermal insulating aggregate and carbon adsorption material, industrial solid wastes rich in alkali metal ions as cementitious materials, and carbonation curing technology. The purpose of this review was to promote the application of CO2 adsorption properties of aerogel in building materials, and enhance the development of low-carbon (or zero-carbon, or negative-carbon) building materials. This is of great significance for reducing carbon emissions in the construction sector and promoting the "carbon neutrality" of global.