In order to reduce the contribution of the building sector to global greenhouse gas emissions and climate change, it is important to improve the building performance through retrofits from the perspective of carbon emission reductions. Data-driven methods are now widely used in building retrofit research. To better apply data-driven techniques in low-carbon building retrofits, a better understanding is needed of the connections and interactions in optimization objectives and parameters, as well as optimization methods and tools. This paper provides a bibliometric analysis of selected 45 studies, summarizes current research hotspots in the field, discusses gaps to be filled, and proposes potential directions for future work. The results show that (1) the building-performance optimization (BPO) process established through physical simulation methods combines the site, retrofit variables, and carbon-related objectives, and the generated datasets are either directly processed using multi-objective optimization (MOO) algorithms or trained as a surrogate model and iteratively optimized using MOO methods. When a sufficient amount of data is available, data-driven methods can be used to develop mathematical models and use MOO methods for performance optimization from the perspective of building carbon emission reductions. (2) The benefits of retrofits are maximized by holistically taking environmental, economic, and social factors into account; from the perspectives of carbon emissions, costs, thermal comfort, and more, widely adopted strategies include improving the thermal performance of building envelopes, regulating HVAC systems, and utilizing renewable energy. (3) The optimization process based on data-driven methods, such as optimization algorithms and machine learning, apply mathematical models and methods for automatic iterative calculations and screen out the optimal solutions with computer assistance with high efficiency while ensuring accuracy. (4) Only 2.2% and 6.7% of the literature focus on the impacts of human behavior and climate change on building retrofits, respectively. In the future, it is necessary to give further consideration to user behaviors and long-term climate change in the retrofit process, in addition to improving the accuracy of optimization models and exploring the generalization and migration capabilities of surrogate models.