One of the critical environmental issues in the Chegeni area (Lorestan Province, western Iran) is the production of a large volume of limestone wastes during the quarrying operations. Releasing limestone wastes in the areas neighboring the quarries has caused visual damage to the environment, and adverse effects on the quality of the soil, running water, and groundwater used for agricultural and drinking water purposes. One solution to this issue can be recycling limestone wastes to produce building materials. In the present study, a comprehensive laboratory program is planned for the durability evaluation of the limestone wastes under harsh environments for their suitability as aggregate in concrete. For this purpose, five aging tests, including freeze-thawing (F-T), salt crystallization (SC), acid attack (AA), wetting-drying (WD), and heating-cooling (HC), were conducted on the limestone sample up to 60 cycles. After every 10 cycles, the physico-mechanical characteristics of the sample, including porosity (n), Brazilian tensile strength (BTS), point load index (PLI), and P-wave velocity (Vp) were determined. Moreover, the pores structure modification of the sample subjected to aging tests was examined through scanning electron microscopy (SEM). Data analyses revealed that the sample is highly vulnerable to the AA and SC processes but is durable against FT, WD, and HC actions. These results were in good agreement with the SEM data such that the sample exposed to AA and SC underwent more changes in their pore structure compared to FT, WD, and HC. Among the physico-mechanical characteristics, the Vp and PLI had the highest and the lowest accuracy, respectively, in the durability evaluation of the sample exposed to aging tests. Based on the data analysis, limestone wastes can be used as aggregate in concrete in environments with the possibility of FT, WD, and HC. However, this type of concrete is not suitable for conditions with occurrences of the AA and SC. Finally, in addition to reducing the environmentally harmful impacts of the study area, using limestone wastes as aggregate in the construction of concrete can also be a practical solution for sustainable development from an economic viewpoint. The results of the present study can be used for assessing limestone wastes produced in other areas of Iran and the world.