Natural aggregates are gradually experiencing resource shortages and price accumulations with the rapid development rate of the highway construction industry. Therefore, new materials with social and economic benefits must be identified to replace natural aggregates. Limestone was selected as the representative of natural aggregates, and waste glass and waste ceramics were chosen as the representatives of solid waste in this article. This was undertaken to compare their physical and mechanical properties and the adhesion performance between bitumen and aggregates and to investigate the applicability of solid waste in asphalt pavement. The chemical and mineral compositions of these materials were tested by an X-ray fluorescence spectrometer and an X-ray powder diffractometer. The adhesion performance between bitumen and aggregates was analyzed by establishing adhesion and spalling models based on surface energy theory. Results show that the sizes of glass and ceramics must be small, characteristics which are unsuitable for use in high-grade roads. Glass and ceramics are more adhesive to bitumen than limestone and are suitable for areas with a considerable amount of rainfall and insufficient drainage systems. This article can promote the recycling of glass and ceramics and also provide a research idea for verifying the suitability of other solid waste in asphalt pavement.