Globally, the growing volume of waste tires and plastics has posed significant concerns about their sustainable and economical disposal. Pyrolysis provides a way for effective treatment and management of these wastes, enabling recovery of energy and produces solid pyrolytic char as a by-product. The use of pyrolytic chars in asphalt binder modification has recently gained significant interest among researchers. As asphalt binder aging influences the cracking, rutting, and moisture damage performance of asphalt binder and the mixtures, evaluation of aging characteristics of char modified asphalt binders is quite important. The main objective of this study is the investigation of the aging characteristics of asphalt binders modified with waste tire pyrolytic char (TPC) and waste plastic pyrolytic char (PPC) through rheological and spectroscopic evaluations. To imitate short-term and long-term aging conditions, the asphalt binders were first treated in a rolling thin film oven (RTFO) and then in a pressure aging vessel (PAV). The aging characteristics were determined using four rheological aging indices based on complex modulus (G*), phase angle (δ), zero shear viscosity (ZSV), and non-recoverable creep compliance (Jnr) from multiple stress creep and recovery (MSCR) test. The fatigue cracking potential was then measured through binder yield energy test (BYET). These parameters were measured through a dynamic shear rheometer. Fourier transform infrared (FTIR) and proton nuclear magnetic resonance (1H-NMR) spectroscopy analyses were then used to investigate changes in chemical composition due to aging in the char modified binders. Both TPC and PPC improved the high-temperature deformation resistance properties of asphalt binder. The TPC-modified binder showed better aging resistance than the control and PPC-modified binders, based on the different rheological and spectroscopic indices. The pyrolytic char modified binders also demonstrated good fatigue performance.