Understanding radiation-induced non-cancer effects on the central nervous system (CNS) is essential for the risk assessment of medical (e.g., radiotherapy) and occupational (e.g., nuclear workers and astronauts) exposures. Herein, the adverse outcome pathway (AOP) approach was used to consolidate relevant studies in the area of cognitive decline for identification of research gaps, countermeasure development, and for eventual use in risk assessments. AOPs are an analytical construct describing critical events to an adverse outcome (AO) in a simplified form beginning with a molecular initiating event (MIE). An AOP was constructed utilizing mechanistic information to build empirical support for the key event relationships (KERs) between the MIE of deposition of energy to the AO of learning and memory impairment through multiple key events (KEs). The evidence for the AOP was acquired through a documented scoping review of the literature. In this AOP, the MIE is connected to the AO via six KEs: increased oxidative stress, increased deoxyribonucleic acid (DNA) strand breaks, altered stress response signaling, tissue resident cell activation, increased pro-inflammatory mediators, and abnormal neural remodeling that encompasses atypical structural and functional alterations of neural cells and surrounding environment. Deposition of energy directly leads to oxidative stress, increased DNA strand breaks, an increase of pro-inflammatory mediators and tissue resident cell activation. These KEs, which are themselves interconnected, can lead to abnormal neural remodeling impacting learning and memory processes. Identified knowledge gaps include improving quantitative understanding of the AOP across several KERs and additional testing of proposed modulating factors through experimental work. Broadly, it is envisioned that the outcome of these efforts could be extended to other cognitive disorders and complement ongoing work by international radiation governing bodies in their review of the system of radiological protection.