The present study focuses on designing a second-order novel explicit fast numerical scheme for the Cauchy problem incorporating memory associated with an evolutionary equation, where the integral term's kernel is a discrete difference operator. The Cauchy problem under consideration is related to a real finite-dimensional Hilbert space and includes a self-adjoint operator that is both positive and definite. We introduce a transformative technique for converting the Cauchy problem incorporating memory, into a local evolutionary system of equations by approximating the difference kernel using the sum of exponentials (SoE) approach. A second-order explicit scheme is then constructed to solve the local system. We thoroughly investigate the stability of this explicit scheme, and present the necessary conditions for the stability of the scheme. Moreover, we extended our investigation to encompass time-fractional diffusion-wave equations (TFDWEs) involving a fractional Caputo derivative with an order ranging between (1,2). Initially, we transform the main TFDWE model into a new model that incorporates the fractional Riemann-Liouville integral. Subsequently, we expand the applicability of our idea to develop an explicit fast numerical algorithm for approximating the model. The stability properties of this fast scheme for solving TFDWEs are assessed. Numerical simulations including a two-dimensional Cauchy problem as well as one-dimensional and two-dimensional TFDWE models are provided to validate the accuracy and experimental order of convergence of the schemes.