We study asymptotic properties of the Generalized Langevin Equation (GLE) in the presence of a wide class of external potential wells with a power-law decay memory kernel. When the memory can be expressed as a sum of exponentials, a class of Markovian systems in infinite-dimensional spaces is used to represent the GLE. The solutions are shown to converge in probability in the small-mass limit and the white-noise limit to appropriate systems under minimal assumptions, of which no Lipschitz condition is required on the potentials. With further assumptions about space regularity and potentials, we obtain $L^1$ convergence in the white-noise limit.