Black hole evaporation is studied using wave packets for the modes. These allow for approximate frequency and time resolution. The leading order late time behavior gives the well known Hawking radiation that is independent of how the black hole formed. The focus here is on the higher order terms and the rate at which they damp at late times. Some of these terms carry information about how the black hole formed. A general argument is given which shows that the damping is significantly slower (power law) than what might be naively expected from a stationary phase approximation (exponential). This result is verified by numerical calculations in the cases of 2D and 4D black holes that form from the collapse of a null shell.