The stability analysis problem for unforced discrete-time systems with a time-varying state delay is considered. Stability criteria for nominal and uncertain system models are derived such that the upper and lower bounds on the delay time can be determined to ensure asymptotic stability. There is no need to assume that the system is stable when the delay vanishes. Adopting the linear matrix inequality approach enables the computations to be implemented conveniently. Compared with existing results in the literature, the proposed method is less conservative for many cases.