This paper presents some convergence properties of the inverse of the autocovariance matrix of a vector autoregressive moving average model. Under causality and invertibility conditions, the inverse has bounded on-diagonal blocks and exponentially declining off-diagonal blocks and some elements of the inverse converge to limiting values at exponential rates. These properties lead to similar convergence rates for filter weights and prediction error autocovariances in a latent-variable prediction problem. Uniform convergence rates and the convergence properties of some matrix derivatives are also discussed. These results are useful in developing some distributional properties of estimated autocovariance matrix inverses and estimated latent- variable filter weights.