Based on the daily return and volatility series of the Chinese yuan (RMB)/US dollar (USD) exchange rate and the Shanghai Stock Composite Index, the time-varying long memories of the Chinese currency and stock markets are investigated by comprehensively using the rescaled range (R/S), the modified R/S, and the detrended fluctuation analysis methods. According to the results drawn: (1) the efficiency of the Chinese currency market has not improved significantly, whereas the efficiency of the Chinese stock market has improved steadily, (2) volatility series presents longer memory than return series either in the Chinese currency or stock market and (3) the time-varying Hurst exponent of the Chinese currency market is sensitive to the reform that enhances the flexibility of the RMB exchange rate. Moreover, we find that short-term bidirectional Granger causal relationship exists, but no long-run equilibrium relationship between the time-varying Hurst exponents of the Chinese currency and stock markets was found based on the Granger causality and cointegration tests, respectively.