Arsenic is a bladder carcinogen though less is known regarding the specific temporal relationship between exposure and bladder cancer diagnosis. In this study, we modeled time-varying mixtures of arsenic exposures at many historic temporal windows to evaluate their association with bladder cancer risk in the New England Bladder Cancer Study. We used arsenic exposure estimates up to 60 years prior to study entry and compared the goodness of fit of models using these mixtures to those using summary measures of arsenic exposures. We used the Bayesian index low rank kriging multiple membership model (LRK-MMM) to estimate the associations of these mixtures with bladder cancer and estimate cumulative spatial risk for bladder cancer using participants' residential histories. We found consistent evidence that modeling arsenic exposures as a time-varying mixture provided better fit to the data than using a single arsenic exposure summary measure. We estimated several positive though not significant associations of the time-varying arsenic mixtures with bladder cancer having odds ratios (ORs) of 1.03-1.14 and identified many significant and positive associations for an interaction among those who consumed water from a private dug well (ORs 1.28-1.60). Arsenic exposures 40-50 years before study entry received elevated importance weights in these mixtures. Additionally, we found two small areas of elevated cumulative spatial risk for bladder cancer in southern New Hampshire and in south central Maine. These results emphasize the importance of considering time-varying mixtures of exposures for diseases with long latencies such as bladder cancer.