Transportation infrastructure asset management modeling using Markov decision process under epistemic uncertainties

Abstract

Purpose Transportation infrastructure asset management has long been an active but challenging problem for agencies, which urges to maintain a good state of their assets but faces budgetary limitations. Managing a network of transportation infrastructure assets, especially when the number is large, is a multifaceted challenge. This paper aims to develop a life-cycle cost analysis (LCCA) based transportation infrastructure asset management analytical framework to study the impacts of a few key parameters/factors on deterioration and life-cycle cost. Using the bridge as an example infrastructure type, the framework incorporates an optimization model for optimizing maintenance, repair, rehabilitation (MR&R) and replacement decisions in a finite planning horizon. Design/methodology/approach The analytical framework is further developed through a series of model variations, scenario and sensitivity analysis, simulation processes and numerical experiments to show the impacts of various parameters/factors and draw managerial insights. One notable analysis is to explicitly model the epistemic uncertainties of infrastructure deterioration models, which have been overlooked in previous research. The proposed methodology can be adapted to different types of assets for solving general asset management and capital planning problems. Findings The experiments and case studies revealed several findings. First, the authors showed the importance of the deterioration model parameter (i.e. Markov transition probability). Inaccurate information of p will lead to suboptimal solutions and results in excessive total cost. Second, both agency cost and user cost of a single facility will have significant impacts on the system cost and correlation between them also influences the system cost. Third, the optimal budget can be found and the system cost is tolerant to budge variations within a certain range. Four, the model minimizes the total cost by optimizing the allocation of funds to bridges weighing the trade-off between user and agency costs. Originality/value On the path forward to develop the next generation of bridge management systems methodologies, the authors make an exploration of incorporating the epistemic uncertainties of the stochastic deterioration models into bridge MR&R capital planning and decision-making. The authors propose an optimization approach that does not only incorporate the inherent stochasticity of bridge deterioration but also considers the epistemic uncertainties and variances of the model parameters of Markovian transition probabilities due to data errors or modeling processes.