Abstract

A matheuristic approach based on a reduced two-stage Stochastic Integer Linear Programming (SILP) model is presented. The proposed approach is suitable for obtaining a policy constructed dynamically on the go during the rollout algorithm. The rollout algorithm is part of the Approximate Dynamic Programming (ADP) lookahead solution approach for a Markov Decision Processes (MDP) framed Multi-Depot Dynamic Vehicle Routing Problem with Stochastic Road Capacity (MDDVRPSRC). First, a Deterministic Multi-Depot VRP with Road Capacity (D-MDVRPRC) is presented. Then an extension, MDVRPSRC-2S, is presented as an offline two-stage SILP model of the MDDVRPSRC. These models are validated using small simulated instances with CPLEX. Next, two reduced versions of the MDVRPSRC-2S model (MDVRPSRC-2S1 and MDVRPSRC-2S2) are derived. They have a specific task in routing: replenishment and delivering supplies. These reduced models are to be utilised interchangeably depending on the capacity of the vehicle, and repeatedly during the execution of rollout in reinforcement learning. As a result, it is shown that a base policy consisting of an exact optimal decision at each decision epoch can be obtained constructively through these reduced two-stage stochastic integer linear programming models. The results obtained from the resulting rollout policy with CPLEX execution during rollout are also presented to validate the reduced model and the matheuristic algorithm. This approach is proposed as a simple implementation when performing rollout for the lookahead approach in ADP.

Highlights

  • Realistic modelling goes a long way in supporting effective relief operation in disasters

  • The problem is formulated as an Mixed Integer Linear Programming (MILP) model, where the solutions are compared with exact computations through a lower bound computed by column generation

  • This paper addressed the problem of Multi-Depot Vehicle Routing Problem (VRP) with Stochastic Road Capacity during a post-disaster event for medical supplies’ delivery

Read more

Summary

Introduction

Realistic modelling goes a long way in supporting effective relief operation in disasters. In addition to the cost incurred by the operation, uncertainties in the road network had to be addressed and travel time was a concern Given all these observations, the Multi-Depot Vehicle Routing Problem with Stochastic Road Capacity is proposed. The means to enable the computation of a base policy via an ILP approach for a Multi-Depot Dynamic Vehicle Routing Problem with Stochastic Road Capacity (MDDVRPSRC) dynamically is proposed by performing ILP iteratively at every decision point. Without such an approach, computing a complete route from the current state would lead to a non viable route as the road capacity might change when the state is observed.

Literature Review
Time Delay and Damage Determination
14: Obtain list of intersection coordinates using sympify library Python
Random Road Capacity
Online MDP MDDVRPSRC Lookahead Approach
Reduced Two-Stage Stochastic Integer Linear Programming Model
Computational Results and Discussions
Conclusions
Full Text
Paper version not known

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.