Abstract

The real option management of commodity conversion assets gives rise to intractable Markov decision processes (MDPs), in part because of the use of high-dimensional models of commodity forward curve evolution, as commonly done in practice. Focusing on commodity storage, we identify a deficiency of approximate linear programming (ALP), which we address by developing a novel approach to derive relaxations of approximate linear programs. We apply our approach to obtain a class of tractable ALP relaxations, also subsuming an existing method. We provide theoretical support for the use of these ALP relaxations rather than their associated approximate linear programs. Applied to existing natural gas storage instances, our ALP relaxations significantly outperform their corresponding approximate linear programs. Our best ALP relaxation is both near optimal and competitive with, albeit slower than, state-of-the-art methods for computing heuristic policies and lower bounds on the value of commodity storage, but is more directly applicable for dual (upper) bound estimation than these methods. Our approach is potentially relevant for the approximate solution of MDPs that arise in the real option management of other commodity conversion assets, as well as the valuation of real and financial options that depend on forward curve dynamics. This paper was accepted by Dimitris Bertsimas, optimization.

Highlights

  • Real options are models of projects that exhibit managerial flexibility (Dixit and Pindyck 1994, Trigeorgis 1996)

  • We show that Storage ADP (SADP) is a relaxation of a math program that is equivalent to an Approximate Linear Program (ALP; Schweitzer and Seidmann 1985, de Farias and Van Roy 2003) obtained from their Markov decision processes (MDPs)

  • For a fast storage asset, the greedy lower bounds and dual upper bounds estimated using the ADP1 and ADP2 optimal value functions are likely to be close to the Exact Dynamic Program (EDP) optimal value function in the initial stage and state when the frictions are small, which is the case for the crude oil instances that we consider in §8.4

Read more

Summary

Introduction

Real options are models of projects that exhibit managerial flexibility (Dixit and Pindyck 1994, Trigeorgis 1996). Applied to natural gas instances, their model computes near optimal policies, provided it is sequentially reoptimized, and fairly tight dual upper bounds (Glasserman 2004, Chapter 8, and Brown et al 2010) This Storage ADP (SADP) features a peculiar conditional expectation that makes it solvable. Our focus is on commodity storage, our proposed methodology has potential relevance for the approximate solution of intractable MDPs that arise in the real option management of other commodity conversion assets, as well as the valuation and management of real and financial options (see the discussion in Secomandi et al 2011, §1 for examples) that depend on forward curve dynamics; that is, MDPs whose state includes both endogenous and exogenous information.

Literature Review
Commodity Storage MDP
Bounding Approach
Discretized Commodity Storage MDP
Analysis of SADP
The PSR Methodology
Main Idea
A Single Price PSR and Its Equivalent ADP
A Two Price PSR and Its Equivalent ADP
PSR Generalizations
Computational Complexity
Computational Results
Instances
State Space Discretization
Results on the Natural Gas Instances
Results on the Crude Oil Instances
Conclusions
A Another PSR-based ADP
B Crude Oil Forward Curves and Calibration Results
C Detailed Computational Results
Results for the Natural Gas Instances
Results for the Crude Oil Instances

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.