Sequential Decision Diagrams Research Articles

A new method for tackling asymmetric decision problems

Chain Event Graphs are probabilistic graphical models designed especially for the analysis of discrete statistical problems which do not admit a natural product space structure. We show here how they can be used for decision analysis through designation of some nodes as decision nodes, and the addition of utilities. We provide a local propagation algorithm for finding an optimal decision strategy and maximising expected utility. We also compare CEGs with Influence diagrams, Valuation Networks, Sequential decision diagrams, Sequential influence diagrams and Decision circuits for the representation and analysis of asymmetric decision problems.

Sequential valuation networks for asymmetric decision problems

This paper deals with representation and solution of asymmetric decision problems. We describe a new representation called sequential valuation networks that is a hybrid of Covaliu and Oliver’s sequential decision diagrams and Shenoy’s valuation networks. The solution algorithm is based on the idea of decomposing a large asymmetric problem into smaller sub-problems and then using the fusion algorithm of valuation networks to solve the sub-problems. Sequential valuation networks inherit many of the strengths of sequential decision diagrams and valuation networks while overcoming many of their shortcomings. We illustrate our technique by representing and solving a modified version of Covaliu and Oliver’s [Manage. Sci. 41(12) (1995) 1860] Reactor problem in complete detail.

A Comparison of Graphical Techniques for Asymmetric Decision Problems

We compare four graphical techniques for representation and solution of asymmetric decision problems—decision trees, influence diagrams, valuation networks, and sequential decision diagrams. We solve a modified version of Covaliu and Oliver's Reactor problem using each of the four techniques. For each technique, we highlight the strengths, weaknesses, and some open issues that perhaps can be resolved with further research.

Representation and Solution of Decision Problems Using Sequential Decision Diagrams

In this paper we introduce a new graph, the sequential decision diagram, to aid in modeling formulation, and solution of sequential decision problems under uncertainty. While as compact as an influence diagram, the sequential diagram captures the asymmetric and sequential aspects of decision problems as effectively as decision trees. We show that a unified framework consisting of a sequential diagram, an influence diagram, and a common formulation table for the problem’s data, suffices for compact and consistent representation, economical formulation, and efficient solution of (asymmetric) decision problems. In addition to asymmetry, the framework exploits other sources of computational efficiency, such as conditional independence and value function decomposition, making it also useful in evaluating dynamic-programming problems. The formulation table and recursive algorithm can be readily implemented in computers for solving large-scale problems. Examples are provided to illustrate the methodology in both asymmetric and symmetric cases.