This paper presents expressions for the multivariate normal-exponential and normal-gamma distributions. It then presents properties of these distributions. These include conditional distributions and a new extension to Stein's lemma. It is also shown that the multivariate normal-gamma and normal-exponential distribution are not in general closed under conditioning, although they are closed under linear transformations. The paper also demonstrates that there are relationships between the extended skew-normal distribution and the normal-gamma and normal-exponential distributions. Specifically, it is shown that certain limiting cases of the extended skew-normal distribution are normal-gamma and normal-exponential. One interpretation of these results is that the normal-exponential distribution may be considered to be an alternative model to the extended skew-normal in some situations. An alternative point of view, however, is that the normal-exponential distribution is redundant since it may be replicated by ...