Abstract

This paper presents a review about the usage of eigenvalues restrictions for constrained parameter estimation in mixtures of elliptical distributions according to the likelihood approach. The restrictions serve a twofold purpose: to avoid convergence to degenerate solutions and to reduce the onset of non interesting (spurious) local maximizers, related to complex likelihood surfaces. The paper shows how the constraints may play a key role in the theory of Euclidean data clustering. The aim here is to provide a reasoned survey of the constraints and their applications, considering the contributions of many authors and spanning the literature of the last 30 years.

Highlights

  • Finite mixture distributions play a central role in statistical modelling, as they combine much of the flexibility of non parametric models with nice analytical properties of parametric models, see e.g. Titterington et al (1985), Lindsay (1995), McLachlan and Peel (2000)

  • The last part of the paper is devoted to the role of eigenvalues in parsimonious models: Gaussian parsimonious clustering models are summarized in Section 5 while in Section 6 mixture of factor analyzers are presented

  • The EM algorithm is usually implemented for parameter estimation in mixture modeling, see e.g. McLachlan and Krishnan (2008b)

Read more

Summary

Introduction

Finite mixture distributions play a central role in statistical modelling, as they combine much of the flexibility of non parametric models with nice analytical properties of parametric models, see e.g. Titterington et al (1985), Lindsay (1995), McLachlan and Peel (2000). For parameter estimation in mixture models several approaches may be considered, as the ones exposed in McLachlan and Krishnan (2008a). The maximum likelihood (ML) framework is among the most commonly used approaches to mixture parameter estimation, and it is the approach we consider here. This paper presents a review about the usage of eigenvalues restrictions for constrained estimation, that serves a twofold purpose: to avoid convergence to degenerate solutions and to reduce the onset of non interesting (spurious) maximizers, related to complex likelihood surfaces. The last part of the paper is devoted to the role of eigenvalues in parsimonious models: Gaussian parsimonious clustering models are summarized in Section 5 while in Section 6 mixture of factor analyzers are presented.

Maximum likelihood estimation of parameters in mixture models
Constrained formulations of maximum-likelihood estimation
Hathaway’s approach
Constraints on the determinants of the covariance matrices
Constraints on the eigenvalues of the covariance matrices
Equivariant constraints based on eigenvalues of the covariance matrices
On the degeneracy in the maximum likelihood estimation
Gaussian parsimonious clustering models
Mixtures of factor analyzers
Concluding remarks
Full Text
Paper version not known

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.