Abstract

Generalized Maximum Entropy (GME) approach is one of the alternative estimation methods for Regression Analysis. GME approach is superior to other classical approaches in terms of parameter estimation accuracy when some or none of the assumptions of classical approaches are violated. However, determining bounds of parameter support vectors is one of the open parts of this approach when researchers have no prior information about the parameters. If support vectors cannot be determined correctly, parameters estimations will not be obtained correctly. There are some theoretical studies about GME for different datasets in the literature, but there are fewer studies about how to determine parameter support vectors. To obtain robust parameter estimations in GME, we introduced a new iterative procedure for determining parameter support vectors bounds for multilevel dataset. In this study, the new iterative procedure was applied for multi-level random intercept model and the new procedure was tested both simulation study and the real life data. The Classical and the new procedures of GME estimations were compared to Generalized Least Square Estimations in terms of Root Mean Square Error (RMSE) statistics. As a result, the estimations of the new approach provided lower RMSE values than classical methods.

Highlights

  • Shannon was defined the term "Entropy" as a measure of uncertainty in communication theory in 1948 and the basic principle of Generalized Maximum Entropy (GME) is based on Jaynes' Maximum Entropy Principle (Shannon, 1948; Jaynes, 1957)

  • GME approach is superior to other classical approaches in terms of parameter estimation accuracy when some or none of the assumptions of classical approaches are violated

  • To obtain robust parameter estimations in GME, we introduced a new iterative procedure for determining parameter support vectors bounds for multilevel dataset

Read more

Summary

Introduction

Shannon was defined the term "Entropy" as a measure of uncertainty in communication theory in 1948 and the basic principle of Generalized Maximum Entropy (GME) is based on Jaynes' Maximum Entropy Principle (Shannon, 1948; Jaynes, 1957). Judge and Miller generalized this principle for regression framework (Golan, Judge, & Miller, 1996). In this approach, Golan et al maximized Shannon's entropy formula under model consistency constraints. The main topic of GME approach is determination of support vector boundaries when researchers have no prior information about the parameters. This approach has been receiving increasing attention in the statistics literature. 5. Five-point support vectors for parameters and the error term were used for GME estimator (Al-Nasser 2011). For determination of parameter support vector boundaries, two different alternatives were tested

Objectives
Methods
Conclusion
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call