Abstract

This paper deals with the problem of integrating the most suitable feature selection methods for a given problem in order to achieve the best feature order. A new, adaptive and hybrid feature selection approach is proposed, which combines and utilizes multiple individual methods in order to achieve a more generalized solution. Various state-of-the-art feature selection methods are presented in detail with examples of their applications and an exhaustive evaluation is conducted to measure and compare the their performance with the proposed approach. Results prove that while the individual feature selection methods may perform with high variety on the test cases, the combined algorithm steadily provides noticeably better solution.

Highlights

  • Most real world modeling problems can be formulated as estimation of some numerical value or classifying a given number of samples

  • Adaptivity of the proposed algorithm is realized in such a way that at an individual step of the feature selection algorithm it iterates in the space of the variables but in the space of available features selection techniques, too

  • Known linear functions were used for test data generation and additional effects were given to this data by varying its distributions, noise and outlier levels for analyze their effects on the performance of the AHFS

Read more

Summary

Introduction

Most real world modeling problems can be formulated as estimation of some numerical value or classifying a given number of samples. These problems, more often than not, are very complex and can be defined by tens, hundreds and even thousands of variables. In order to achieve a more generalized solution It minimizes the shortcomings of each incorporated algorithms by choosing dynamically the most suitable one for a given assignment and dataset. In the paragraph the proposed method is evaluated through many benchmarking datasets according to modelling error and calculation time demends, and it is compared by the very recent, state-of-the-art feature selection methods.

Methods and applications of feature selection
Motivation and concept
Search strategy
Modeling method
Evaluation
Evaluation on artificial data sets with known effects
Evaluation on becnhmarking datasets
Comprehensive evaluation
Comparison with other state-of-the-art feature selection techniques
Conclusions

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.