title: |
Fuzzy Mutual Information Based min-Redundancy and Max-Relevance Heterogeneous Feature Selection |
|
publication: |
||
| volume-issue: | 4 - 4 | |
| pages: | 619 - 633 | |
ISSN: |
1875-6883 | |
DOI: |
doi:10.2991/ijcis.2011.4.4.18 (how to use a DOI) | |
author(s): |
Daren Yu, Shuang An, Qinghua Hu |
|
publication date: |
June 2011 |
|
keywords: |
Feature selection; fuzzy mutual information; redundancy; relevance; stability |
|
abstract: |
Feature selection is an important preprocessing step in pattern classification and machine learning, and mutual information is widely used to measure relevance between features and decision. However, it is difficult to directly calculate relevance between continuous or fuzzy features using mutual information. In this paper we introduce the fuzzy information entropy and fuzzy mutual information for computing relevance between numerical or fuzzy features and decision. The relationship between fuzzy information entropy and differential entropy is also discussed. Moreover, we combine fuzzy mutual information with "min-Redundancy-Max-Relevance", "Max-Dependency" and min-Redundancy-Max-Dependency" algorithms. The performance and stability of the proposed algorithms are tested on benchmark data sets. Experimental results show the proposed algorithms are effective and stable. |
|
copyright: |
©
Atlantis Press. This article is distributed under the
terms of the Creative Commons Attribution License, which permits
non-commercial use, distribution and reproduction in any medium,
provided the original work is properly cited. |
|
full text: |