AEkNN: An AutoEncoder kNN–Based Classifier With Built-in Dimensionality Reduction

DOI

10.2991/ijcis.2018.125905686How to use a DOI?

Keywords

kNN; Deep learning; Autoencoders; Dimensionality reduction; High dimensionality

Abstract

High dimensionality tends to be a challenge for most machine learning tasks, including classification. There are different classification methodologies, of which instance-based learning is one. One of the best known members of this family is the k-nearest neighbors (kNNs) algorithm. Its strategy relies on searching a set of nearest instances. In high-dimensional spaces, the distances between examples lose significance. Therefore, kNN, in the same way as many other classifiers, tends to worsen its performance as the number of input variables grows. In this study, AEkNN, a new kNN-based algorithm with built-in dimensionality reduction, is presented. Aiming to obtain a new representation of the data, having a lower dimensionality but with more informational features, AEkNN internally uses autoencoders. From this new vector of features the computed distances should be more significant, thus providing a way to choose better neighbors. An experimental evaluation of the new proposal is conducted, analyzing several configurations and comparing them against the original kNN algorithm and classical dimensionality reduction methods. The obtained conclusions demonstrate that AEkNN offers better results in predictive and runtime performance.

Copyright

© 2019 The Authors. Published by Atlantis Press SARL.

Open Access

This is an open access article distributed under the CC BY-NC 4.0 license (http://creativecommons.org/licenses/by-nc/4.0/).

Download article (PDF)
View full text (HTML)

TY  - JOUR
AU  - Francisco J. Pulgar
AU  - Francisco Charte
AU  - Antonio J. Rivera
AU  - María J. del Jesus
PY  - 2019
DA  - 2019/02/28
TI  - AEkNN: An AutoEncoder kNN-Based Classifier With Built-in Dimensionality Reduction
JO  - International Journal of Computational Intelligence Systems
SP  - 436
EP  - 452
VL  - 12
IS  - 1
SN  - 1875-6883
UR  - https://doi.org/10.2991/ijcis.2018.125905686
DO  - 10.2991/ijcis.2018.125905686
ID  - Pulgar2019
ER  -