Multi label classification using a cascade of stacked autoencoder and extreme learning machines
Abstract This article introduces a cascade of neural networks for classification of multi label data. Two types of networks, namely, stacked autoencoder (SAE) and extreme learning machine (ELM) have been incorporated in the proposed system. ELM is a compact and efficient single label classifier which seems to lose its efficiency while dealing with multi label data. This happens due to the complex nature of the multi label data, which makes it difficult for the smaller networks to interpret it accurately. In our proposed work, we attempt to deal with few of the bottlenecks faced while handling multi label data. Thus, we aim to enhance the performance of a stand alone multi label extreme learning machine (MLELM) by collaborating it with other networks. There are three basic phases in the proposed method: feature encoding, soft classification and class score approximation. In the first step, an SAE network is employed to generate a discriminating and reduced input representation of the multi label data. This makes the data compact and more manageable for the successive stages. This data in turn is used by an MLELM in the next phase for the prediction of soft labels. In the final step, to improve the prediction capability of the previous network, a novel approach of approximating the class score is proposed using an additional MLELM. Comprehensive experimental evaluation of the proposed approach has been performed on seven datasets against eleven relevant algorithms, and overall it displays a promising performance.
Neurocomputing