Representation Learning for Sparse, High Dimensional Multi-label Classification

RYAN KIROS; AXEL J. SOTO; EVANGELOS MILIOS; VLADO KESELJ

Chengdu

Conferencia; 8th International Conference on Rough Sets and Current Trends in Computing 2012; 2012

Springer

n this article we describe the approach we applied for the JRS 2012 Data Mining Competition. The task of the competition was the multi-labelled classification of biomedical documents. Our method is motivated by recent work in the machine learning and computer vision communities that highlights the usefulness of feature learning for classification tasks. Our approach uses orthogonal matching persuit to learn a dictionary from PCA-transformed features. Binary relevance with logistic regression is applied to the encoded representations, leading to a fifth place performance in the competition. In order to show the suitability of our approach outside the competition task we also report a state-of-the-art classification performance on the multi-label ASRS dataset.