Repozytorium publikacji - Politechnika Gdańska

In this paper, we describe five features selection techniques used for a text classification. An information gain, independent significance feature test, chi-squared test, odds ratio test, and frequency filtering have been compared according to the text benchmarks based on Wikipedia. For each method we present the results of classification quality obtained on the test datasets using K-NN based approach. A main advantage of evaluated approach is reducing the dimensionality of the vector space that allows to improve effectiveness of classification task. The information gain method, that obtained the best results, has been used for evaluation of features selection and classification scalability. We also provide the results indicating the feature selection is also useful for obtaining the commonsense features for describing natural-made categories.

Autorzy

• dr hab. inż. Jerzy Balicki link otwiera się w nowej karcie ,
• prof. dr hab. inż. Henryk Krawczyk link otwiera się w nowej karcie ,
• Łukasz Rymko link otwiera się w nowej karcie ,
• dr hab. inż. Julian Szymański link otwiera się w nowej karcie