ارسل ملاحظاتك

ارسل ملاحظاتك لنا







Toward An Enhanced Arabic Text Classification Using Cosine Similarity And Latent Semantic Indexing

المصدر: مجلة جامعة الملك سعود - علوم الحاسب والمعلومات
الناشر: جامعة الملك سعود
المؤلف الرئيسي: Al-Anzi, Fawaz S. (Author)
مؤلفين آخرين: Abu Zeina, Dia (Co-Author)
المجلد/العدد: مج29, ع2
محكمة: نعم
الدولة: السعودية
التاريخ الميلادي: 2017
الصفحات: 189 - 195
DOI: 10.33948/0584-029-002-007
ISSN: 1319-1578
رقم MD: 974103
نوع المحتوى: بحوث ومقالات
اللغة: الإنجليزية
قواعد المعلومات: science
مواضيع:
كلمات المؤلف المفتاحية:
Arabic Text | Classification | Supervised Learning | Cosine Similarity | Latent Semantic Indexing
رابط المحتوى:
صورة الغلاف QR قانون
حفظ في:
المستخلص: Cosine similarity is one of the most popular distance measures in text classification problems. In this paper, we used this important measure to investigate the performance of Arabic language text classification. For textual features, vector space model (VSM) is generally used as a model to represent textual information as numerical vectors. However, Latent Semantic Indexing (LSI) is a better textual representation technique as it maintains semantic information between the words. Hence, we used the singular value decomposition (SVD) method to extract textual features based on LSI. In our experiments, we conducted comparison between some of the well-known classification methods such as Naïve Bayes, k- Nearest Neighbors, Neural Network, Random Forest, Support Vector Machine, and classification tree. We used a corpus that contains 4,000 documents of ten topics (400 document for each topic). The corpus contains 2,127,197 words with about 139,168 unique words. The testing set contains 400 documents, 40 documents for each topics. As a weighing scheme, we used Term Frequency. Inverse Document Frequency (TF.IDF). This study reveals that the classification methods that use LSI features significantly outperform the TF.IDF-based methods. It also reveals that k Nearest Neighbors (based on cosine measure) and support vector machine are the best performing classifiers.

ISSN: 1319-1578

عناصر مشابهة