ارسل ملاحظاتك

ارسل ملاحظاتك لنا







الرئيسية > Word Length Algorithm for Lang...>الوصف

Word Length Algorithm for Language Identification of Under Resourced Languages

المصدر: مجلة جامعة الملك سعود - علوم الحاسب والمعلومات
الناشر: جامعة الملك سعود
المؤلف الرئيسي: Selamat, Ali (Author)
مؤلفين آخرين: Akosu, Nicholas (Co-Author)
المجلد/العدد: مج28, ع4
محكمة: نعم
الدولة: السعودية
التاريخ الميلادي: 2016
الصفحات: 457 - 469
DOI: 10.33948/0584-028-004-008
ISSN: 1319-1578
رقم MD: 974021
نوع المحتوى: بحوث ومقالات
اللغة: الإنجليزية
قواعد المعلومات: science
مواضيع:
علوم الحاسوب | الخوارزميات | اللسانيات الحاسوبية
كلمات المؤلف المفتاحية:
Language Identification | Under Resourced Languages | Resource Scarce | Digital Divide | Spellchecker Model
رابط المحتوى:
PDF (صورة)     
صورة الغلاف QR قانون
حفظ في:
المستخلص: Language identification is widely used in machine learning, text mining, information retrieval, and speech processing. Available techniques for solving the problem of language identification do require large amount of training text that are not available for under-resourced languages which form the bulk of the World’s languages. The primary objective of this study is to propose a lexicon based algorithm which is able to perform language identification using minimal training data. Because language identification is often the first step in many natural language processing tasks, it is necessary to explore techniques that will perform language identification in the shortest possible time. Hence, the second objective of this research is to study the effect of the proposed algorithm on the run time performance of language identification. Precision, recall, and F1 measures were used to determine the effectiveness of the proposed word length algorithm using datasets drawn from the Universal Declaration of Human Rights Act in 15 languages. The experimental results show good accuracy on language identification at the document level and at the sentence level based on the available dataset. The improved algorithm also showed significant improvement in run time performance compared with the spelling checker approach.
ISSN: 1319-1578

عناصر مشابهة


© 2024 المنظومة. جميع الحقوق محفوظة.