Word Length Algorithm for Language Identification of Under Resourced Languages
| المصدر: | مجلة جامعة الملك سعود - علوم الحاسب والمعلومات |
|---|---|
| الناشر: | جامعة الملك سعود |
| المؤلف الرئيسي: | Selamat, Ali (Author) |
| مؤلفين آخرين: | Akosu, Nicholas (Co-Author) |
| المجلد/العدد: | مج28, ع4 |
| محكمة: | نعم |
| الدولة: |
السعودية |
| التاريخ الميلادي: |
2016
|
| الصفحات: | 457 - 469 |
| DOI: |
10.33948/0584-028-004-008 |
| ISSN: |
1319-1578 |
| رقم MD: | 974021 |
| نوع المحتوى: | بحوث ومقالات |
| اللغة: | الإنجليزية |
| قواعد المعلومات: | science |
| مواضيع: | |
| كلمات المؤلف المفتاحية: |
Language Identification | Under Resourced Languages | Resource Scarce | Digital Divide | Spellchecker Model
|
| رابط المحتوى: |
| المستخلص: |
Language identification is widely used in machine learning, text mining, information retrieval, and speech processing. Available techniques for solving the problem of language identification do require large amount of training text that are not available for under-resourced languages which form the bulk of the World’s languages. The primary objective of this study is to propose a lexicon based algorithm which is able to perform language identification using minimal training data. Because language identification is often the first step in many natural language processing tasks, it is necessary to explore techniques that will perform language identification in the shortest possible time. Hence, the second objective of this research is to study the effect of the proposed algorithm on the run time performance of language identification. Precision, recall, and F1 measures were used to determine the effectiveness of the proposed word length algorithm using datasets drawn from the Universal Declaration of Human Rights Act in 15 languages. The experimental results show good accuracy on language identification at the document level and at the sentence level based on the available dataset. The improved algorithm also showed significant improvement in run time performance compared with the spelling checker approach. |
|---|---|
| ISSN: |
1319-1578 |
عناصر مشابهة
-
A Hybrid Fingerprint Identification & Verification Algorithm
بواسطة: Al Khreisat, Alaa' Abd Elrahim منشور: (2012) -
Enhancing The Bellovin and Cheswick's Algorithm by Adding Dummy Values and Reorder Process
بواسطة: Eshtaiwi, Fadi Yousef Ali منشور: (2012) -
Cuckoo Search Based Optimal Mask Generation For Noise Suppression And Enhancement Of Speech Signal
بواسطة: Garg, Anil منشور: (2015) -
Proposing an Arabic Letters Coding System for Different Programming Languages
بواسطة: عبدالكريم، مها منشور: (2020) -
Translating Natural Language Constraints To OCL
بواسطة: Bajwa, Imran Sarwar منشور: (2012)
