Morphological, Syntactic And Diacritics Rules For Automatic Diacritization Of Arabic Sentences
| المصدر: | مجلة جامعة الملك سعود - علوم الحاسب والمعلومات |
|---|---|
| الناشر: | جامعة الملك سعود |
| المؤلف الرئيسي: | Chennoufi, Amine (Author) |
| مؤلفين آخرين: | Mazroui, Azzeddine (Co-Author) |
| المجلد/العدد: | مج29, ع2 |
| محكمة: | نعم |
| الدولة: |
السعودية |
| التاريخ الميلادي: |
2017
|
| الصفحات: | 156 - 163 |
| DOI: |
10.33948/0584-029-002-003 |
| ISSN: |
1319-1578 |
| رقم MD: | 974085 |
| نوع المحتوى: | بحوث ومقالات |
| اللغة: | الإنجليزية |
| قواعد المعلومات: | science |
| مواضيع: | |
| كلمات المؤلف المفتاحية: |
Arabic Language | Automatic Diacritization | Arabic Diacritical Marks | Morphological Analysis | Smoothing Techniques | Hidden Markov Model
|
| رابط المحتوى: |
| المستخلص: |
The diacritical marks of Arabic language are characters other than letters and are in the majority of cases absent from Arab writings. This paper presents a hybrid system for automatic diacritization of Arabic sentences combining linguistic rules and statistical treatments. The used approach is based on four stages. The first phase consists of a morphological analysis using the second version of the morphological analyzer Alkhalil Morpho Sys. Morphosyntactic outputs from this step are used in the second phase to eliminate invalid word transitions according to the syntactic rules. Then, the system used in the third stage is a discrete hidden Markov model and Viterbi algorithm to determine the most probable diacritized sentence. The unseen transitions in the training corpus are processed using smoothing techniques. Finally, the last step deals with words not analyzed by Alkhalil analyzer, for which we use statistical treatments based on the letters. The word error rate of our system is around 2.58% if we ignore the diacritic of the last letter of the word and around 6.28% awhen this diacritic is taken into account. |
|---|---|
| ISSN: |
1319-1578 |
عناصر مشابهة
-
Morphological Analysis and Diacritical Arabic Text Compression
بواسطة: Daoud, Amjad Mustafa منشور: (2013) -
Arabic Diacritics and Their Influence on Word Recognition
بواسطة: Eldeeb, Muftah B. منشور: (2017) -
The Effect of Full and Partial Diacritization on Arabic Root Extraction
بواسطة: T, Rachid منشور: (2007) -
AlKhalil Morpho Sys 2: A Robust Arabic Morpho Syntactic Analyzer
بواسطة: Boudchiche, Mohamed منشور: (2017) -
A hybrid statistical and morphological Arabic language diacritizing system
بواسطة: Hattab, Abd Allah Mamoun منشور: (2012)
