Transliteration Normalization For Information Extraction And Machine Translation
| المصدر: | مجلة جامعة الملك سعود - علوم الحاسب والمعلومات |
|---|---|
| الناشر: | جامعة الملك سعود |
| المؤلف الرئيسي: | Marton, Yuval (Author) |
| مؤلفين آخرين: | Zitouni, Imed (Co-Author) |
| المجلد/العدد: | مج26, ع4 |
| محكمة: | نعم |
| الدولة: |
السعودية |
| التاريخ الميلادي: |
2014
|
| الصفحات: | 379 - 387 |
| DOI: |
10.33948/0584-026-004-004 |
| ISSN: |
1319-1578 |
| رقم MD: | 973347 |
| نوع المحتوى: | بحوث ومقالات |
| اللغة: | الإنجليزية |
| قواعد المعلومات: | science |
| مواضيع: | |
| كلمات المؤلف المفتاحية: |
Arabic | Named Entity Recognition | Transliteration | Name Normalization | Information Extraction | Machine Translation
|
| رابط المحتوى: |
| المستخلص: |
Foreign name transliterations typically include multiple spelling variants. These variants cause data sparseness and inconsistency problems, increase the Out-of-Vocabulary (OOV) rate, and present challenges for Machine Translation, Information Extraction and other natural language processing (NLP) tasks. This work aims to identify and cluster name spelling variants using a Statistical Machine Translation method: word alignment. The variants are identified by being aligned to the same ‘‘pivot” name in another language (the source-language in Machine Translation settings). Based on word-to-word translation and transliteration probabilities, as well as the string edit distance metric, names with similar spellings in the target language are clustered and then normalized to a canonical form. With this approach, tens of thousands of high-precision name transliteration spelling variants are extracted from sentence-aligned bilingual corpora in Arabic and English (in both languages). When these normalized name spelling variants are applied to Information Extraction tasks, improvements over strong baseline systems are observed. When applied to Machine Translation tasks, a large improvement potential is shown. |
|---|---|
| ISSN: |
1319-1578 |
عناصر مشابهة
-
Failure of Machine Translation of English Dysphemistic Expressions into Arabic
بواسطة: الحديثي، عمار أحمد محمود منشور: (2023) -
Automatic Extraction Of Ontological Relations From Arabic Text
بواسطة: Al Zamil, Mohammed G. H. منشور: (2014) -
A Hybrid Method For Extracting Relations Between Arabic Named Entities
بواسطة: Boujelben, Ines منشور: (2014) -
The Effect of Personalization Based on User Profiling on the Information Retrieval Performance
بواسطة: Bataineh, Manar Q. منشور: (2014) -
Rational Kernels for Arabic Root Extraction and Text Classification
بواسطة: Nehar, Attia منشور: (2016)
