Abstract
Part-of-speech (POS) tagging is a well-established technology for most Western European languages and a few other world languages, but it has not been evaluated on Igbo, an agglutinative African language. This article presents POS tagging experiments conducted using an Igbo corpus as a test bed for identifying the POS taggers and the Machine Learning (ML) methods that can achieve a good performance with the small dataset available for the language. Experiments have been conducted using different well-known POS taggers developed for English or European languages, and different training data styles and sizes. Igbo has a number of language-specific characteristics that present a challenge for effective POS tagging. One interesting case is the wide use of verbs (and nominalizations thereof) that have an inherent noun complement, which form “linked pairs” in the POS tagging scheme, but which may appear discontinuously. Another issue is Igbo's highly productive agglutinative morphology, which can produce many variant word forms from a given root. This productivity is a key cause of the out-of-vocabulary (OOV) words observed during Igbo tagging. We report results of experiments on a promising direction for improving tagging performance on such morphologically-inflected OOV words.
| Original language | English |
|---|---|
| Article number | 42 |
| Number of pages | 26 |
| Journal | ACM Transactions on Asian and Low-Resource Language Information Processing (TALLIP) |
| Volume | 18 |
| Issue number | 4 |
| Early online date | 21/05/2019 |
| DOIs | |
| Publication status | Published - 31/08/2019 |
User-defined Keywords
- African language
- Corpora
- Corpus annotation
- Igbo
- Language technology
- Machine learning
- Morphological analysis
- Natural language processing (NLP)
- Part-of-speech (POS) tagging
- POS tagger
- Tagset
- Text processing
Cite this
- APA
- Author
- BIBTEX
- Harvard
- Standard
- RIS
- Vancouver