Experiments with Language Models for Word Completion and Prediction in Hebrew

Yaakov Hacohen-Kerner,Asaf Applebaum,Jacob Bitterman

doi:10.1007/978-3-319-10888-9_44

Experiments with Language Models for Word Completion and Prediction in Hebrew

Yaakov Hacohen-Kerner, Asaf Applebaum + Show 1 more

https://doi.org/10.1007/978-3-319-10888-9_44

Copy DOI

Publication Date: Jan 1, 2014

Citations: 2

Affiliation: Jerusalem College of Technology

#Language Models #Basic Language Models + Show 8 more

Abstract
Full-Text PDF
Similar Papers

Abstract

In this paper, we describe various language models (LMs) and combinations created to support word prediction and completion in Hebrew. We define and apply 5 general types of LMs: (1) Basic LMs (unigrams, bigrams, trigrams, and quadgrams), (2) Backoff LMs, (3) LMs Integrated with tagged LMs, (4) Interpolated LMs, and (5) Interpolated LMs Integrated with tagged LMs. 16 specific implementations of these LMs were compared using 3 types of Israeli web newspaper corpora. The foremost keystroke saving results were achieved with LMs of the most complex variety, the Interpolated LMs Integrated with tagged LMs. Therefore, we conclude that combining all strengths by creating a synthesis of all four basic LMs and the tagged LMs leads to the best results.

Full Text