Using Ellipsis Detection and Word Similarity for Transformation of Spoken Language into Grammatically Valid Sentences

Abstract

When humans speak they often use gram-matically incorrect sentences, which is a problem for grammar-based language pro-cessing methods, since they expect in-put that is valid for the grammar. We present two methods to transform spoken language into grammatically correct sen-tences. The first is an algorithm for au-tomatic ellipsis detection, which finds el-lipses in spoken sentences and searches in a combinatory categorial grammar for suitable words to fill the ellipses. The sec-ond method is an algorithm that computes the semantic similarity of two words us-ing WordNet, which we use to find alter-natives to words that are unknown to the grammar. In an evaluation, we show that the usage of these two methods leads to an increase of 38.64 % more parseable sen-tences on a test set of spoken sentences that were collected during a human-robot interaction experiment. 1