Abstract

AbstractThe paper is based on the Bielefeld Speech-And-Gesture-Alignment corpus (SAGA). From this corpus one video film is taken to establish a typological grid for iconic and referring gesture types, i.e. a multiple inheritance hierarchy of types proceeding from single gestural features like hand shape to sequences of entities filling up the whole gesture space. Types are mapped onto a partial ontology specifying their respective meaning. Multi-modal meaning is generated via linking verbal meaning and gestural meaning. How verbal and gestural meaning interface is shown with an example using a quantified NP. It is argued that gestural meaning extends the restriction of the original quantified NP. On the other hand it is shown that gestural meaning is not strong enough to resolve the underspecification of the lexical information.KeywordsSAGA corpusiconic gesturegesture typologypartial ontologyspeech-gesture interface

Full Text
Paper version not known

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.