Abstract
A text window is a group of words appearing in contiguous positions in text. Intuitively, words in such close proximity should have something to do with each other. We can use the text window to exploit a variety of lexical, syntactic, and semantic relationships without having to analyze the text explicitly for their structure. This research supports the previously suggested idea that natural groupings of words are best treated as a unit of size 7 to 11 words, that is, plus or minus three to five words. Our text retrieval experiments varying the size of windows, both with full text and with stopwords removed, support these size ranges. The characteristics of windows that best match terms in queries are examined in detail, revealing interesting differences between those for queries with good results and those for queries with poorer results. Queries with good results tend to contain more content word phrases and fewer terms with high frequency of use in the database. Information retrieval systems may benefit from expanding thesaurus-style relationships or incorporating statistical dependencies for terms within these windows.
Published Version
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.