An efficient, classification-based approach for grouping pen strokes into objects

Abstract

Objects in freely drawn sketches often have no spatial or temporal separation, making object identification difficult. We present a two-step stroke-grouping algorithm that first classifies individual strokes according to the type of object to which they belong, and then groups strokes with like classifications into clusters representing individual objects. The first step facilitates clustering by naturally separating the strokes, and both steps fluidly integrate spatial and temporal information. Our single-stroke classifier has comparable accuracy to an existing state-of-the-art single-stroke classifier on text vs. non-text classification, and is significantly more efficient. Furthermore, our classifier is also suitable for applications with more than two classes of strokes. Our approach to grouping is unique in its formulation as an efficient classification task rather than, for example, an expensive search task. In experiments on several types of sketches, our grouping method performed accurately, correctly grouping up to 92% of the ink, with up to 79% of the shapes being perfectly clustered.