User Sketches Research Articles

Comfort Of Pedestrian Roads In The City Of Singaraja An Assessment Of User Behavior

This study focuses on the concept of pedestrian path arrangement in terms of physical and non-physical conditions as well as user behavior. The research was conducted in commercial areas on Jalan Ahmad Yani and Diponegoro in Singaraja City, based on the phenomenon of pedestrian paths that are currently experiencing a change of function. The research method used is a qualitative method using place-centered mapping techniques for data collection. The place-centered mapping technique is used for mapping the location of activities / pedestrian paths and user sketches in using pedestrian paths which results in the concept of structuring pedestrian paths. The results of this study indicate that the current pedestrian paths in Singaraja City are not in accordance with the behavior of its users due to physical conditions and the change in the function of the pedestrian paths by parking, trading and displaying merchandise. So the concept of structuring the comfort of the pedestrian path that is produced is in the form of a pedestrian lane that should not be obstructed by behavioral activities or other supporting facilities, the need to provide an on-street parking area, the need for attention in terms of the pavement material used on the pedestrian path to comply with standards and the need for additional leveling. as well as pedestrian pathway dividers.

Human-Computer Co-Creativity: Blending Human and Computational Creativity

This paper describes a thesis exploring how computer programs can collaborate as equals in the artistic creative process. The proposed system, CoCo Sketch, encodes some rudimentary stylistic rules of abstract sketching and music theory to contribute supplemental lines and music while the user sketches. We describe a three-part research method that includes defining rudimentary stylistic rules for abstract line drawing, exploring the interaction design for artistic improvisation with a computer, and evaluating how CoCo Sketch affects the artistic creative process. We report on the initial results of early investigations into artistic style that describe cognitive, perceptual, and behavioral processes used in abstract artists making.

Interactive liquid splash modeling by user sketches

Splashing is one of the most fascinating liquid phenomena in the real world and it is favored by artists to create stunning visual effects, both statically and dynamically. Unfortunately, the generation of complex and specialized liquid splashes is a challenging task and often requires considerable time and effort. In this paper, we present a novel system that synthesizes realistic liquid splashes from simple user sketch input. Our system adopts a conditional generative adversarial network (cGAN) trained with physics-based simulation data to produce raw liquid splash models from input sketches, and then applies model refinement processes to further improve their small-scale details. The system considers not only the trajectory of every user stroke, but also its speed, which makes the splash model simulation-ready with its underlying 3D flow. Compared with simulation-based modeling techniques through trials and errors, our system offers flexibility, convenience and intuition in liquid splash design and editing. We evaluate the usability and the efficiency of our system in an immersive virtual reality environment. Thanks to this system, an amateur user can now generate a variety of realistic liquid splashes in just a few minutes.

Inverse Procedural Modeling of Branching Structures by Inferring L-Systems

We introduce an inverse procedural modeling approach that learns L-system representations of pixel images with branching structures. Our fully automatic model generates a compact set of textual rewriting rules that describe the input. We use deep learning to discover atomic structures such as line segments or branchings. Orientation and scaling of these structures are determined and the detected structures are combined into a tree. The initial representation is analyzed, and repeating parts are encoded into a small grammar by using greedy optimization while the user can control the size of the detected rules. The output is an L-system that represents the input image as a simple text and a set of terminal symbols. We apply our approach to a variety of examples, demonstrate its robustness against noise and blur, and we show that it can detect user sketches and complex input structures.

A sketch-aided retrieval approach for incomplete 3D objects

With the growing amount of digital collections of visual CH data being available across different repositories, it becomes increasingly important to provide archaeologists with means to find relations and cross-correspondences between different digital records. In principle, existing shape- and image-based similarity search methods can aid such domain analysis tasks. However, in practice, visual object data are given in different modalities, and often only in incomplete or fragmented state, posing a particular challenge for conventional similarity search approaches. In this paper we introduce a methodology and system for cross-modal visual search in CH object data that addresses these challenges. Specifically, we propose a new query modality based on 3D views enhanced by user sketches (3D+sketch). This allows for adding new context to the search, which is useful e.g., for searching based on incomplete query objects, or for testing hypotheses on existence of certain shapes in a collection. We present an appropriately designed workflow for constructing query views from incomplete 3D objects enhanced by a user sketch, based on shape completion and texture inpainting. Visual cues additionally help users compare retrieved objects with the query. The proposed approach extends on a previously presented retrieval system by introducing improved retrieval methods, an extended evaluation including retrieval in a larger and richer data collection, and enhanced interactive search weight specification. We demonstrate the feasibility and potential of our approach to support analysis of domain experts in Archaeology and the field of CH in general.

SmartPaint: a co-creative drawing system based on generative adversarial networks

Artificial intelligence (AI) has played a significant role in imitating and producing large-scale designs such as e-commerce banners. However, it is less successful at creative and collaborative design outputs. Most humans express their ideas as rough sketches, and lack the professional skills to complete pleasing paintings. Existing AI approaches have failed to convert varied user sketches into artistically beautiful paintings while preserving their semantic concepts. To bridge this gap, we have developed SmartPaint, a co-creative drawing system based on generative adversarial networks (GANs), enabling a machine and a human being to collaborate in cartoon landscape painting. SmartPaint trains a GAN using triples of cartoon images, their corresponding semantic label maps, and edge detection maps. The machine can then simultaneously understand the cartoon style and semantics, along with the spatial relationships among the objects in the landscape images. The trained system receives a sketch as a semantic label map input, and automatically synthesizes its edge map for stable handling of varied sketches. It then outputs a creative and fine painting with the appropriate style corresponding to the human’s sketch. Experiments confirmed that the proposed SmartPaint system successfully generates high-quality cartoon paintings.

Sketching in Gestalt Space: Interactive Shape Abstraction through Perceptual Reasoning

AbstractWe present an interactive method that allows users to easily abstract complex 3D models with only a few strokes. The key idea is to employ well‐known Gestalt principles to help generalizing user inputs into a full model abstraction while accounting for form, perceptual patterns and semantics of the model. Using these principles, we alleviate the user's need to explicitly define shape abstractions. We utilize structural characteristics such as repetitions, regularity and similarity to transform user strokes into full 3D abstractions. As the user sketches over shape elements, we identify Gestalt groups and later abstract them to maintain their structural meaning. Unlike previous approaches, we operate directly on the geometric elements, in a sense applying Gestalt principles in 3D. We demonstrate the effectiveness of our approach with a series of experiments, including a variety of complex models and two extensive user studies to evaluate our framework.

Computational design of telescoping structures

Telescoping structures are valuable for a variety of applications where mechanisms must be compact in size and yet easily deployed. So far, however, there has been no systematic study of the types of shapes that can be modeled by telescoping structures, nor practical tools for telescopic design. We present a novel geometric characterization of telescoping curves, and explore how free-form surfaces can be approximated by networks of such curves. In particular we consider piecewise helical space curves with torsional impulses, which significantly generalize the linear telescopes found in typical engineering designs. Based on this principle we develop a system for computational design and fabrication which allows users to explore the space of telescoping structures; inputs to our system include user sketches or arbitrary meshes, which are then converted to a curve skeleton. We prototype applications in animation, fabrication, and robotics, using our system to design a variety of both simulated and fabricated examples.

A novel 3D model retrieval system based on three-view sketches

© 2016 - IOS Press and the authors. All rights reserved.3D models can be used in 3D printing and many other areas. At present, there are a lot of researches on 3D model retrieval and sketch is considered to be important for 3D model retrieval. In this paper, we develop a new 3D model retrieval prototype system based on style-sensitive 3D model retrieval method and three-view user sketches. We also implement user-friendly graphic interfaces for the 3D model retrieval system. We explore the performance of the system by conducting a series of 3D model retrieval experiments on the Princeton shape benchmark data set. Experimental results show that the new retrieval system can obtain satisfactory retrieval results. And some results of the new method are superior to some content-based 3D model retrieval methods, in terms of both quantitative search performance metrics and qualitatively measured user search experiences.

A Suggestive Interface for Sketch-based Character Posing

We present a user-friendly suggestive interface for sketch-based character posing. Our interface provides suggestive information on the sketching canvas in succession by combining image retrieval technique with 3D character posing, while the user is drawing. The system highlights the canvas region where the user should draw on and constrains the user's sketches in a reasonable solution space. This is based on an efficient image descriptor, which is used to measure the distance between the user's sketch and 2D views of 3D poses. In order to achieve faster query response, local sensitive hashing is involved in our system. In addition, sampling-based optimization algorithm is adopted to synthesize and optimize the retrieved 3D pose to match the user's sketches the best. Experiments show that our interface can provide smooth suggestive information to improve the reality of sketching poses and shorten the time required for 3D posing.

Sketch‐to‐Design: Context‐Based Part Assembly

AbstractDesigning 3D objects from scratch is difficult, especially when the user intent is fuzzy and lacks a clear target form. We facilitate design by providing reference and inspiration from existing model contexts. We rethink model design as navigating through different possible combinations of part assemblies based on a large collection of pre‐segmented 3D models. We propose an interactive sketch‐to‐design system, where the user sketches prominent features of parts to combine. The sketched strokes are analysed individually, and more importantly, in context with the other parts to generate relevant shape suggestions via adesign galleryinterface. As a modelling session progresses and more parts get selected, contextual cues become increasingly dominant, and the model quickly converges to a final form. As a key enabler, we use pre‐learned part‐based contextual information to allow the user to quickly explore different combinations of parts. Our experiments demonstrate the effectiveness of our approach for efficiently designing new variations from existing shape collections.

Graph-based retrieval of building information models for supporting the early design stages

Building information modeling (BIM) principles are transforming today’s communication and working processes in the field of construction, however the early design phases are only rarely supported and information technology is therefore not exploited to its full potential. The early design phases are characterized by an iterative process of searching for plausible solutions. A common approach is to refer to similar examples, which are conventionally found using keyword-based search strategies.To this end we propose a method for indexing spatial configurations along with a sketch-based input method for search strategies that uses so-called semantic fingerprints of buildings. The topology of spatial configurations is extracted from building information models and represented as graphs. For both building information models and the user sketches, the extracted graphs are used as the basis for a subgraph-matching algorithm facilitating an intuitive novel query method for researching similar reference examples. The system is able to present corresponding existing solutions to even rudimentary sketches or fragments of a design idea. In addition to graph matching and sketch-based interaction, more recent BIM-based approaches are also taken into account.

Simultaneous structure and geometry detail completion based on interactive user sketches

We articulate a novel approach to geometric model completion via interactive sketches in this paper. First, the initial incomplete model (with holes) is decomposed into a base model and a high-frequency component, which represents global rough shape and geometric details, respectively. We then repair the base model via smooth hole-filling, and compute the geometry detail image using high frequency information. One novel element of our approach is that we allow users to interactively sketch a few structural curves that span across hole regions, with a goal to repair both local geometric details and global structure. With the help of local parameterization, we convert detailed geometry into gradient-domain images which can propagate along user-specified sketches. By integrating recovered gradient-domain images and base shape, we can generate a complete model that faithfully recovers both global structure and local details. The salient contribution of this paper is the unified approach for user interaction, global structure, and geometry details towards high-fidelity model completion. We demonstrate our new approach using a number of examples that exhibit salient global structure as well as local geometry details.

Photosketcher: interactive sketch-based image synthesis.

Photosketcher is an interactive system for progressively synthesizing novel images using only sparse user sketches as input. Photosketcher works on the image content exclusively; it doesn't require keywords or other metadata associated with the images. Users sketch the rough shape of a desired image part, and Photosketcher searches a large collection of images for it. The search is based on a bag-of-features approach that uses local descriptors for translation-invariant retrieval of image parts. Composition is based on user scribbles: from the scribbles, Photosketcher predicts the desired part using Gaussian mixture models and computes an optimal seam using graph cuts. To further reduce visible seams, users can blend the composite image in the gradient domain.

Automatic creation of 3D environments from a single sketch using content-centric networks

In this article a complete and innovative system for automatic creation of 3D environments from multimedia content available in the network is presented. The core application provides an interface where the user sketches in 2D the scene that s/he aims to build. Moreover, the GUI application exploits the similarity search and retrieval capabilities of search-enabled content-centric networks to fetch 3D models that are similar to the drawn 2D objects. The retrieved 3D models act as the building components for the automatically constructed 3D scene. Two CCN-based applications are also described, which perform the query routing and similarity search on each node of the CCN network.

Sketch based garment modeling on an arbitrary view of a 3D virtual human model

This paper presents a new approach for modeling a virtual garment intuitively and simply by sketching garment style lines. The user sketches directly onto the surface of 3D virtual human from arbitrary viewing directions, and the 3D garment suited to the virtual human can be created automatically. First, a distance field based allocation algorithm is proposed to find the 3D point which has the shortest given distance to the virtual human along the view direction. Then, the 3D style lines are generated by transforming from the 2D strokes on the human model and all the garment pieces are recognized from the 3D style lines. Finally, the 3D garment model is constructed by using the angle and offset based interpolation and Delaunay triangulation. In addition, we propose a body feature based template reusing method to fit the 3D garment to different virtual human models. The method can be adapted to designer habits and improve the usefulness of garment design. Examples show that the method is useful and efficient.

Landscape Image Retrieval with Query by Sketch and Icon

This paper reports a new method for retrieving landscape images using a sketch and icons as a query. Based on the proposal, first, a user sketches lines expressing contours of landscape elements such as mountains and forests and attaches icons expressing landscape elements to the sketch. Second, whether individual images in a database match with the layout expressed by the sketch and icons is judged with principal component analysis and pattern recognition. From experimental results, we have confirmed that the proportion of the correct images ranked within top 10 of retrieval results is 80% in an average.

Vision-based continuous Graffiti™-like text entry system

It is now possible to design real-time, low-cost computer vi- sion systems even in personal computers due to the recent advances in electronics and the computer industry. Due to this reason, it is feasible to develop computer-vision-based human-computer interaction systems. A vision-based continuous Graffiti™-like text entry system is presented. The user sketches characters in a Graffiti™-like alphabet in a continuous manner on a flat surface using a laser pointer. The beam of the laser pointer is tracked on the image sequences captured by a camera, and the corresponding written word is recognized from the extracted trace of the laser beam. © 2004 Society of Photo-Optical Instrumentation Engineers.

Sketching space

In this paper, we present a sketch modelling system which we call Stilton. The program resembles a desktop VRML browser, allowing a user to navigate a three-dimensional model in a perspective projection, or panoramic photographs, which the program maps onto the scene as a “floor” and “walls”. We place an imaginary two-dimensional drawing plane in front of the user, and any geometric information that user sketches onto this plane may be reconstructed to form solid objects through an optimisation process. We show how the system can be used to reconstruct geometry from panoramic images, or to add new objects to an existing model. While panoramic imaging can greatly assist with some aspects of site familiarisation and qualitative assessment of a site, without the addition of some foreground geometry they offer only limited utility in a design context. Therefore, we suggest that the system may be of use in “just-in-time” CAD recovery of complex environments, such as shop floors, or construction sites, by recovering objects through sketched overlays, where other methods such as automatic line-retrieval may be impossible. The result of using the system in this manner is the “sketching of space” — sketching out a volume around the user — and once the geometry has been recovered, the designer is free to quickly sketch design ideas into the newly constructed context, or analyse the space around them. Although end-user trials have not, as yet, been undertaken we believe that this implementation may afford a user-interface that is both accessible and robust, and that the rapid growth of pen-computing devices will further stimulate activity in this area.

Visual Image Retrieval by Multiscale Description of User Sketches

This paper describes an application allowing content-based retrieval. The application may be called ‘sketch-based database retrieval’ since the user interacts with the database by means of sketches. The user draws his request with a pencil: the request image is then a binary image that comprises a contour on a uniform bottom. The image-retrieval based on user-provided information such as hand-drawn sketches is a challenging problem in multimedia applications. A human's perception of shape can be rather subjective and has a large variance. In this paper, we propose to represent a sketch and a contours in image database by curvature scale space (CSS) description, which define an invariant distance in the shapes space. In theoretical aspect, the invariance, the completeness and the stability properties of CSS description imply the definition of a metric on the shape space. This distance allows us to compare a sketch to images in database. A prototype system has been developed for image retrieval by sketch. This system takes into account spatial relationships between objects in multi-objects queries.