Sketching Tool Research Articles

3D sketching in immersive environments: Shape from disordered ribbon strokes

Immersive environments with head mounted displays (HMD) and hand-held controllers, either in Virtual or Augmented Reality (VR/AR), offer new possibilities for the creation of artistic 3D content. Some of them are exploited by mid-air drawing applications: the user’s hand trajectory generates a set of stylized curves or ribbons in space, giving the impression of painting or drawing in 3D. We propose a method to extend this approach to the sketching of surfaces with a VR controller. The idea is to favor shape exploration, offering a tool, where the user creates a surface just by painting ribbons. These ribbons are not constrained to form patch boundaries for example or to completely cover the shape. They can be very sparse, disordered, overlap or not, intersect or not. The shape is computed simultaneously, starting with the first piece of ribbon drawn by the user and continuing to evolve in real-time as long as the user continues sketching. Our method involves minimizing an energy function based on the projections of the ribbon strokes on a proxy surface by taking the controller’s orientations into account. The current implementation considers elevation surfaces. In addition to many examples, we evaluate the time performance of the dynamic shape modeling with respect to an increasing number of input ribbon strokes. Finally, we present images of an artistic creation that combines stylized curve drawings in VR with our surface sketching tool created by a professional artist.

Exploring Apparel Design Students’ Willingness to Use Virtual Reality in the Sketching Phase of the Fashion Design Process

Virtual reality (VR) is a computer-generated experience through projection of shapes, objects, and scenic views via headset or helmet device and interpreted as a genuine realistic environment. The interpretation of the highly realistic projection from the eye creates an immersive experience for the user. The use of VR technology is utilized in an array of industry applications as well as learning/training spaces. In particular, when VR is used in an educational setting, studies have shown positive or improved student achievement for a variety of academic disciplines in conjunction with creativity, inspiration, engagement, and motivation. VR used in industry applications, specifically within apparel industries, has been reported to enhance efficiencies in retail, enable virtual garment fitting, and reduction of physical samples in the apparel design and product development process. Regardless of these demonstrated favorable outcomes from education and industry, few research studies have investigated students’ willingness to adopt VR as a tool for use within their desired academic discipline (feeding into their future career path). As use in the apparel design and product development process has been reported, an opportunity exists to explore VR as an educational tool to ideate fashion design ideas in an individual’s apparel design process. Thus, the goal of this study was to provide initial insights into students’ willingness to use VR as a sketching tool, compared to traditional sketching tools, during the apparel design process. A multiple case study design was employed to examine the phenomenon in eight selected undergraduate Apparel Design students. The study was guided through the lens of the Unified Theory of Acceptance and Use of Technology (UTAUT) framework to examine students’ willingness based on performance expectancy, effort expectancy, social influence, and facilitating conditions to use VR. A learning module was developed in a 300-level apparel design course specifically to explore VR as a sketching tool in their design ideation process. Students received a demonstration for how to use the Oculus Quest VR equipment and experimentation/practice time using the equipment in conjunction with the Gravity Sketch (GS) VR application which allowed student users to draw in virtual space on an imported preexisting dress form. Following the practice time, students then completed an apparel design activity using the VR tool. Students then completed a survey in which data was collected through mixed methods by questionary scales and open-ended questions. The findings suggest a relationship between social willingness to adopt VR in their design ideation process while also providing a structure for future researchers to expand the use of this technology in apparel design coursework.

I am a Genius! Influence of Virtually Embodying Leonardo da Vinci on Creative Performance.

Virtual reality (VR) provides users with the ability to substitute their physical appearance by embodying virtual characters (avatars) using head-mounted displays and motion-capture technologies. Previous research demonstrated that the sense of embodiment toward an avatar can impact user behavior and cognition. In this paper, we present an experiment designed to investigate whether embodying a well-known creative genius could enhance participants' creative performance. Following a preliminary online survey (N = 157) to select a famous character suited to the purpose of this study, we developed a VR application allowing participants to embody Leonardo da Vinci or a self-avatar. Self-avatars were approximately matched with participants in terms of skin tone and morphology. 40 participants took part in three tasks seamlessly integrated in a virtual workshop. The first task was based on a Guilford's Alternate Uses test (GAU) to assess participants' divergent abilities in terms of fluency and originality. The second task was based on a Remote Associates Test (RAT) to evaluate convergent abilities. Lastly, the third task consisted in designing potential alternative uses of an object displayed in the virtual environment using a 3D sketching tool. Participants embodying Leonardo da Vinci demonstrated significantly higher divergent thinking abilities, with a substantial difference in fluency between the groups. Conversely, participants embodying a self-avatar performed significantly better in the convergent thinking task. Taken together, these results promote the use of our virtual embodiment approach, especially in applications where divergent creativity plays an important role, such as design and innovation.

Examining apparel design students’ self-efficacy towards using virtual reality in the design process

ABSTRACT Virtual reality (VR) is an emerging technology in garment design that has demonstrated promising student achievement results (Wyss et al., 2014 [Cotton Island: Students’ learning motivation using a virtual world. Decision Sciences Journal of Innovative Education, 12(3), 219–232]). When educators and institutions adopt new technologies, they need to consider how the unfamiliar technology will affect student’s self-efficacy levels and to design lesson plans accordingly. Therefore, the purpose of this initial study is to examine students’ self-efficacy levels toward the adoption of VR as a design sketching tool. A multiple case study design was employed in this study. Eight undergraduate Apparel Design students enrolled in an Apparel Design course constituted the sample. Data were collected using a self-efficacy scale, and open-ended questions. The data examined levels of self-efficacy in VR use as well as factors that impacted those levels. The findings failed to show differences among factors that influence students’ self-efficacy in VR usage at each self-efficacy level. Based on the findings, research propositions were confirmed or modified, or were additionally proposed.

Solving Program Sketches with Large Integer Values

Program sketching is a program synthesis paradigm in which the programmer provides a partial program with holes and assertions. The goal of the synthesizer is to automatically find integer values for the holes so that the resulting program satisfies the assertions. The most popular sketching tool, Sketch , can efficiently solve complex program sketches but uses an integer encoding that often performs poorly if the sketched program manipulates large integer values. In this article, we propose a new solving technique that allows Sketch to handle large integer values while retaining its integer encoding. Our technique uses a result from number theory, the Chinese Remainder Theorem, to rewrite program sketches to only track the remainders of certain variable values with respect to several prime numbers. We prove that our transformation is sound and the encoding of the resulting programs are exponentially more succinct than existing Sketch encodings. We evaluate our technique on a variety of benchmarks manipulating large integer values. Our technique provides speedups against both existing Sketch solvers and can solve benchmarks that existing Sketch solvers cannot handle.

Review: Cinque viaggi (1990–98), by Guido Guidi

Review: <i>Cinque viaggi (1990–98)</i>, by Guido Guidi

A study of the effects of a natural virtual environment on creativity during a product design activity

Numerous studies have shown a beneficial effect of exposing people to natural landscapes and plants on their well-being and attentional functioning. The aim of the present study was to evaluate the effects of a natural virtual environment on creativity in a task consisting of sketching ideas of creative solutions to a problem. The participants in this experiment were asked to sketch ideas of innovative workstation for a person in a wheelchair. To do this, they used a virtual reality sketching tool. They performed this task once in a neutral environment (all in the dark), one in a natural virtual envirnment (forest) and once in a non-natural environment (office). The results revealed that people tend to be more creative in this task when they are immersed in a natural environment than when they are in a neutral environment without any vegetation.

AN EXPLORATIVE STUDY TOWARDS USING VR SKETCHING AS A TOOL FOR IDEATION AND PROTOTYPING IN PRODUCT DESIGN

AbstractThe advancements in the field of VR allow designers to use VR as a technology for sketching ideas in a virtual space. In this paper, Gravity Sketch (a VR sketching software) is used as an ideation sketching tool in the process of product styling. The goal of this research is to examine the advantages and points-of-pain when using virtual reality tools in the process of product styling. 29 Master students used the VR sketching tool in their design process and all of them had feedback and insights on the tool.

Rapid simulation of various types of HVAC systems in the early design stage

Considerations on indoor thermal comfort and energy efficiency need to be addressed early in the conceptual design stage of low-energy buildings. This paper describes an investigation on how to appropriately expand the hourly method of ISO 13790 to include performance assessment of different configurations of heating and cooling strategies. The implementation of the new thermal simulation procedure works as a plug-in to architectural sketching tool where it can execute an annual simulation within approx. 9 milliseconds. The plug-in may therefore qualify as a suitable tool for rapid and precise performance assessment of various heating and cooling strategies in the early design stage.

A comparison of digital and conventional sketching: implications for conceptual design ideation

The study compared the use of digital and conventional sketching as influence upon conceptual design work. The results show a significantly increased focus of attention upon the sketching tool in the digital condition compared to conventional sketching with pen and paper. Both a statistical analysis and fine-grained qualitative comparison illustrate how increased frequencies of sketching tool focused activities resulted in both significantly more time spent in problem orientated work and the fragmentation of attempts to transition from problem definition to generative solution ideation. In contrast, reduced tool-focused activity in the conventional sketching condition appeared to provide opportunities for significantly increased solution ideation through design-driven moves to explore, reflect upon and develop solution propositions. The implications of a tool orientated focus of attention are discussed in terms of its impact upon reflective solution ideation during conceptual design.

Toward Meaningful Industrial--Academic Partnerships

At the Ready-Set-Transfer panel at the 2014 IEEE International Requirements Engineering Conference, researchers presented their projects to a team of industrial judges, explaining the industrial motivation and describing how they had evaluated their idea's adoption readiness. The projects included FlexiSketch, a collaborative-whiteboard sketching tool; the Collaborative Creativity Canvas, which replaces requirements negotiation with a lively cocreation process; and Archie, which detects and visualizes architectural decisions in code. The Web extra at http://youtu.be/6RNYVVWrJAQ is an audio podcast in which author Jane Cleland-Huang provides an audio recording of the Requirements column,in which she discusses the Ready-Set-Transfer panel at the 2014 IEEE International Requirements Engineering Conference.

Evolutionary and interactive sketching tool for innovative car shape design

So as to create innovative car silhouettes, we propose in this paper a model based on an Interactive Genetic Algorithm using an encoding of a design solution by a Fourier analysis approach. This model permits the designer to browse through generations of car profiles from an initial population of existing silhouettes. By qualitatively assessing each individual, the designer converges towards solutions complying with his/her requirements and preferences, possibly creating novelty and generating surprise. We describe here tests for assessing the efficiency of this innovative design platform. These tests are mainly based on a similarity index, a similarity measure being the perceived distance between two cars silhouettes. The results highlight a good convergence toward a satisfactory solution. In addition, this design process turns out to be very flexible because of the local and intuitive modifications allowed on a given individual solution at any moment of the design process.

Automatic terrain generation with a sketching tool

Nowadays, applications such as scientific simulations, virtual reality or computer games are increasing the detail of their environments with the aim of offering more realism. Terrain is a very imp...

Sketch-n-Stretch: sketching animations using cutouts.

Sketch-n-Stretch lets novices quickly and easily create 2D animations. The system has a seamless two-layer drawing interface that supports cutouts using a whiteboard metaphor. Cutout animations serve as building blocks to help users construct sophisticated animations. While manipulating cutout animations, users can draw and write text to create effects-such as articulated figures, multiple motions, and image objects-that have been difficult with previous sketching approaches. An intuitive timeline interface employs visually integrated motion cues and supports several traditional animation effects. Novices positively evaluated Sketch-n-Stretch's effectiveness in creating object motions, compared to an existing sketching tool. They also used its advanced features to animate complete stories. This video demonstrates the Sketch-n-Stretch tool for making sketch-based animations.

A Freehand Vascular Designing and Modeling Tool for Surgery Simulation

This paper presents an intuitive sketching tool for human-computer interactively designing and modeling the vascular structure. Our system supports freehand outlining of the initial vascular structure through a 3D user interface, which is capable of modeling tubular vessel segments as well as bifurcations. The editing capability can be used for completing partially segmented vascular information such as the topology and radius, as well as designing normal vascular structure or pathological vascular structure such as the aneurysm and stenosis for medical simulations curriculum. Our tool may also be used in the various semi-automatic initialization steps for segmentation and registration processes such as the positioning of 3D seed and land-marking of vessels on top of different modalities. The improved parallel frame approach is used for sweeping surfaces along the composed curve of vascular tree such that the vascular structure can be easily and well visualized as a tube model.

SimLandScape, a sketching tool for collaborative spatial planning

Interactive spatial planning requires the development of planning support systems (PSSs) that are specifically tailored to support the exchange of ideas and visions during the planning process. This article presents SimLandScape, a client-server-based PSS designed to combine sketching and geographic information system (GIS) functionality. The PSS is implemented on an interactive digital surface, the MapTable, which makes it easy to use and retains the sketching experience. Using the MapTable, participants work together to explore the environment, exchange ideas about the direction of future development and sketch the first designs of a spatial plan. The close integration of the PSS with GIS allows spatial models to be plugged into the system. These can be used to calculate indicators that offer insights into how well a sketch plan meets predetermined criteria. SimLandScape was developed according to a socio-technical development strategy, which ensured close collaboration between software developers, spatial planners and designers. It was tested and evaluated in three case studies, which demonstrated its applicability, especially during the initial phases of an interactive spatial planning process.

The PubChem chemical structure sketcher

PubChem is an important public, Web-based information source for chemical and bioactivity information. In order to provide convenient structure search methods on compounds stored in this database, one mandatory component is a Web-based drawing tool for interactive sketching of chemical query structures. Web-enabled chemical structure sketchers are not new, being in existence for years; however, solutions available rely on complex technology like Java applets or platform-dependent plug-ins. Due to general policy and support incident rate considerations, Java-based or platform-specific sketchers cannot be deployed as a part of public NCBI Web services. Our solution: a chemical structure sketching tool based exclusively on CGI server processing, client-side JavaScript functions, and image sequence streaming. The PubChem structure editor does not require the presence of any specific runtime support libraries or browser configurations on the client. It is completely platform-independent and verified to work on all major Web browsers, including older ones without support for Web2.0 JavaScript objects.

Peek‐in‐the‐Pic: Flying Through Architectural Scenes From a Single Image*

Abstract Many casually taken ‘tourist’ photographs comprise of architectural objects like houses, buildings, etc. Reconstructing such 3D scenes captured in a single photograph is a very challenging problem. We propose a novel approach to reconstruct such architectural scenes with minimal and simple user interaction, with the goal of providing 3D navigational capability to an image rather than acquiring accurate geometric detail. Our system, Peek‐in‐the‐Pic, is based on a sketch‐based geometry reconstruction paradigm. Given an image, the user simply traces out objects from it. Our system regards these as perspective line drawings, automatically completes them and reconstructs geometry from them. We make basic assumptions about the structure of traced objects and provide simple gestures for placing additional constraints. We also provide a simple sketching tool to progressively complete parts of the reconstructed buildings that are not visible in the image and cannot be automatically completed. Finally, we fill holes created in the original image when reconstructed buildings are removed from it, by automatic texture synthesis. Users can spend more time using interactive texture synthesis for further refining the image. Thus, instead of looking at flat images, a user can fly through them after some simple processing. Minimal manual work, ease of use and interactivity are the salient features of our approach.

Sketching interfaces: toward more human interface design

Researchers at University of California, Berkeley and Carnegie Mellon University have designed, implemented, and evaluated SILK (Sketching Interfaces Like Krazy), an informal sketching tool that combines many of the benefits of paper-based sketching with the merits of current electronic tools. With SILK, designers can quickly sketch an interface using an electronic pad and stylus, and SILK recognizes widgets and other interface elements as the designer draws them. Unlike paper-based sketching, however, designers can exercise these elements in their sketchy state. For example, a sketched scroll-bar is likely to contain an elevator or thumbnail, the small rectangle a user drags with a mouse. In a paper sketch, the elevator would just sit there, but in a SILK sketch, designers can drag it up and down, which lets them test component or widget behavior. SILK also supports the creation of storyboards-the arrangement of sketches to show how design elements behave, such as how a dialog box appears when the user activates a button. Storyboards are important because they give designers a way to show colleagues, customers, or end users early on how an interface will behave.

Multimodal tool support for creative tasks in the visual arts

This paper presents an investigation into computer tool support for creative tasks in the visual arts, in particular sketching. The research draws from both theoretical models of creative processes and empirical observations of sketching activity in the domain of character development in animation and illustration. These sources show that creative problem solving through sketching is a highly iterative process during which various constraints are rapidly evolving and being adapted to. A set of requirements for an experimental, multimodal sketching tool was developed, drawing from our theoretical and empirical studies. In order to support the intense, rapid nature of the task, voice input was implemented allowing the user to access functionality without interrupting the hand activity. The multimodal tool also included radial marking menus in order to provide rapid navigation to functionality. Informal evaluations were conducted that provided qualitative feedback about the use of the system.