Finger Gestures Research Articles

Finger-based Gestural Interaction for Exploration of 3D Heart Visualization

Interaction with medical visualization is one of attractive research topics in human computer interaction and medical visualization. Controlling the volume visualization for 3D heart is one of the useful applications for clinician to produce an efficient ways on analysing the behaviour of heart. In this paper, we use some scenarios to develop a gesture control system using finger gesture to give more natural way to interact with the 3D cardiac model besides helping to reduce user cognition in using the system. We had proposed several gesture techniques that only require the user to move their finger in interacting with model. This paper also will focus on how to interacting with the cardiac model with finger gestures and advantages of using finger gestures in helping the diagnosis part besides having several drawbacks that can be solved in the future.

Deficits in motor abilities and developmental fractionation of imitation performance in high-functioning autism spectrum disorders

The co-occurrence of motor and imitation disabilities often characterises the spectrum of deficits seen in patients with autism spectrum disorders (ASD). Whether these seemingly separate deficits are inter-related and whether, in particular, motor deficits contribute to the expression of imitation deficits is the topic of the present study and was investigated by comparing these deficits' cross-sectional developmental trajectories. To that end, different components of motor performance assessed in the Zurich Neuromotor Assessment and imitation abilities for facial movements and non-meaningful gestures were tested in 70 subjects (aged 6-29 years), including 36 patients with high-functioning ASD and 34 age-matched typically developed (TD) participants. The results show robust deficits in probands with ASD in timed motor performance and in the quality of movement, which are all independent of age, with one exception. Only diadochokinesis improves moderately with increasing age in ASD probands. Imitation of facial movements and of non-meaningful hand, finger, hand finger gestures not related to social context or tool use is also impaired in ASD subjects, but in contrast to motor performance this deficit overall improves with age. A general imitation factor, extracted from the highly inter-correlated imitation tests, is differentially correlated with components of neuromotor performance in ASD and TD participants. By developmentally fractionating developmentally stable motor deficits from developmentally dynamic imitation deficits, we infer that imitation deficits are primarily cognitive in nature.

Macroscopic acoustoelectric charge transport in graphene

We demonstrate macroscopic acoustoelectric transport in graphene, transferred onto piezoelectric lithium niobate substrates, between electrodes up to 500 μm apart. Using double finger interdigital transducers we have characterised the acoustoelectric current as a function of both surface acoustic wave intensity and frequency. The results are consistent with a relatively simple classical relaxation model, in which the acoustoelectric current is proportional to both the surface acoustic wave intensity and the attenuation of the wave caused by the charge transport.

GaFinC: Gaze and Finger Control interface for 3D model manipulation in CAD application

Natural and intuitive interfaces for CAD modeling such as hand gesture controls have received a lot of attention recently. However, in spite of its high intuitiveness and familiarity, their use for actual applications has been found to be less comfortable than a conventional mouse interface because of user physical fatigue over long periods of operation. In this paper, we propose an improved gesture control interface for 3D modeling manipulation tasks that possesses conventional interface level usability with low user fatigue while maintaining a high level of intuitiveness. By analyzing problems associated with previous hand gesture controls in translation, rotation and zooming, we developed a multi-modal control interface GaFinC: Gaze and Finger Control interface. GaFinC can track precise hand positions, recognizes several finger gestures, and utilizes an independent gaze pointing interface for setting the point of interest. To verify the performance of GaFinC, tests of manipulation accuracy and time are conducted and their results are compared with those of a conventional mouse. The comfort and intuitiveness level are also scored by means of user interviews. As a result, although the GaFinC interface posted insufficient performance in accuracy and times compared with a mouse, it shows applicable level performance. Also users found it to be more intuitive than a mouse interface while maintaining a usable level of comfort.

Infrared Camera-Based Hand Gesture Space Touch System Implementation of Smart Device Environment

This paper proposes a method to recognize the tip of a finger and space touch hand gesture using an infrared camera in a smart device environment. The proposed method estimates the tip of a finger with a curvature-based ellipse fitting algorithm, and verifies that the estimated object is indeed a finger with an ellipse fitting rectangular area. The feature extracted from the verified finger tip is used to implement the movement of a mouse and clicking gesture. The proposed algorithm was implemented with an actual smart device to test the proposed method. Empirical parameters were obtained from the keypad software and an image analysis tool for the performance optimization, and a comparative analysis with conventional research showed improved performance with the proposed method. Keywords—Infrared camera, Hand gesture, Smart device, Space touch.

Radical-stroke-based Chinese input method using dynamic radical keypad on touchscreen smartphones

This paper presents a new Chinese input method that utilises finger gestures for improving stroke-based input method on touchscreen devices. It is a radical-stroke (RS) based method with a dynamic radical keypad (DRK), in which single radical multiple strokes coding is used. It speeds up the input of complex Chinese characters by simply sliding a finger. Experimental results show that the proposed RS–DRK outperforms the conventional Chinese input methods on an Android platform.

MagiThings

The theory of around device interaction (ADI) has recently gained a lot of attention in the field of human computer interaction (HCI). As an alternative to the classic data entry methods, such as keypads and touch screens interaction, ADI proposes a touchless user interface that extends beyond the peripheral area of a device. In this paper, the authors propose a new approach for around mobile device interaction based on magnetic field. Our new approach, which we call it “MagiThings”, takes the advantage of digital compass (a magnetometer) embedded in new generation of mobile devices such as Apple’s iPhone 3GS/4G, and Google’s Nexus. The user movements of a properly shaped magnet around the device deform the original magnetic field. The magnet is taken or worn around the fingers. The changes made in the magnetic field pattern around the device constitute a new way of interacting with the device. Thus, the magnetic field encompassing the device plays the role of a communication channel and encodes the hand/finger movement patterns into temporal changes sensed by the compass sensor. The mobile device samples momentary status of the field. The field changes, caused by hand (finger) gesture, is used as a basis for sending interaction commands to the device. The pattern of change is matched against pre-recorded templates or trained models to recognize a gesture. The proposed methodology has been successfully tested for a variety of applications such as interaction with user interface of a mobile device, character (digit) entry, user authentication, gaming, and touchless mobile music synthesis. The experimental results show high accuracy in recognizing simple or complex gestures in a wide range of applications. The proposed method provides a practical and simple framework for touchless interaction with mobile devices relying only on an internally embedded sensor and a magnet.

3차원 추적영역 제한 기법을 이용한 손 동작 인식 시스템

본 논문에서는 손 추적과 제스처 인식 시스템을 제안한다. 제안한 시스템은 사용자 손의 3차원 기하학적 정보를 취득하기 위해 별도의 장비를 사용한다. 특히, 기존의 물체 검출 및 추적 시스템들에서 제기 되었던 추적 과정에서의 문제점을 피하기 위해 능동적인 타원체 영역을 만들고 손 추적을 위한 영역을 타원체 영역의 안으로 제한했다. 제안된 시스템은 미리 정의된 기간 동안에 손 위치의 이동평균을 계산한다. 그리고 추적영역은 3차원 공간에 편성된 공분산에 기반한 사용자 손 움직임의 불확실성을 추정하여 통계적인 데이터에 따라 능동적으로 제어하였다. 또한 손 위치가 획득되었을 때, 손 제스처를 인식하기 위해 펼쳐진 손가락을 검출한다. 사용자 인터페이스 체제 기반의 시스템을 구현하여 복잡한 환경에서 다중의 대상들이 동시에 존재하는 경우이거나 일시적인 가려짐이 발생하는 경우에도 정확성을 보여 매우 안정적으로 동작할 수 있음을 보여주며, 약 24-30fps의 프레임 비율로 사용할 수 있는 가능성을 보여주었다.

Extracting Flick Operator for Predicting Performance by GOMS Model in Small Touch Screen

Objective: The purpose of this study is to extract GOMS manual operator, except for an experiment with participants. Background: The GOMS model has advantage of rapid modeling which is suitable for the environment of technology development which has a short life cycle products with a fast pace. The GOMS model was originally designed for desktop environment so that it is not adequate for implementing into the latest HCI environment such as small touch screen device. Therefore, this research proposed GOMS manual operator extraction methodology which is excluded experimental method. And flick Gesture was selected to explain application of proposed methodology to extract new operator. Method: Divide into start to final step of hand gesture needed to extract as an operator through gesture task analysis. Then apply the original GOMS operator to each similar step of gesture and modify the operator for implementation stage based on existing Fitts' law research. Steps that are required to move are modified based on the Fitts' law developed in touch screen device. Finally, new operator can be derived from using these stages and a validation experiment, performed to verify the validity of new operator and methodology by comparing human performance. Results: The average movement times of the participants' performance and the operator which is extracted in case study are not different significantly. Also the average of movement times of each type of view study is not different significantly. Conclusion: In conclusion, the result of the proposed methodology for extracting new operator is similar to the result of the experiment with their participants. Furthermore the GOMS model included the operator by the proposed methodology in this research could be applied successfully to predict the user's performance. Application: Using this methodology could be applied to develop new finger gesture in the touch screen. Also this proposed methodology could be applied to evaluate the usability of certain system rapidly including the new finger gesture performance.

Invisible touch—Control of a DICOM viewer with finger gestures using the Kinect depth camera

With the increasing use of imaging technologies during surgeries and autopsies, new control methods for computer systems are required to maintain sterility. Gesture controlled systems seem to be promising, since they allow for a touch-free control of computer systems. In a previous publication we presented a system which allows the control of the open source Picture Archiving and Communication System (PACS) OsiriX by means of gesture and voice commands. In order to overcome the limitations of this system, we developed a plug-in for OsiriX that allows for gesture control of the DICOM viewer of OsiriX with finger gestures.

Online Finger Gesture Recognition Using Surface Electromyography Signals

The analysis on the online finger gesture recognition using multi-channel sEMG signals was explored in this paper. Nine types of gestures were applied to be identified, involving six kinds of numerical finger gestures and three kinds of hand gestures. The time domain parameters were extracted to be the features. And then, the probabilistic neural network was utilized to classify the proposed gestures with the extracted features. The experimental results showed that most of gestures could acquire the acceptable classification performance and a few elaborate gestures were hard to acquire the effective identification.

智能化交互人体表面特征点三维运动轨迹检测技术的研究

Three dimensional space coordinate real-time measurement is one of key and basic techniques in non-contact、high efficient and natural man-machine interaction.Algorithm can locate the tip of finger based on shape restrain feature of finger and hand gesture on the contour of skin hue region.Face region is recognized by Adaboost algorithm.According to whether wearing strong interference glass,different algorithm based on gray scale and space structure are used to accurately locate the center of eyes.The light trace algorithm is improved by tracing the certain feature points(inside corner points of left and right eyes or inside frame curvature points of black frame glass).Algorithm increases the location accuracy of feature points by multiscale step location method.The three dimensional coordinate of feature points is reconstructed based on binocular stereo vision,and the light trace with error can be restarted by three dimensional information feedback.Algorithm combines feature and statistics methods,synthetically applies multiscale and multi-source information.Compared to traditional algorithm,the time efficiency and the accuracy ratio of object feature points recognization in multiple situation(strong interference wearing,gesture change in big angle,shelter,illumination)in complex backgroud picture are increased.

A novel soft keyboard for touchscreen phones: QWERT

The popularity of touchscreen phones has been growing around the world since the iPhones and Android phones were released. More and more mobile phones with large touchscreen have been produced, however, the phones with small size displays are still in the majority of touch phones. The foremost interface on touch smartphones is the information input module using soft keyboards. Traditional input methods on touch phones have either too small key buttons (such as QWERTY) or too many functions (such as 3$\times$4 keyboard), which are inconvenient to use. Moreover, the conventional soft keyboards only use tapping to input texts while current touch smartphones allow various gestures on the touchscreen, such as sliding. In this paper, a novel soft keyboard called QWERT is proposed for touchscreen-based smartphones. The users can interact with phones via finger gestures of tapping or sliding when input text by using the QWERT. In doing so, the interactions between users and smartphones will be faster and easier. An experiment carried out on inexperienced human subjects shows that they can learn very fast due to their familiarities with QWERTY. A simulation experiment based on a cognitive architecture, ACT-R, was also conducted to predict the movement time (MT) of experienced human subjects. The simulation results show that the MT using QWERT outperforms other default keyboards. These outcomes imply that the novel QWERT is a viable option for touch smartphone users. Based on the novel design, an application is released on Android systems. This application is expected to give better user experience for customers who use touch smartphones.

2-Dimensional Finger Gesture Based Mobile Robot Control Using Touch Screen

The purpose of this study was to present a reliable mean for human-computer interfacing based on finger gestures made in two dimensions, which could be interpreted and adequately used in controlling a remote robot's movement. The gestures were captured and interpreted using an algorithm based on trigonometric functions, in calculating the angular displacement from one point of touch to another as the user’s finger moved within a time interval; thereby allowing for pattern spotting of the captured gesture. In this paper the design and implementation of such a gesture based user interface was presented, utilizing the aforementioned algorithm. These techniques were then used to control a remote mobile robot's movement. A resistive touch screen was selected as the gesture sensor, then utilizing a programmed microcontroller to interpret them respectively.

A Comparison of the Characteristics between Single and Double Finger Gestures for Web Browsers

Objective: The purpose of this study is to compare the characteristics of single and double finger gestures related on the web browser and to extract the appropriate finger gestures. Background: As electronic equipment emphasizes miniaturization for improving portability various interfaces are being developed as input devices. Electronic devices are made smaller, the gesture recognition technology using the touch-based interface is favored for easy editing. In addition, user focus primarily on the simplicity of intuitive interfaces which propels further research of gesture based interfaces. In particular, the fingers in these intuitive interfaces are simple and fast which are users friendly. Recently, the single and double finger gestures are becoming more popular so more applications for these gestures are being developed. However, systems and software that employ such finger gesture lack consistency in addition to having unclear standard and guideline development. Method: In order to learn the application of these gestures, we performed the sketch map method which happens to be a method for memory elicitation. In addition, we used the MIMA(Meaning in Mediated Action) method to evaluate gesture interface. Results: This study created appropriate gestures for intuitive judgment. We conducted a usability test which consisted of single and double finger gestures. The results showed that double finger gestures had less performance time faster than single finger gestures. Single finger gestures are a wide satisfaction difference between similar type and difference type. That is, single finger gestures can judge intuitively in a similar type but it is difficult to associate functions in difference type. Conclusion: This study was found that double finger gesture was effective to associate functions for web navigations. Especially, this double finger gesture could be effective on associating complex forms such as curve shaped gestures. Application: This study aimed to facilitate the design products which utilized finger and hand gestures.

Crystal Structures of the Scaffolding Protein LGN Reveal the General Mechanism by Which GoLoco Binding Motifs Inhibit the Release of GDP from Gαi

GoLoco (GL) motif-containing proteins regulate G protein signaling by binding to Gα subunit and acting as guanine nucleotide dissociation inhibitors. GLs of LGN are also known to bind the GDP form of Gα(i/o) during asymmetric cell division. Here, we show that the C-terminal GL domain of LGN binds four molecules of Gα(i)·GDP. The crystal structures of Gα(i)·GDP in complex with LGN GL3 and GL4, respectively, reveal distinct GL/Gα(i) interaction features when compared with the only high resolution structure known with GL/Gα(i) interaction between RGS14 and Gα(i1.) Only a few residues C-terminal to the conserved GL sequence are required for LGN GLs to bind to Gα(i)·GDP. A highly conserved "double Arg finger" sequence (RΨ(D/E)(D/E)QR) is responsible for LGN GL to bind to GDP bound to Gα(i). Together with the sequence alignment, we suggest that the LGN GL/Gα(i) interaction represents a general binding mode between GL motifs and Gα(i). We also show that LGN GLs are potent guanine nucleotide dissociation inhibitors.

Indirect Touch Pointing with Desktop Computing: Effects of Trackpad Size and Input mapping on Performance, Posture, Discomfort, and Preference

Multi-touch trackpads have the advantage over traditional pointing devices (mice) in being able to recognize and act on finger gestures, such as pinching, rotating, and swiping. The primary objective of this study was to quantify the effects of desktop-trackpad size and input mapping on performance, posture and discomfort. Three trackpad sizes (112X63 mm, 178X100 mm, 230 X130 mm) and two types of input mapping, the traditional relative mapping with ‘cursor acceleration’ and absolute mapping, were tested. Subjects performed a series of target acquisition tasks (drag and select) while the dependent variables were recorded. Results suggest that peripheral indirect-touch pointing devices with a width between 112 and 178 mm and a depth between 63 and 100 mm may provide an appropriate balance between cost, footprint, performance, and comfort.

Magic Ring: A Finger-Worn Device for Multiple Appliances Control Using Static Finger Gestures

An ultimate goal for Ubiquitous Computing is to enable people to interact with the surrounding electrical devices using their habitual body gestures as they communicate with each other. The feasibility of such an idea is demonstrated through a wearable gestural device named Magic Ring (MR), which is an original compact wireless sensing mote in a ring shape that can recognize various finger gestures. A scenario of wireless multiple appliances control is selected as a case study to evaluate the usability of such a gestural interface. Experiments comparing the MR and a Remote Controller (RC) were performed to evaluate the usability. From the results, only with 10 minutes practice, the proposed paradigm of gestural-based control can achieve a performance of completing about six tasks per minute, which is in the same level of the RC-based method.

Gestural Interaction in Vehicular Applications

In-vehicle gestural interfaces are easy to use and increase safety by reducing visual demand on the driver. Prototype capacitive proximity sensing and depth-camera-based systems demonstrate that current technologies can recognize finger and hand gestures of varying complexity.

2P1-O02 指の擬人的な動作を用いた歩行ロボットへの操作手法(VRとインタフェース)

We propose an operating method for bipedal robots by using two-fingered gestures on a multi-touch surface. We focus on finger gestures that people represent the human with moving fingers, such as walking, running, kicking and turning. These bipedal gestures are natural and intuitive enough for the end-users to control the humanoid robots. The system captures those finger gestures on a multi-touch display as the direct operation method. The capturing method is easy and simple, but robust enough for the entertainment applications. We show an example application with our proposed method, and demonstration at the international exhibition. We conclude with the results of observation and future implementation of our method.