Finger Gestures Research Articles

On free-hand TV control: experimental results on user-elicited gestures with Leap Motion

We present insights from a gesture elicitation study conducted for TV control, during which 18 participants contributed gesture commands and rated the execution difficulty and recall likeliness of free-hand gestures for 21 television control tasks. Our study complements previous work on gesture interaction design for the TV set with the first exploration of fine-grained resolution 3-D finger movements and hand gestures. We report lower agreement rates than previous gesture studies ( $${\mathcal {AR}}=.158$$ ) with 72.8 % recall rate and 15.8 % false positives, results that are explained by the complexity and variability of unconstrained finger and hand gestures. However, our observations also confirm previous findings, such as people preferring related gestures for dichotomous tasks and more disagreement occurring for abstract tasks, such as “open browser” or “show the list of channels” for our specific TV scenario. To reach a better understanding of our participants’ preferences for articulating finger and hand gestures, we defined five measures for Leap Motion gestures, such as gesture volume and finger-to-palm distance, which we employed to evaluate gestures performed by our participants. We also contribute a set of guidelines for practitioners interested in designing free-hand gestures for interactive TV scenarios involving similar gesture acquisition technology. We release our dataset consisting in 378 Leap Motion gestures described by fingertips position, direction, and velocity coordinates to foster further studies in the community. This first exploration of viewers’ preferences for fine-grained resolution free-hand gestures for TV control represents one more step toward designing low-effort gesture interfaces for lean-back interaction with the TV set.

Design, simulation and testing of capacitive micromachined ultrasound transducer-based phospholipidic biosensor elements

In this study we present theoretical proof of the principle of using interdigital capacitive micromachined ultrasound transducers (CMUT IDTs) for the detection of phospholipid membrane elasticity. Proof of principle was needed to find out whether the new type of microelectromechanical sensors of the toxins incorporated with the lipid membranes was feasible. CMUT IDTs for 10 MHz operation in water, with 146 µm spaced double fingers were designed and fabricated using the surface micromachining technique. Fabricated CMUTs were tested for their resonance in air and for Scholte-type wave transmission in deionized water and isopropanol solutions containing 0%, 10% and 20% water. The amplitude and phase velocity of the excited and received Scholte waves were measured in a 200 µm height microchannel, capped with a thick layer of soft polymer, which suppressed the production of non-informative guided waves. It was determined that the average sensitivity of Scholte wave phase velocity within the given range of solution concentrations is 2.9 m s−1 per one percent. Experimental data were also used to verify the adequacy of the finite element model, which was found to be suitable for reliable prediction of the phospholipid membrane elasticity impact on the Scholte wave phase velocity or the resonance frequency in the present IDT structure. It was determined that for the analyzed conditions (the elasticity of simulated phospholipid membrane changed from 1 to 5 GPa) the sensitivity of the measurement channel is expected to be no worse than 2 kHz GPa−1 in terms of the Scholte wave and CMUT IDT resonance frequency. This leads to a positive conclusion on the feasibility of the new sensor type.

An intelligent skin based self-powered finger motion sensor integrated with triboelectric nanogenerator

Tracking human gestures and movement is crucial for development of advanced input technologies and human computer interfaces. In this paper we demonstrate a novel flexible, low cost and wearable self-powered motion sensor to detect human finger motion for static positions and dynamic motion. As the finger moves to different positions, the capacitance between finger skin and device electrode changes. The device uses the change in capacitive coupling with human skin (epidermis) to measure the static and dynamic positions of finger. It is proposed that the device can utilize low frequency electric fields generated by the household power lines and equipment to passively sense the human finger movement. The device also acts as a triboelectric nanogenerator using outer epidermis as an active triboelectric layer for surface charge generation. It is shown to generate a maximum voltage of 70V and a current area density of 2.7μA/cm2 at a load resistance of 5MΩ. As a demonstration of a new approach for detection of static finger gestures and dynamic motion which is self-powered and intuitive, this work contributes towards development of self-powered sensors for human computer interfacing and osteoarthritis rehabilitation applications.

Purwarupa Pengoperasian TV Dengan Mendeteksi Isyarat Jari Berbasis Pengolahan Citra Digital

Abstrak Perkembangan teknologi komputer dan elektronika yang sangat pesat saat ini membuat manusia mulai mencari solusi lain untuk melakukan kegiatan menjadi lebih mudah dan praktis. Teknologi-teknologi yang berkembang dan dapat dimanfaatkan saat ini sangat memungkinkan manusia untuk memudahkan aktifitas dalam mengoperasikan TV dengan isyarat jari. Dalam penelitian ini, pengolahan citra digital merupakan teknologi yang digunakan untuk mengoperasikan TV dengan memanfaatkan webcam dan komputer sebagai pengolah citra. Input dari penelitian ini berupa citra tangan hasil tangkapan webcam pada komputer. Kemudian citra tangan diolah melalui sistem pengolah citra untuk mendapatkan hasil berupa nilai pada jari tangan. Nilai tersebut menunjukkan angka yang sama dengan jumlah jari tangan yang terdeteksi oleh webcam pada layar monitor. Mikrokontroler berfungsi menerima data serial dari hasil pemrosesan citra tangan dan berfungsi sebagai konversi nilai data serial menjadi instruksi yang dapat mengoperasikan TV. Model warna yang dipakai adalah model HSV. Langkah awal pengujian pada penelitian ini dilakukan dengan setting ruangan agar pengambilan citra mendapatkan hasil yang terbaik pada setiap ruangan. Hasil dari pengujian ini didapatkan nilai yang terbaik untuk pengoperasian TV dengan isyarat jari yaitu : untuk nilai intensitas cahaya sebesar 12 lux, nilai jarak terbaik sebesar 70 cm dan background terbaik berupa warna biru. Kata kunci— TV, pengolahan citra, model warna HSV Abstract The development computer technology and electronics very rapidly at this time makes people start looking for other solutions to perform activities easier and more practical. Technologies are developed and can be used at this time it is possible to facilitate the activities human beings to operate TV with finger gesture. In this research, digital image processing of technology can be used to operate TV using webcam and computer as image processing. Input this research is hand image that catched by webcam on computer. Then hand image processed through image processing system to obtain results form value fingers. This value indicates the number equal to number fingers detected by webcam camera on monitor screen. Microcontroller function is receives serial data from results image processing and serves serial data conversion value into instructions can operate TV. Color model used in research is HSV. First step testing this research is setting room in order to capture image for get best results in any room. Results of the research found best value for testing operation TV with finger gesture is : for value light intensity is 12 lux, best distance is 70 cm and best baskground is blue. Keywords— TV, image processing, HSV color model

Arterial segments as microvascular interposition grafts in venous anastomosis in digital replantations.

Introduction:Microvascular anastomosis is a crucial procedure in replantation surgeries. Venous insufficiency is one of the most consistent cause of failure or re-exploration in these surgeries necessitating the use of venous grafts.Materials and Methods:We discuss our study of 9 such replantation surgeries executed in calendar year 2013-2014, including a double finger replantation done in the same patient having total amputation of 4 fingers of the same (right) hand, in which an arterial segment was used as a microvascular interposition graft for venous anastomosis. Out of these 9 surgeries, 3 were re-exploration procedures for venous compromise and 6 were successful primary replantations.Results:In all, 8 replants were successful and one failed due to arterial compromise.Discussion:In our experience and extensive review of the previously available literature, we would like to portray the advantages of arterial segments as microvascular grafts in replant surgeries. Specifically, in a crush amputation injury for which the use of a vascular interposition graft is being contemplated. If any other digit is also amputated and is unsuitable for replantation, it can act as a potential donor site to harvest the arterial segment. However, when dealing with single finger amputation, the surgeon must be confident about the single digital arterial anastomosis, before harvesting the second digital artery as a microvascular graft.Conclusion:In our study, we found the use of arterial grafts in microvascular anastomosis of veins advantageous, as arterial segments have better ability to resist spasm due to environmental changes, better pressure tolerance as compared to venous segments, and provide an appropriate calibre match and ease of harvest in the same operative field.

Fine Line Double Printing and Advanced Process Control for Cell Manufacturing

In this paper the latest applications of screen printing technology for solar cell metallization are reviewed. The principal achievement is 36 μm Double Printing finger width allowing +0.2% absolute efficiency gain compared to baseline Single Printing process. Dedicated rheology analysis of Ag pastes and measurements of equivalent optical finger width have been performed to have a better understanding of optimal process conditions, together with Stencil Printing experiments, showing the viability of Stencil Printing only for laboratory applications. In the last section, Advanced Printing Control is introduced as a potential enabler of controlled deposit on fingers and busbars, aiming at an increased process window and further cost savings.

공중 손동작 인식을 위한 핸드 헬드형 기기의 설계 및 평가

We propose AirPincher, a handheld pointing device for recognizing delicate mid-air hand gestures to control a remote display. AirPincher is designed to overcome disadvantages of the two kinds of existing hand gesture-aware techniques such as glove-based and vision-based. The glove-based techniques cause cumbersomeness of wearing gloves every time and the vision-based techniques incur performance dependence on distance between a user and a remote display. AirPincher allows a user to hold the device in one hand and to generate several delicate finger gestures. The gestures are captured by several sensors proximately embedded into AirPincher. These features help AirPincher avoid the aforementioned disadvantages of the existing techniques. We experimentally find an efficient size of the virtual input space and evaluate two types of pointing interfaces with AirPincher for a remote display. Our experiments suggest appropriate configurations to use the proposed device.

Double-finger-gate controlled spin-resolved resonant quantum transport in the presence of a Rashba–Zeeman gap

We investigate double finger gate (DFG) controlled spin-resolved resonant transport properties in an n-type quantum channel with a Rashba–Zeeman (RZ) subband energy gap. By appropriately tuning the DFG in the strong Rashba coupling regime, resonant state structures in conductance can be found that are sensitive to the length of the DFG system. Furthermore, a hole-like bound state feature below the RZ gap and an electron-like quasi-bound state feature at the threshold of the upper spin branch can be found that is insensitive to the length of the DFG system.

Finger musical gesture recognition in 3D space without any tangible instrument for performing arts

This paper proposes a marker–less computer vision methodology for the simultaneous recognition of complex finger musical gestures performed in space without any tangible musical instrument. Image analysis techniques are applied in order to detect and identify the fingertips on a video. Scale and rotation invariance techniques are also applied. The finger gesture recognition and prediction is based on the stochastic modelling of the extracted high–level features with the help of hidden Markov models and Gaussian mixture models. The applications concern directly the finger gesture control of sound in performing arts. The proposed system can be considered in the long term as an intangible musical instrument that implies 'everyday gestures' and reduces the gap between non–musicians or blind people and music.

Resistive-based Sensor System for Prosthetic Fingers Application

Amputees seldom experience from physical difficulties due to their incapability to use their extremities. To aid the amputees in acquiring an operative replacement fingers at a feasible cost, a 3D printed prosthetic fingers model interfaced with Readout Interfacing Circuit (ROIC) and a microcontroller is presented. A resistive-voltage as well as sensitive active bridge circuit for ROIC has been proposed for measuring very small resistance changes of a tactile sensor attributable to vary the gestures of the prosthetic fingers. To allow more than one prosthetic fingers’ motion, two servo motors are embedded which offers two choices of gestures depending on the resistance of the tactile sensor. An experimental result of ROIC has been compared with conventional bridge circuit. The result reveals that the active bridge circuit is more sensitive than conventional full bridge circuit.

Impaired imitation of gestures in mild dementia: comparison of dementia with Lewy bodies, Alzheimer's disease and vascular dementia

IntroductionTo examine whether imitation of gestures provided useful information to diagnose early dementia in elderly patients.MethodsImitation of finger and hand gestures was evaluated in patients with mild dementia; 74 patients...

3차원 공간에서 손가락 제스쳐 인터랙션을 이용한 간접제어의 사용성에 관한 실험연구

3차원 공간에서 손가락 제스쳐 인터랙션을 이용한 간접제어의 사용성에 관한 실험연구

Regulation of autophagy by E3 ubiquitin ligase RNF216 through BECN1 ubiquitination

Autophagy is an evolutionarily conserved biological process involved in an array of physiological and pathological events. Without proper control, autophagy contributes to various disorders, including cancer and autoimmune and inflammatory diseases. It is therefore of vital importance that autophagy is under careful balance. Thus, additional regulators undoubtedly deepen our understanding of the working network, and provide potential therapeutic targets for disorders. In this study, we found that RNF216 (ring finger protein 216), an E3 ubiquitin ligase, strongly inhibits autophagy in macrophages. Further exploration demonstrates that RNF216 interacts with BECN1, a key regulator in autophagy, and leads to ubiquitination of BECN1, thereby contributing to BECN1 degradation. RNF216 was involved in the ubiquitination of lysine 48 of BECN1 through direct interaction with the triad (2 RING fingers and a DRIL [double RING finger linked]) domain. We further showed that inhibition of autophagy through overexpression of RNF216 in alveolar macrophages promotes Listeria monocytogenes growth and distribution, while knockdown of RNF216 significantly inhibited these outcomes. These effects were confirmed in a mouse model of L. monocytogenes infection, suggesting that manipulating RNF216 expression could be a therapeutic approach. Thus, our study identifies a novel negative regulator of autophagy and suggests that RNF216 may be a target for treatment of inflammatory diseases.

Assisted Research of the Biomechanics Characteristics of the Complex Acrobatic Movement

This paper is meant to highlight the biomechanical features of the technique key elements of the back layout somersault with 720° twist on floor at the level of junior girl gymnasts aged 12 to 14 years. This scientific approach led to the organization of a study conducted during the National Master Championship held from 16th to 18th of November 2012 in Nadia Comăneci Multifunctional Hall of Onești. A number of 8 gymnasts aged 12 to 14, members of the training junior team of Deva, participated in this study. The following methods have been used throughout this research: method of bibliographic study, method of pedagogical observation, method of video biomechanical analysis, using Physics Toolkit program, experimental method, statistical method (KyPlot) and method of graphical representation. The results of the kinematic features of sports technique key elements used in back layout somersault with 720° twist on floor highlight the phasic sequence of the execution, concerning the preparatory movement made from round-off back flip connection, moment of flip off of the floor, multiplication of body posture and the concluding posture - landing. The analytical video biomechanical processing of each segment pointed out the spatial - temporal indicators characteristics of sports technique key elements used in the back layout somersault with 720° twist on floor, according to the data on joints trajectories movement and the graphical representation of the whole body segments of junior gymnasts aged 12 to 14; the somersaults were performed under the conditions of National Master Championship of Artistic Gymnastics 2012. The effective use of the video biomechanical analysis method for the back layout somersault with 720° twist highlighted the kinematic and dynamic features of sports technique key elements in accordance with the performances achieved in competitions

Out of touch – A plugin for controlling OsiriX with gestures using the leap controller

Abstract Objectives In recent years, different systems for gesture control of medical devices have been presented. Today, low-cost gesture control systems are commercially available. In this article, we present a plugin for the OsiriX medical image viewer, which operates the viewer using finger gestures. Materials and methods We use a device called the Leap controller for gesture control input. The device has a low cost, and it uses structured light to create a depth image of the screen. The drivers provided by the manufacturer allow for easy integration into existing software projects. The presented plugin features gestures for panning, zooming, windowing and browsing of medical image datasets. Conclusion Gesture control technology is becoming increasingly robust and available. We therefore expect that gesture control solutions will be increasingly implemented in medical environments. For broad acceptance of such technologies, standard gestures for certain actions should be standardized in the future.

Threshold selection and adjustment for online segmentation of one-stroke finger gestures using single tri-axial accelerometer

Online segmentation of continuous gestures is a key issue in accelerometer-based gesture recognition. The challenge is to segment short-duration, ambiguous, and individually different gestures by an accurate method for online applications. In this paper, we propose a threshold-based method for the online segmentation of one-stroke gestures using a single tri-axial accelerometer on a finger. The method first obtains a proper initial threshold based on Bayes decision theory to ensure accurate initial segmentation, and then an adaptation mechanism is designed to automatically adjust the threshold to improve user-dependent accuracy. A dataset of over 1,200 samples from 12 gestures and 25 subjects is created for evaluation. The results show that our method achieves high segmentation precision/recall and high user-dependent adaptability with low computational complexity.

Preliminary observation on a modified postoperative therapeutic scheme following digit replantation

Objective To observe the survival rate and incidence of vascular crisis following a modified postoperative treatment scheme for finger replantation and investigate the rationale and practicability of this scheme.Methods From February 2012 to May 2013,105 cases (129 digits) of single or double finger replantation were involved in the study.Among them 46 cases (55 digits) were treated with the modified postoperative therapeutic scheme.Low molecular weight dextran was not administered as part of the anticoagulant treatment.After 3 days of absolute bed rest,patients with stable blood perfusion of the replanted fingers were allowed to get up to eat and use the bathroom.They started ambulating in the hospital ward freely 5 days postoperatively.The other 59 cases (74 digits)were treated with the conventional postoperative scheme with regular anti-infection,anti-coagulation,anti-spasm therapy and absolute bed rest for 7 days.The occurrence of vascular crisis in all the patients was observed and recorded.The results of the two groups were compared statistically.Results The survival rates of replanted fingers between the modified therapeutic group(96.4％) and the conventional group (97.3 ％) were not significantly different (P ＞ 0.05).However,there was significant difference in the postoperative comfort scale(P ＜ 0.05).Conclusion The modified postoperative therapeutic scheme following finger replantation can shorten the length of postoperative bed rest and hospital stay,reduce bed rest associated complications,increase postoperative comfort while not decreasing the survival rate of replanted fingers.It is worth wider clinical application. Key words: Replantation; Finger injuries; Modify

RBR E3 ubiquitin ligases: new structures, new insights, new questions

The RBR (RING-BetweenRING-RING) or TRIAD [two RING fingers and a DRIL (double RING finger linked)] E3 ubiquitin ligases comprise a group of 12 complex multidomain enzymes. This unique family of E3 ligases includes parkin, whose dysfunction is linked to the pathogenesis of early-onset Parkinson's disease, and HOIP (HOIL-1-interacting protein) and HOIL-1 (haem-oxidized IRP2 ubiquitin ligase 1), members of the LUBAC (linear ubiquitin chain assembly complex). The RBR E3 ligases share common features with both the larger RING and HECT (homologous with E6-associated protein C-terminus) E3 ligase families, directly catalysing ubiquitin transfer from an intrinsic catalytic cysteine housed in the C-terminal domain, as well as recruiting thioester-bound E2 enzymes via a RING domain. Recent three-dimensional structures and biochemical findings of the RBRs have revealed novel protein domain folds not previously envisioned and some surprising modes of regulation that have raised many questions. This has required renaming two of the domains in the RBR E3 ligases to more accurately reflect their structures and functions: the C-terminal Rcat (required-for-catalysis) domain, essential for catalytic activity, and a central BRcat (benign-catalytic) domain that adopts the same fold as the Rcat, but lacks a catalytic cysteine residue and ubiquitination activity. The present review discusses how three-dimensional structures of RBR (RING1-BRcat-Rcat) E3 ligases have provided new insights into our understanding of the biochemical mechanisms of these important enzymes in ubiquitin biology.

Method for User Interface of Large Displays Using Arm Pointing and Finger Counting Gesture Recognition

Although many three-dimensional pointing gesture recognition methods have been proposed, the problem of self-occlusion has not been considered. Furthermore, because almost all pointing gesture recognition methods use a wide-angle camera, additional sensors or cameras are required to concurrently perform finger gesture recognition. In this paper, we propose a method for performing both pointing gesture and finger gesture recognition for large display environments, using a single Kinect device and a skeleton tracking model. By considering self-occlusion, a compensation technique can be performed on the user's detected shoulder position when a hand occludes the shoulder. In addition, we propose a technique to facilitate finger counting gesture recognition, based on the depth image of the hand position. In this technique, the depth image is extracted from the end of the pointing vector. By using exception handling for self-occlusions, experimental results indicate that the pointing accuracy of a specific reference position was significantly improved. The average root mean square error was approximately 13 pixels for a 1920 × 1080 pixels screen resolution. Moreover, the finger counting gesture recognition accuracy was 98.3%.

Location Control Techniques of Object via Mapping Gesture on Touch Screen to 3-Dimensional Coordinates

Mobile devices are very popular electronic tools in modern life. Therefore researchers develop new services based on mobile device. The many fields of these services support 3dimensional environment to enhance the feeling of reality. However input facilities equipped in mobile device have constraints to control the location of objects in space simulated by 2dimensional screen. In this paper, we propose new input techniques to control the location of object in 3-dimensional space. Our method traces user’s touch and move action on touch screen, decodes actions, and translates into 3-dimensional coordinates. To trace user’s touch and move action, we use one or two fingers gestures. We implement sample Android application adopting our techniques. From our experience of using sample implementations, we can know that our input method can be effectively used to control the location of object in 3-dimensional space.