Special Input Devices Research Articles

Research on Digital Protection Technology of Based on Virtual Reality

VR technology is a simulation of the virtual world. Users receive and respond to various sensory stimuli provided by the virtual environment with the help of special output and input devices, and interact with people and objects in the virtual world in a natural way to create an immersive feeling. Based on the virtual reality technology, the tourism intangible cultural heritage that has disappeared can be reproduced in front of people. Three technologies are specifically used. First, the three-dimensional modeling technology makes the real scene virtual reappearance, and produces a fully real three-dimensional effect. Second, three-dimensional panorama technology, which uses panoramic images to represent three-dimensional virtual environment, makes the picture effect more realistic. Third, human-computer interaction technology. After adding the somatosensory device, you can get an almost real interaction experience.

Robust Interactive Method for Hand Gestures Recognition Using Machine Learning

The Hand Gestures Recognition (HGR) System can be employed to facilitate communication between humans and computers instead of using special input and output devices. These devices may complicate communication with computers especially for people with disabilities. Hand gestures can be defined as a natural human-to-human communication method, which also can be used in human-computer interaction. Many researchers developed various techniques and methods that aimed to understand and recognize specific hand gestures by employing one or two machine learning algorithms with a reasonable accuracy. This work aims to develop a powerful hand gesture recognition model with a 100% recognition rate. We proposed an ensemble classification model that combines the most powerful machine learning classifiers to obtain diversity and improve accuracy. The majority voting method was used to aggregate accuracies produced by each classifier and get the final classification result. Our model was trained using a self-constructed dataset containing 1600 images of ten different hand gestures. The employing of canny's edge detector and histogram of oriented gradient method was a great combination with the ensemble classifier and the recognition rate. The experimental results had shown the robustness of our proposed model. Logistic Regression and Support Vector Machine have achieved 100% accuracy. The developed model was validated using two public datasets, and the findings have proved that our model outperformed other compared studies.

Cyber-physical-system for representing a robot end effector

Programming by Demonstration (PbD) is a method to program robots through the performance of a task by humans. Most implementations are online methods that use visual or force feedback of the demonstrator. However, we developed an offline programming approach for PbD with a special input device within an Augmented Reality Environment. Therefore, this paper aims to answer how the characteristics and functionality of the end effector of a jointed-arm robot can be represented by a haptic input device in order to perform PbD. The PbD process is first carried out on a digital twin of the robot, visualized to the user in real physical space by means of augmented reality technology. The programming of the digital twin can later be transferred to the real robot. The haptic input device in this context is the main part of the Cyber-Physical-System (CPS), which enables the user to interact with the virtual robot. Therefore, the specification of the mechanical and software components of the CPS is of main importance. Within this paper, strategies for the implementation of shape and function abstraction, as well as for ensuring communication, have been worked out. The physical shape of the CPS is kept generic and is only subject to ergonomic restrictions. However, Augmented Reality overlays the physical shape with an exact digital image of the end effector used later in the process. Nevertheless, the physical characteristics of the real robot should be represented as real as possible by the CPS. Therefore, the CPS is equipped with various sensors and actuators. With the CPS it is possible to determine contact forces and to manipulate objects to a certain extent in order to teach gripping strategies to the digital twin. An operating system was developed for communication and control of the electronic components. For the validation of the functionality of the CPS an exemplary PbD process was developed, the results were analyzed and evaluated.

Synchronization of Dance Motion Data Acquisition using Motion Capture

Dance is a body activity that unites body movements, art and certain meanings. Dance performances are sometimes only performed at certain times, so that it is not well known by the public, especially young people today, especially classical dance. They are more interested in presenting a more modern culture because of the development of the times and more advanced technology. The lack of public knowledge about current dance moves has encouraged researchers to conduct motion capture research for dance movements using the Kinect sensor. This paper proposes a technique called mechanical motion capture to capture the motion of objects, namely the dance movement Golek Menak which is one of the classical dances in Indonesia. The proposed Kinect motion capture technique requires special input devices such as cameras with the ability to capture motion up to 2000 frames per second. Kinect has the facility of RGB camera and depth sensor (depth sensor). Kinect's advantages over other tools that can capture and track the movements or actions of three - dimensional (3D) objects (humans and animals) accurately, without marking under certain lighting conditions by utilizing depth sensors. The results showed that the Kinect sensor was able to perform motion capture (MOCAP) techniques in dance movements accurately to produce the right body frame with the movement of dance props which subsequently developed the results in various fields, one of which was the development of motion characters for animation. The results of the synchronization of dance motion data and the capture of motion with motion capture then in this study were developed in the animation of dance movements.

Robot-Assisted Minimally Invasive Surgical Skill Assessment—Manual and Automated Platforms

The practice of Robot-Assisted Minimally Invasive Surgery (RAMIS) requires extensive skills from the human surgeons due to the special input device control, such as moving the surgical instruments, use of buttons, knobs, foot pedals and so. The global popularity of RAMIS created the need to objectively assess surgical skills, not just for quality assurance reasons, but for training feedback as well. Nowadays, there is still no routine surgical skill assessment happening during RAMIS training and education in the clinical practice. In this paper, a review of the manual and automated RAMIS skill assessment techniques is provided, focusing on their general applicability, robustness and clinical relevance.

A camera based human computer interaction through virtual keyboard assistant

Human Computer Interaction has evolved with time and exploited almost all the possible relationships that human can have with computers. The present scenario of using the computer is often inaccessible to people with severe motor impairment, which cannot inhabit the traditional keyboard and mouse, and require another specialized input device. A Camera mouse Human-Computer Interface (HCI) based virtual assistant is designed and planned to be evaluated with 15 subjects and hoped to work for individuals with advanced Amyotrophic Lateral Sclerosis (ALS), all of whom were given tasks to execute through the virtual assistant. In the proposed system, this includes primarily, a virtual keyboard with an embedded Internet browser. The virtual keyboard allows users with movement impairments, basically hand movement issues, to directly interact with the computer. The keyboard has varied functions, apart from just typing; namely, searching anything on google, login to social media and checking emails, text to speech facilities and has a database that holds all the basic helper commands for the person. The camera mouse is software that allows people to interact with the computer by registering any part of their body and then using that part as the pointing device to work on the computer system. The participants of the evaluation will be both, subjects that have knowledge about the HCI interface and those completely new to it. We define additional criteria for unrestricted internet access for evaluation of the presented and future internet browsers, Camera based browser provides unrestricted access and enables free web surfing for individuals with motor impairments. This system improves the subject’s quality of life and provides uninterrupted access for the subject to use the computer.

Special Input Devices Integration to LIRKIS CAVE

Abstract LIRKIS CAVE is a unique immersive virtual reality installation with a compact cylinder-based construction and a high-quality stereoscopic video output rendered on twenty 55” Full HD LCD panels. While the video output of the CAVE provides a high level of immersion to a virtual world, its original implementation of peripherals support had a negative impact because of a limited number of supported devices and certain performance issues. In this paper we describe a new, distributed, peripheral devices support implementation for the LIRKIS CAVE, which solves the performance issues and allows for ease of integration of new input devices into the CAVE. We also present a successful integration of a special input device, the Myo armband,which allows a natural and unobtrusive gesture-based control of virtual environments. The integration includes a newly developed control and monitoring application for the Myo, called MLCCS, which utilization is not limited to CAVE systems or virtual reality applications.

Augmented reality usage for prototyping speed up

The integral part of production process in many companies is prototyping. Although, these companies commonly have high quality visualization tools (large screen projections, virtual reality), prototyping was never abandoned. There is a number of reasons. The most important is the possibility of model observation from any angle without any physical constraints and its haptic feedback. The interactivity of model adjustments is important as well. The direct work with the model allows the designers to focus on the creative process more than work with a computer. There is still a problem with a difficult adjustability of the model. More significant changes demand completely new prototype or at least longer time for its realization.The first part of the article describes our approach for solution of this problem by means of Augmented Reality. The merging of the real world model and digital objects allows streamline the work with the model and speed up the whole production phase significantly. The main advantage of augmented reality is the possibility of direct manipulation with the scene using a portable digital camera. Also adding digital objects into the scene could be done using identification markers placed on the surface of the model. Therefore it is not necessary to work with special input devices and lose the contact with the real world model. Adjustments are done directly on the model. The key problem of outlined solution is the ability of identification of an object within the camera picture and its replacement with the digital object. The second part of the article is focused especially on the identification of exact position and orientation of the marker within the picture. The identification marker is generalized into the triple of points which represents a general plane in space. There is discussed the space identification of these points and the description of representation of their position and orientation be means of transformation matrix. This matrix is used for rendering of the graphical objects (e. g. in OpenGL and Direct3D).

Interactive Technologies for Autistic Children: A Review

Recently, there have been considerable advan- ces in the research on innovative information communi- cation technology (ICT) for the education of people with autism. This review focuses on two aims: (1) to provide an overview of the recent ICT applications used in the treat- ment of autism and (2) to focus on the early development of imitation and joint attention in the context of children with autism as well as robotics. There have been a variety of recent ICT applications in autism, which include the use of interactive environments implemented in computers and special input devices, virtual environments, avatars and serious games as well as telerehabilitation. Despite exciting preliminary results, the use of ICT remains limited. Many of the existing ICTs have limited capabilities and perfor- mance in actual interactive conditions. Clinically, most ICT proposals have not been validated beyond proof of concept studies. Robotics systems, developed as interactive devices for children with autism, have been used to assess the child's response to robot behaviors; to elicit behaviors that are promoted in the child; to model, teach and practice a skill; and to provide feedback on performance in specific environments (e.g., therapeutic sessions). Based on their importance for both early development and for building autonomous robots that have humanlike abilities, imitation, joint attention and interactive engagement are key issues in the development of assistive robotics for autism and must be the focus of further research.

Guest Editorial Introduction to the Special Issue on Modern Control for Computer Games

A typical gaming scenario, as developed in the past 20 years, involves a player interacting with a game using a specialized input device, such as a joystic, a mouse, a keyboard, etc. Recent technological advances and new sensors (for example, low cost commodity depth cameras) have enabled the introduction of more elaborated approaches in which the player is now able to interact with the game using his body pose, facial expressions, actions, and even his physiological signals. A new era of games has already started, employing computer vision techniques, brain-computer interfaces systems, haptic and wearable devices. The future lies in games that will be intelligent enough not only to extract the player's commands provided by his speech and gestures but also his behavioral cues, as well as his/her emotional states, and adjust their game plot accordingly in order to ensure more realistic and satisfactory gameplay experience. This special issue on modern control for computer games discusses several interdisciplinary factors that influence a user's input to a game, something directly linked to the gaming experience. These include, but are not limited to, the following: behavioral affective gaming, user satisfaction and perception, motion capture and scene modeling, and complete software frameworks that address several challenges risen in such scenarios.

The Selection of the Appropriate Computer Interface Device for Patients With High Cervical Cord Injury

In order to determine the most suitable computer interfaces for patients with high cervical cord injury, we report three cases of applications of special input devices. The first was a 49-year-old patient with neurological level of injury (NLI) C4, American Spinal Injury Association Impairment Scale (ASIA)-A. He could move the cursor by using a webcam-based Camera Mouse. Moreover, clicking the mouse could only be performed by pronation of the forearm on the modified Micro Light Switch. The second case was a 41-year-old patient with NLI C3, ASIA-A. The SmartNav 4AT which responds according to head movements could provide stable performance in clicking and dragging. The third was a 13-year-old patient with NLI C1, ASIA-B. The IntegraMouse enabling clicking and dragging with fine movements of the lips. Selecting the appropriate interface device for patients with high cervical cord injury could be considered an important part of rehabilitation. We expect the standard proposed in this study will be helpful.

Separation, optimization, miniaturization and signal space. Optimum measurability factors in process analytical chromatography

AbstractThe theory concerning optimum separation conditions with respect to the precision and minimum peak estimation error is extended with the derivation of the conditions for optimum measurability in case of chemical process control, resulting in extremely short columns to be used. High‐speed correlation chromatography (CC) with a special input device is suggested as a solution for the practical problems of these required columns. An example of a one‐second correlogram with a spark modulation input device is shown. An alternative is monitoring chemical processes by multiple input chromatography, applying a polynomial fit procedure. Copyright © 2009 John Wiley & Sons, Ltd.

지체장애학생을 위한 지능형 입력 장치의 설계와 구현

국내에 보급되어 사용 중인 장애인용 정보통신 보조기기의 대부분은 시각장애인을 위한 기기나 소프트웨어이며, 특정 장애 유형과 특정 장애 부위에만 적용 가능한 것들이 대부분이고, 장애정도가 비교적 경도인 장애인의 특수 키보드 또는 특수 마우스 장치가 주류를 이룬다. 이 또한 전체 장애 인구에 비하면 보급률이 매우 낮은 것으로 보고되고 있다. 본 연구에서는 하나의 지능적인 특수 입력장치를 통해 다양한 장애 유형과 장애부위에 적용될 수 있는 새로운 방안을 연구하여, 이를 실제 제품화 가능한 수준으로 설계 및 구현하였다. 또한 이를 토대로 더 보편적인 보조입력 장치의 설계 및 구현 방안을 위한 제안과 향후 연구 방향에 대하여 제안하였다. Most of information and communication assistance machinery and tools for disorder people of Occupied are machinery and tools for a visual impairment person and software, The things which can apply to only a specification disorder type and a specification disorder part are most, A special keyboard or a special mouse device of the handicapped person that disorder rank is comparatively the hardness makes the mainstream. It is reported in diffusion rate being very low if I compare this with total disorder population. I study new 1 plan which it can be applied to various disorder types and disorder parts through an intelligent special input device in a study of a book and, I designed this at the real standard that I could manufacture and incarnated it. In addition, I suggested this in a base for a design of a universal supporting input device and suggestion for the side of incarnation plan and a future study direction.

Face recognition with Zernike moments

AbstractIn recent years, considerable research has been performed on technology for verifying individual identity using human biometrics. In particular, verification technology using facial images has been extensively researched. This is because special input devices are not needed, and there is little of the psychological resistance that is found with fingerprint input. In this paper, the author proposes a method for recognition using the subspace method, and using the Zernike moment, a moment that is invariable during rotation, as a feature vector. The validity of the method is then shown. In addition, the author confirms through experiments the relationship between the circle width of the circular Zernike moment and the recognition rate, as well as between the order of the Zernike moment and the recognition rate. Furthermore, the recognition capacity of each circle is described, and experiments are performed on variations in the recognition rate when the circle with the lowest recognition capacity is eliminated. Finally, experiments comparing the author's approach to other methods are performed. The author shows that equivalent recognition results can be obtained using the Zernike moment as a feature vector whose order is far lower than other feature vectors. © 2003 Wiley Periodicals, Inc. Syst Comp Jpn, 34(10): 26–35, 2003; Published online in Wiley InterScience (www.interscience.wiley.com). DOI 10.1002/scj.10414

Designing special-purpose input devices

For an increasing number of applications, we may be reaching the point of diminishing returns with general purpose computer input devices, such as the keyboard and mouse. At Digital Image Design Incorporated (DID) we've created special purpose input devices to perform tasks that are commonly addressed with software and general purpose devices alone. These more specific devices have led to significant advantages in accomplishing the tasks, and we've developed an approach to designing these devices that I hope will help others in doing similar work.When someone says "Build us a system to speed up computer character animation," the typical solution is purely software. This is not necessarily optimal or even cost effective, and the only way to determine that is to consider developing a hardware device during the initial project exploration. Let's go through the process of designing a special purpose device together. Real-world details are critical to this process, so we'll do it in the problem domain of animation, where DID and others have previously developed special purpose input devices. I'll generalize where appropriate.

Incorporating local consistency information into the online signature verification process

This paper describes a fully operational online signature verification system. Its heart is the SmartPen™, a special input device enabling the perception of force and angle signals. The main key for the success of the approach is the decoupling of the time-alignment stage, based on the dynamic time warping algorithm, and the actual feature-extraction process, in which the wavelet transform plays a central role. This separation allows taking into account information about the relative stability of different phenomena present in a specific person's handwriting. The usefulness of the approach is illustrated by presenting the results of a full-scale field-test.

Position controlled input device for handicapped: Experimental studies with a footmouse

To test the practical suitability of the footmouse developed at the Institute of Industrial Engineering and Ergonomics, experimental studies of speed and accuracy were carried out with the footmouse to compare this device with a conventional mouse. Testing of the footmouse was performed either barefoot or with shoes on. Both handicapped and able-bodied subjects took part in these experimental laboratory studies. Handicapped subjects with the footmouse produced the same number of mistakes in a given time period as did able-bodied subjects with a conventional, hand-operated mouse. The time required for selecting graphic objects with the aid of the footmouse was 2.3 times higher than the selection time for the handmouse. The accuracy of positioning was about twice as bad as that with a conventional mouse. Handicapped people plead with one voice for this possibility of data input because of there is no special input device for hand/arm handicapped. The lower acceptance by able-bodied people probably stems from the unpractised fine motor ability of their feet and a missing understanding of the necessity to input data with their feet. Relevance to industry Input devices for graphic computer applications which can be used by hand or arm handicapped people are mostly adopted from existing input principles: the roller skate mouse adopts the principle of a mouse, trackballs for handicapped are based on conventional trackballs. The principle of the footmouse, which is presented in this paper, reduces most of the problems in using input devices by feet, for example speed and/or accuracy problems. Therefore the proposed principle seems to be an appropriate alternative to existing foot-controlled input devices. Because no adaptional effort in computer applications has to be made for using the mouse, this product would increase the possibilities for the handicapped to get a job in normal office environments.

Graphic Acquisition and Retrieval of Stereochemical Information

AbstractStereochemistry concepts deal with situations associated with chiral arrangement of atoms in a molecule. The existence of stereocompounds implies different physical properties associated with local and global structural space dissymetry. A left and right hand relationship is a typical local example of such concepts. In this paper, we show how it is possible to include stereochemistry in a comprehensive system allowing for acquisition, storage and retrieval of chemical information. Special emphasis has been placed on the description of the graphic interface on the level of both data acquisition and retrieval. Various graphic coding procedures associated with stereochemical handling are analysed. A specialized input device, optimized for handling of chemical and structural data in bulk, is presented.

A universal keyboard emulator for disabled computer users

Replacement of the keyboard of a microcomputer by a specialized input device which produces signals to emulate those produced by the keyboard allows physically handicapped users access to a powerful communication and learning aid. An emulator which is more versatile than those previously developed is described. This design reduces the restrictions on the use of special input devices by simplifying the task of connecting such devices in place of the keyboard of a computer. The emulator enables an input device developed for one computer to be used with another and a high degree of interchangeability is achieved.

A method for simultaneous automatic analysis of many electrograms

A new method is suggested for simultaneous automatic analysis of many electrograms. The method provides for transformation of continuous input signals into intermittents, their transference into the common tract, analysis of signals with regrad to strength, coding of signal strength and recording of analysis data on a single-track magnetic tape. The experimental findings are processed on a “Ural-2” electronic computing machine which “memorizes” analysis data fed into it by means of a marking selector and a special input device.