Computer Interaction Technology Research Articles

The effect of target and non-target similarity on neural classification performance: a boost from confidence.

Brain computer interaction (BCI) technologies have proven effective in utilizing single-trial classification algorithms to detect target images in rapid serial visualization presentation tasks. While many factors contribute to the accuracy of these algorithms, a critical aspect that is often overlooked concerns the feature similarity between target and non-target images. In most real-world environments there are likely to be many shared features between targets and non-targets resulting in similar neural activity between the two classes. It is unknown how current neural-based target classification algorithms perform when qualitatively similar target and non-target images are presented. This study address this question by comparing behavioral and neural classification performance across two conditions: first, when targets were the only infrequent stimulus presented amongst frequent background distracters; and second when targets were presented together with infrequent non-targets containing similar visual features to the targets. The resulting findings show that behavior is slower and less accurate when targets are presented together with similar non-targets; moreover, single-trial classification yielded high levels of misclassification when infrequent non-targets are included. Furthermore, we present an approach to mitigate the image misclassification. We use confidence measures to assess the quality of single-trial classification, and demonstrate that a system in which low confidence trials are reclassified through a secondary process can result in improved performance.

Multimodal corpus of multiparty conversations in L1 and L2 languages and findings obtained from it

To investigate the differences in communicative activities by the same interlocutors in Japanese (their L1) and in English (their L2), an 8-h multimodal corpus of multiparty conversations was collected. Three subjects participated in each conversational group, and they had conversations on free-flowing and goal-oriented topics in Japanese and in English. Their utterances, eye gazes, and gestures were recorded with microphones, eye trackers, and video cameras. The utterances and eye gazes were manually annotated. Their utterances were transcribed, and the transcriptions of each participant were aligned with those of the others along the time axis. Quantitative analyses were made to compare the communicative activities caused by the differences in conversational languages, the conversation types, and the levels of language expertise in L2. The results reveal different utterance characteristics and gaze patterns that reflect the differences in difficulty felt by the participants in each conversational condition. Both total and average durations of utterances were shorter in their L2 than in their L1 conversations. Differences in eye gazes were mainly found in those toward the information senders: Speakers were gazed at more in their second-language than in their native-language conversations. Our findings on the characteristics of conversations in the second language suggest possible directions for future research in psychology, cognitive science, and human–computer interaction technologies.

Developing interactive mathematical visualisations

In early 2014, researchers at the University of Western Sydney (UWS) developed a suite of interactive mathematical visualisations (IMVs) aimed at improving students’ understanding of key concepts in first-level mathematics. This paper outlines the pedagogical and interaction design considerations that informed this development, as well as the processes adopted in preparing the IMVs for classroom use. Guidelines for interaction design that draw on research in human computer interaction, information visualisation and cognitive technologies are reviewed and contextualised for the specific learning needs of mathematics students at UWS. Examples are given of how these guidelines were factored-in to the IMV development. In addition to the pedagogical and technological dimensions of this work, research-based methods for analysing and evaluating the educational effectiveness of the IMVs are examined. It is expected that these methods will underpin a formative evaluation approach to ongoing design and development of the IMVs.

A GPU-accelerated immersive audio-visual framework for interaction with molecular dynamics using consumer depth sensors.

With advances in computational power, the rapidly growing role of computational/simulation methodologies in the physical sciences, and the development of new human-computer interaction technologies, the field of interactive molecular dynamics seems destined to expand. In this paper, we describe and benchmark the software algorithms and hardware setup for carrying out interactive molecular dynamics utilizing an array of consumer depth sensors. The system works by interpreting the human form as an energy landscape, and superimposing this landscape on a molecular dynamics simulation to chaperone the motion of the simulated atoms, affecting both graphics and sonified simulation data. GPU acceleration has been key to achieving our target of 60 frames per second (FPS), giving an extremely fluid interactive experience. GPU acceleration has also allowed us to scale the system for use in immersive 360° spaces with an array of up to ten depth sensors, allowing several users to simultaneously chaperone the dynamics. The flexibility of our platform for carrying out molecular dynamics simulations has been considerably enhanced by wrappers that facilitate fast communication with a portable selection of GPU-accelerated molecular force evaluation routines. In this paper, we describe a 360° atmospheric molecular dynamics simulation we have run in a chemistry/physics education context. We also describe initial tests in which users have been able to chaperone the dynamics of 10-alanine peptide embedded in an explicit water solvent. Using this system, both expert and novice users have been able to accelerate peptide rare event dynamics by 3-4 orders of magnitude.

Effects of Interactive Technology on Home-Based Rehabilitation for Chronic Stroke Patient

This study aimed to apply low-cost interactive technology to home-based rehabilitation training for patients suffering from chronic stroke. It also focuses on discussing the results of the integration of interactive computer game training with home-based rehabilitation training in helping these patients. We conducted an experiment following the reversal design of single-subject research, in which a patient suffering with chronic stroke was given home-based rehabilitation training. In addition to interactive computer technology, the experiment also involved the adoption of a low-cost Wii Remote controller as an infrared receiver and a homemade infrared emitter supplemented by computer animation software to investigate the outcome of a home-based rehabilitation program. Data analysis is based on collection of points by the participant throughout the experiment and adopting visual analysis to discuss the outcome of interactive technology integrated with home-based rehabilitation. The results of this research show that the subject was able to stand on one leg for a few seconds longer than prior to the adoption of interactive technology integrated with home-based rehabilitation. Furthermore, parents of this patient and the therapists involved believe that the research and this innovative approach improved the patients performance in rehabilitation. The subject not only showed better motivation with regard to rehabilitation but also greater independence and enhanced capability of integrating into society.

Graphics, Audio-visuals and Interaction (GAI) based Handheld Augmented Reality System

Augmented Reality is considered as one of the highly sophisticated technologies in research field of virtual reality. It generates the virtual information to the real world to the user's perception and interaction to perform the tasks. Graphics, Audio-visual and Interaction (GAI) based mobile Augmented Reality is a Human Computer Interaction technology where user can view the multimedia content (like video, 2D, 3D, text, animation) with audio visuals in augmented environment. GAI based mobile AR system allows user to develop their own Augmented Reality applications and games. This system based on Symbian and Android Smartphone where the users can use their Smartphone's camera for real time video capturing and rendering virtual object augmented environments. Users can interact and control the virtual objects by touch in touch enable phone or by button in non touch phone. The general purpose of this technology is to introduce multimedia base Mobile Augmented Reality to user. This paper describes the potential of AR in mobiles and how the various useful features like 2D/3D object, audio, video can be implemented in Mobile AR.

A 3-D interactive software tool to help VSEs/SMEs integrate risk prevention in workplace design projects

In workplace design or refit projects, it is recommended to use a global, participative and progressive approach supported by simulation in order to take into account health, safety and working conditions. We propose a modeling tool based on new 3-D interactive computer technologies. To assess the tool’s usefulness, several tests were carried out, in particular two usage-based validations with apprentice bakers. In addition, external technical consultants (architects, equipment designers, etc.) were interviewed. These tests showed that the target population, i.e. VSEs/SMEs acting as occasional clients, were able to easily learn how to use the proposed software. It was also demonstrated that the software made it possible to rapidly model and test layout assumptions, made the project easy to understand and facilitated exchange with external participants. Interviews with external consultants confirmed the tool’s usefulness for workplace design projects.

Gesture Recognition for Briefing Application

With the growth of Human Computer Interaction (HCI) technologies, gesture recognition is one of the easiest ways to interact with computer. A briefing application with gesture recognition is proposed that easily plays the slides based on gesture detection, feature extraction, and gesture recognition. We deal with four commonly used actions which are next, previous, play from the start, and ending. The experimental results show that our system provides satisfactory results and is easy to use.

Studies on visual scene process system of aircraft assembly

Abstract According to the aircraft assembly worksite scene process, the hierarchical data model based on PPR (product, process, resources) was got to achieve the conversion in various types of aircraft assembly process data model. At the same time, the lightweight technology and human–computer interactive scene control technology were researched to obtain the lightweight of three-dimensional (3D) model and site scene and the human–computer real-time interaction between people and virtual environment through the computer keyboard and mouse, respectively. And then, the visual assembly sequence planning algorithm based on the parallel binary-coded was suggested to complete the aircraft assembly sequence planning. On the basis of techniques mentioned above, we developed the assembly worksite scene process system, which can be integrated with PDM system. At last, an application case of aircraft nose assembly was given, and the result was proved to be effective.

A Survey on Human Computer Interaction Technology for ATM

Human computer interaction technology has been applied too much in Automated Teller Machine's design, such as interface design. In this paper, we have done a survey on human computer technology for ATM and presented an investigation of the ATM's design on the precious literatures. The user experience test and evaluation of the prototype are reviewed and discussed in details, and we find the defects and the improvement of the ATM's design. In the end, we propose some suggestions and discussion in future works.

The use of online groups to involve older people in influencing nursing care guidance

The drive to involve service users in policy and practice decisions is occurring on an international basis, yet meaningful involvement is not as commonplace as it should be. There are numerous barriers to meaningful involvement of service users, and groupwork offers a potentially empowering approach to helping service users influence the policy and practice decisions that impact their lives. This paper describes a model of service user involvement based on an online communities of practice approach. Twenty-one older people and carers were recruited to take part in a project aimed at influencing the policy and practice of nursing older people on a national level (Scotland). Participants were taught IT skills and worked as an online group to articulate what they thought constituted good nursing care of older people. Together they produced two statements concerning prevention of depression and ensuring adequate nutrition for older people in care. This paper reports on one aspect of a larger evaluation of the project, namely the role of groupwork in the involving model. Content analysis of the groupwork records highlights the importance of groupwork and mutual aid in achieving group goals. The combination of groupwork, service user involvement, and interactive computer technology has much potential.

Slingshot 3D: A synchronous haptic-audio-video game

Recent advances in multimedia and human computer interaction technologies have paved the way for rich contents across multiple media such as haptics, audio, and video. This paper introduces a multimodal game named the Slingshot 3D Game: an interactive and synchronous haptic-audio-video shooter game over the Internet network. The game incorporates two types of haptic feedback: tactile feedback using a haptic jacket and kinesthetic feedback using the Novint Falcon haptic interface. Furthermore, the game utilizes a depth camera to track the player's (upper) body movements and detect collisions between the player's body and the shot projectile. To promote availability and cost, the game uses the Internet network as the communication medium between the players, by utilizing the Admux communication framework [10]. The game design and implementation are detailed in this paper. Both the player performance analysis and the user satisfaction analysis have shown that the incorporation of synchronous haptic-video multimedia has enhanced the perception of player presence and the overall quality of performance.

An Internet-Based Tailored Hearing Protection Intervention for Firefighters

Noise-induced hearing loss is a significant occupational injury for firefighters exposed to intermittent noise on the job. It is important to educate firefighters about using hearing protection devices whenever they are exposed to loud noise. Computer technology is a relatively new health education approach and can be useful for tailoring specific aspects of behavioral change training. The purpose of this study is to present the development process of an Internet-based tailored intervention program and to assess its efficacy. The intervention programs were implemented for 372 firefighters (mean age = 44 years, Caucasian = 82%, male = 95%) in three states (California, Illinois, and Indiana). The efficacy was assessed from firefighters' feedback through an Internet-based survey. A multimedia Internet-based training program was developed through (a) determining program content and writing scripts, (b) developing decision-making algorithms for tailoring, (c) graphic design and audio and video productions, (d) creating computer software and a database, and (e) postproduction quality control and pilot testing. Participant feedback regarding the training has been very positive. Participants reported that they liked completing the training via computer (83%) and also that the Internet-based training program was well organized (97%), easy to use (97%), and effective (98%) and held their interest (79%). Almost all (95%) would recommend this Internet training program to other firefighters. Interactive multimedia computer technology using the Internet was a feasible mode of delivery for a hearing protection intervention among firefighters. Participants' favorable feedback strongly supports the continued utilization of this approach for designing and developing interventions to promote healthy behaviors.

An investigation into the secondary schools in � service teachers' selected Variables on interactive computer technology (ICT) competency

An investigation into the secondary schools in � service teachers' selected Variables on interactive computer technology (ICT) competency

A computerized education module improves patient knowledge and attitudes about appropriate antibiotic use for acute respiratory tract infections

BackgroundOver-use of antibiotics for acute respiratory infections (ARIs) increases antimicrobial resistance, treatment costs, and side effects. Patient desire for antibiotics contributes to over-use. ObjectiveTo explore whether a point-of-care interactive computerized education module increases patient knowledge and decreases desire for antibiotics. MethodsBilingual (English/Spanish) interactive kiosks were available in 8 emergency departments as part of a multidimensional intervention to reduce antibiotic prescribing for ARIs. The symptom-tailored module included assessment of symptoms, knowledge about ARIs (3 items), and desire for antibiotics on a 10-point visual analog scale. Multivariable analysis assessed predictors of change in desire for antibiotics. ResultsOf 686 adults with ARI symptoms, 63% initially thought antibiotics might help. The proportion of patients with low (1–3 on the scale) desire for antibiotics increased from 22% pre-module to 49% post-module (p<.001). Self-report of “learning something new” was associated with decreased desire for antibiotics, after adjusting for baseline characteristics (p=.001). ConclusionAn interactive educational kiosk improved knowledge about antibiotics and ARIs. Learning correlated with changes in personal desire for antibiotics. Practice implicationsBy reducing desire for antibiotics, point-of-care interactive educational computer technology may help decrease inappropriate use for antibiotics for ARIs.

Computer Linguistic Automatic Ticket-Selling System for the Blind: The Perspective of Human-Sense Characteristics

The eye is the window of the soul. Without the input of visual information, the mobility for those with visual disability is much limited compared with people with healthy eyes. Surveys have revealed that approximately 39.2% of the visually disabled people in Taiwan desperately wish to return to the society and that the lack of mobility is one the major causes leading to their inability to live an independent life. Therefore, the provision of an ideal ticket selling system for public transportation catered to the needs of the visually disabled has become one of the most important issues surrounding the discussion about how to help the blind to start participating in the various societal activities as early as possible. According to the principle of the Universal design, this study has developed a train ticket seller system applying computer interactive voice response technology according to the sense characteristics of the visually disabled. The main idea is to allow the blind to interact with the ticket selling system through hearing sense and verbal ability. The increasingly sophisticated computer speech recognition technology also played a pivotal role in the development of the system. Using voice recognition as the input unit of the computer equipment is probably one of the easiest and most convenient methods for the blind. Hence, this study set out to develop a more user-friendly voicecontrolled man-machine interface, with an aim to provide a simple, convenient, and accurate automatic train ticket seller system for the visually disabled, making it possible for the blind to move more freely and independently, thereby facilitating their needs to return to the society as early as possible.

Independent interaction

Daniel Jarmola shares his experiences of using interactive computer technologies, such as whiteboards and the SMART Table™, to explore independent learning with young children in a school reception class.

Obstructive Sleep Apnea Management with Interactive Computer Technology and Nutrition: Two Case Reports

We present two cases of obstructive sleep apnea (OSA) in which one of the subjects was managed with virtual scanning, which is a computer interactive diagnostic and therapeutic technology, and the other was treated with nutrition. We propose an oxidative stress concept as the biochemical basis of the two management options. It is important to consider the validity of virtual scanning Technology (which can be used to manage sleep apnea noninvasively) and to determine whether oxidative stress is the biochemical basis for this technology. It will be beneficial to develop a framework for integration into clinical practice.

Hidden Markov Model based gesture recognition on low-cost, low-power Tangible User Interfaces

The development of new human–computer interaction technologies that go beyond traditional mouse and keyboard is gaining momentum as smart interactive spaces and virtual reality are becoming part of our everyday life. Tangible User Interfaces (TUIs) introduce physical objects that people can manipulate to interact with smart spaces. Smart objects used as TUIs can further improve the user experiences by recognizing and coupling natural gesture to command issued to the computing system. Hidden Markov Models (HMM) are a typical approach to recognize gestures. In this paper, we show how the HMM forward algorithm can be adapted for its use on low-power, low-cost microcontrollers without floating point unit that can be embedded into several TUI. The proposed solution is validated on a set of gestures performed with the Smart Micrel Cube (SMCube), a TUI developed within the TANGerINE framework. Through the paper we evaluate the complexity of the algorithm and the performance of the recognition algorithm as a function of the number of bits used to represent data. Furthermore, we explore a multiuser scenario where up to four people share the same cube. Results show that the proposed solution performs comparably to the standard forward algorithm run on a PC with double-precision floating point calculations.

Do Online Students Perform Better than Face-to-face Students? Reflections and a Short Review of some Empirical Findings

L'augment en el nombre de cursos en línia impartits per les universitats ha crescut d'una manera espectacular en aquests dos últims anys. Actualment, moltes universitats fins i tot ofereixen programes de graduació complets en línia en els quals les instruccions i les classes es donen, per exemple, en forma de vídeos en temps real que estan disponibles durant les 24 hores del dia per tal que els estudiants els puguin mirar. En cert sentit, l'ús d'Internet i de les TIC en l'educació superior es pot comparar amb l'ús de qualsevol altre mena d'eina educativa, com la pissarra o els retroprojectors. La motivació per utilitzar Internet i les TIC en educació superior, des d'un punt de vista econòmic, és si són més eficaces com a eines educatives en comparació amb les altres alternatives pertinents. És a dir, cal saber si, en igualtat de condicions, Internet és una eina educativa eficaç, cosa que es demostraria si els alumnes que segueixen cursos i programes de graduació complets en línia rendeixen millor en termes de notes de l'examen final en comparació amb els alumnes presencials. En aquest article resumim i reflexionem sobre alguns dels descobriments empírics que es troben a la literatura sobre els efectes de l'ensenyament en línia en el rendiment dels estudiants en comparació amb els seus equivalents presencials.