Human-computer Communication Research Articles

A Gesture Recognition Based on Accelerometer and Hidden Markov Model for Human Computer Communication

Along with the continuous changes and improvement of information technology, remote controls are widely used in smart living, robot control, Sign language systems, and so on. However, the human-computer communication needs to be diversified in the future. In particular, users are not intuitive when applying a special application or remote control environment, thus, this study applying Nintendo Wii remote as a human-computer interface device, to capture motion data by built-in three-axis accelerometer sensor, and training and recognize with Hidden Markov Model. First, we apply a gesture recognize system, to enhance the interactive ability of three-axis accelerometer sensor, gesture commands are trainable by user on-demand, and users can interactive with different computer applications through the gesture command has been trained. Finally, this study had issued a Gesture Recognition approach for intelligent interactive system design and for future study.

Extracting optimal tempo-spatial features using local discriminant bases and common spatial patterns for brain computer interfacing

Brain computer interfaces (BCI) provide a new approach to human computer communication, where the control is realised via performing mental tasks such as motor imagery (MI). In this study, we investigate a novel method to automatically segment electroencephalographic (EEG) data within a trial and extract features accordingly in order to improve the performance of MI data classification techniques. A new local discriminant bases (LDB) algorithm using common spatial patterns (CSP) projection as transform function is proposed for automatic trial segmentation. CSP is also used for feature extraction following trial segmentation. This new technique also allows to obtain a more accurate picture of the most relevant temporal–spatial points in the EEG during the MI. The results are compared with other standard temporal segmentation techniques such as sliding window and LDB based on the local cosine transform (LCT).

Virtual Effort: An Advanced User Interface that Combines Various Visual Information with a Kinetic System for Virtual Object Manipulations

The present day virtual environments are very advanced and have the ability to display complex representations of simulated objects together with their surroundings. Each virtual object can be endowed with multiple physical properties; in this way the entire virtual environment tends to become very real. However, human interaction with objects in virtual environments is forced from the user perspective and very different from how humans interact with objects in physical world. In this paper, a research that allows a more natural human-computer communication is presented. This is realized by combining visual information that is displayed to a user with kinetic information captured from the user hand by utilizing a sensor to capture depth data. The presented method is used in order to perform experiment that consist in grasping, moving and dropping a virtual object and analyze the hand trajectory compared with the virtual object trajectory.

Design of Interior Off-Line Temperature Detector for the Ultrahigh Pressure Vessel

The gas temperature in vessel will be significantly increased according to the aeration speed and pressure during the aeration or deflation for the ultrahigh pressure vessel. Due to the restriction of air tightness and structure for the ultrahigh pressure vessel, it is difficult to measure the gas temperature by adopting the traditional measurement method without change of the vessel structure. In this paper, a new type interior off-line temperature detector is designed to measure the gas temperature in vessel. The power, temperature sensors, processor, memory and human-computer communication module is linear arranged in the circuit board, which ensure that the temperature detector can be putted inside the ultrahigh pressure vessel through the vessel inlet of diameter Ø25mm. The experiment results show that the gas temperature in vessel can be effectively measured by adopting the interior off-line temperature detector without change of the vessel structure.

ARM-Based Greenhouse Environmental Parameters Control System Design and Implementation

The countries all over the world, the development of facilities agriculture that science and technology is to promote the modern facilities of the development of the agriculture basic power, biological technology, information technology, energy technology, the new material technology, high and new technology in agricultural facilities, make the comprehensive application of facilities agriculture become highly intensive industrial technology, to the large-scale, mechanization automation and information way, promoted the sustainable development of modern agriculture[1-2]. As China's economy continues to develop, more and more greenhouses, more and more popular, but the intelligence levels of high and low, in recent years learning to the advanced level , technology continues to develop [3-4]. Control over most of the greenhouse with the IPC, high cost, is not conducive to large scale, then switch to single-chip, but the structure is relatively simple external circuit design complexity, is not conducive to the latter part of the system upgrade, unable to complete the complex control and meets the requirements for low-cost agricultural facilities. Therefore, the study of advanced ARM microprocessor based greenhouse control system meets the requirements for low-cost agricultural facilities, but also well positioned to meet the functional requirements of small and medium sized greenhouse. And has a very good human-computer interaction and communication functions, is of great significance and practical value.

The Design of Actuating Cylinder Salt Spray Testing Device Based on Lab Windows/CVI and PLC Control

The performance tests and the requirements of experiments on aircraft alighting gear actuating cylinder in the salt spray and hot and humid environment are presented in this paper, and the hydraulic system of experimental device is designed. The host computer software is developed by Lab Windows/CVI for actuating cylinder on test parameters settings, monitoring, and storage and record, The Siemens PLC are used at the sub-processors to control the salt spray experimental device. The field-test shows that the device control precision is higher to pressure, flow rate, and the parameters such as temperature, and it can realize the simulation for different salt spray and hot and humid environments. The test on aircraft landing gear by using actuating cylinder has a good human-computer interaction and communication function. The device is safe, reliable and it can reach the test requirements.

Emotional Audio-Visual Speech Synthesis Based on PAD

Audio-visual speech synthesis is the core function for realizing face-to-face human-computer communication. While considerable efforts have been made to enable talking with computer like people, how to integrate the emotional expressions into the audio-visual speech synthesis remains largely a problem. In this paper, we adopt the notion of Pleasure-Displeasure, Arousal-Nonarousal, and Dominance-Submissiveness (PAD) 3-D-emotional space, in which emotions can be described and quantified from three different dimensions. Based on this new definition, we propose a unified model for emotional speech conversion using Boosting-Gaussian mixture model (GMM), as well as a facial expression synthesis model. We further present an emotional audio-visual speech synthesis approach. Specifically, we take the text and the target PAD values as input, and employ the text-to-speech (TTS) engine to first generate the neutral speeches. Then the Boosting-GMM is used to convert the neutral speeches to emotional speeches, and the facial expression is synthesized simultaneously. Finally, the acoustic features of the emotional speech are used to modulate the facial expression in the audio-visual speech. We designed three objective and five subjective experiments to evaluate the performance of each model and the overall approach. Our experimental results on audio-visual emotional speech datasets show that the proposed approach can effectively and efficiently synthesize natural and expressive emotional audio-visual speeches. Analysis on the results also unveil that the mutually reinforcing relationship indeed exists between audio and video information.

The multiple faces of social intelligence design

Nowadays, interactions between the human and the digitalhave become paramount aspects of our everyday experi-ence. The pervasiveness of the digital has closed the bridgebetween the cyber and the human, progressing toward asituation in which boundaries that used to separate thecomputers and the world in which the subject interacts withthe devices continuously disappear. In a recent conferencepaper, Mikael and Erik (2008) pointed out how recenttrends show how their multiple studies on ‘‘digitallyenhanced physical environments, as well as by recentresearch into ubiquitous computing, ambient intelligence,and interactive architecture which all highlight the blend ofthe physical and virtual world, and the disappearing char-acter of modern information technology’’, leading them toargue that the ‘‘move towards digitally enhanced interac-tive environments has to be taken seriously by the field ofHCI’’ (Mikael and Erik 2008, p. 21).The articles included in this special issue of AI andSociety, take on the challenge posed by these authors,tackling this subject of study through a conceptual frame-work that connects the relationship between the individualand the interactive environment by means of social medi-ation. The theoretical ground to these conceptualizationscomes from the paradigm of social intelligence design(SID) as defined by Nishida that it is explained by Nijholtet al. as ‘‘the necessary ability for people to relate tounderstand and interact effectively with others’’ and theirparticular concern to understand ‘‘how Social Intelligenceis mediated through the use of emerging information andcommunication technologies’’ (2009, p. 2). This paradigmtherefore involves the development of systematic approa-ches concerning design and implementation of systems andenvironments, ranging from team-based collaborationsystems that facilitate common ground building, goal-oriented interactions among participants, to community-centered systems that support large scale online dialog andinstructional design.The multidisciplinary articles included in this specialissue are augmented versions of ten selected works origi-nally presented at the 7th Social Intelligence Design (SID)workshop held at the School of Architecture of the Uni-versity of Puerto Rico, San Juan, PR, in December 2008.As in previous SID workshops, Puerto Rico hosted for3 days a multidisciplinary group of individuals, comingfrom varied disciplines such as industrial design, engi-neering fields, computer science, human computer inter-action, communication, social science, cognitive science,social psychology, and architecture. Common to all, thesediverse minds were a shared goal to improve the means andapproaches to produce better interactions between thehuman beings and their environments by means of theprinciples stated by SID.The first two articles in this special issue deal specifi-cally with the problem of communication. The article byKatai et al. studies the fundamental structures of verbalcommunication among people by using the conceptualnotions of coming from the Leibnizian notions of space andtime. In this article, the formalization generated by themodels used by Katai et al. shed light on the pieces and

딜리셔스에서 유사태그 추출에 관한 연구

The synonym issue is an inherent barrier in human-computer communication, and it is more challenging in a Web 2.0 application, especially in social tagging applications. In an effort to resolve the issue, the goal of this study is to test the feasibility of a Web 2.0 application as a potential source for synonyms. This study investigates a way of identifying similar tags from a popular collaborative tagging application, Delicious. Specifically, we propose an algorithm (FolkSim) for measuring the similarity of social tags from Delicious. We compared FolkSim to a cosine-based similarity method and observed that the top-ranked tags on the similar list generated by FolkSim tend to be among the best possible similar tags in given choices. Also, the lists appear to be relatively better than the ones created by CosSim. We also observed that tag folksonomy and similar list resemble each other to a certain degree so that it possibly serves as an alternative outcome, especially in case the FolkSim-based list is unavailable or infeasible.

Analysis of the oral interface in the interactive servicing systems. I

The oral technologies created a new type of the human-computer interaction. The oral servers and oral portals which implement a new model of human-computer communications may be studied using the methods of the queuing theory. Development of the analytical models to estimate some numerical characteristics of the human-computer one-channel dialogue such as the probability of successful dialogue, number of overinterrogations, and mean time of dialogue are the immediate subject matters of such studies. These characteristics may be used further to analyze operation of the entire queuing system that models the multichannel oral portal. The main parameters of the human-computer dialogue such as the probability of correct recognition of an element and the entire dialogue at overinterrogations and the time used for a dialogue element were considered. The parameters for estimation of the dialogue length were determined. A classification of the dialogue control algorithms at oral interaction of the client with the computer-aided information and servicing systems was developed. The algorithms were compared in terms of duration with regard for the desired reliability of recognition.

Do It Yourself Haptics: Part II [Tutorial

This article is the second of a two-part series intended to be an introduction to haptic interfaces, their construction, and application design. Haptic interactions employ mechanical, programmed physical devices that can be used for human-computer communication via the sense of touch. In Part I of this series, we focused on the devices themselves: the classes of hardware schemes currently available or envisioned, the software components that drive them, and specific examples that can be built on the kitchen table. Here in Part II, we broach a topic that is coming into its own; between the vision of a particular utility that haptic feedback theoretically should enable and the hardware capable of delivering the required sensations is the problem of designing the interaction in a usable way.

An approach to context in human-computer interaction

A comprehensive framework is presented for the analysis or description of context in relation to human-computer communication, in a manner that is also consistent with the contextual analysis of interpersonal communication among humans. Following a discussion of the nature of context, a hierarchically structured framework is proposed, which distinguishes between those contextual factors that are intrinsic to the communication process and those extrinsic factors that are classed as situational. Both of these overall classes are subdivided into broader and narrower categories, and the situational context is additionally analyzed in terms of physical and socio-cultural factors. Cognitive aspects of context are also included within the treatment, while allowing for the differences that exist between human and computer-based representations. Finally, the application of the framework to various aspects of human-computer communication is discussed, with a view to the resolution of attendant problems.

User Studies Differ Across Some Disciplines and May Not Be Very Effective

Objective – As part of a multi-staged project, this study seeks to identify the unanswered questions about users as found in three fields: library and information science (LIS), human computer interaction, and communication and media studies, as well as the convergences and divergences across these fields.
 
 Design – A multi-phased, qualitative study involving individual face-to-face and telephone interviews, as well as self interviewing and focus groups.
 
 Setting – The fields of LIS, human computer interaction, and communication and media studies as examined in interview situations.
 
 Subjects – 83 international experts across 
 the three fields, as well as 31 local experts from central Ohio, USA.
 
 Methods – The majority of the 83 international experts in the fields of LIS, human computer interaction, and communication and media studies were interviewed by telephone (some in person). Thirty-one local experts (7 public and 24 academic library directors) were individually interviewed and also took part in focus groups. The Sense-Making Methodology was used as an interview approach with its emphasis on bridging gaps. Neutral interview questions were used to tease out the gaps in certain situations—in the case of this project, the gaps involve communication and the unanswered questions about users. Brenda Dervin developed this approach, which has been transformed and adapted by Dervin and a host of other LIS researchers over the past 25 years. It is a metatheoretical approach that has “evolved into a generalized communication-based methodology seen as useful for the study of human sense-making (and sense-unmaking) in any context” (Dervin 729). The Sense-Making metatheory is implemented three ways in the method: “in the framing of research questions; in the designing of interviewing; and in the analyzing and concluding processes of research” (Dervin 737). In the research under review for this summary the answers to the gap-identifying questions allow different disciplines to begin to communicate and understand each other. Using Sense-Making in focus groups involves self interviewing (diaries, journals) and group discussions.
 
 Interviews were transcribed using the “smooth verbatim approach” in which non fluencies such as repetition, hesitancies, and partial words are eliminated. Care was taken to ensure anonymity, as this is necessary in the first step of the Sense-Making approach. The transcripts were analyzed for themes to capture a broad picture of what the participants struggle with across disciplinary and research-practice divides. Analysis was carried out by using comparative coding developed in early grounded theory combined with the Sense-Making methodology’s emphasis on gaps and bridging gaps. The “quotable quote” was the unit of analysis, and thematically representative quotes were selected from the transcriptions.
 
 Main Results – In an attempt to analyze communication across and within disciplines, the researchers did a thematic analysis on the interviews conducted with their international and local experts. The thematic analysis found 12 major themes, which included a total of 75 sub themes. The 12 major themes include the following: Participants wanted to make a difference with their work; participants agreed that current user research is not doing the job; there are fundamental disagreements about users and user studies; there are fundamental disagreements about the purposes of using user studies; there are external forces that make carrying out and applying user studies difficult; there was a lengthy list of differing suggestions for improving user studies; interdisciplinary communication across the three fields that do user studies is not effective; it was agreed that interdisciplinary contact is difficult; communication across the research/practice divide is not going well; some participants saw academic researchers as the problem, while some participants viewed practitioners as the problem; and most participants agreed that contact across fields and the research/practice divide would be beneficial.
 
 The researchers contend that this analysis is one of many that could be done on the information retrieved from the interviews. Their goal was not to find the definitive answers, but to describe the difficulties that participants are having across disciplines and across the research/practice divide in terms of communication and relating to user studies. The researchers wanted to tease out implications for communication and to illustrate the multiplicity that they found.
 
 Conclusions – It is difficult for this study to draw conclusions except in the most general sense, as it is part of a larger, multi-staged research project. However, this study did find that although participants across fields wanted a synthesis, they also expressed their inability to understand syntheses from fields other than their own. There were some who wanted more theories, while some claimed there were too many theories already. There was much criticism about communication across disciplines, but few solutions offered. The researchers can offer up no “magic wands” as solutions for these results, but they do suggest that the modes of communication traditionally used in user studies research are not working.

Revisiting the layer/mask paradigm for augmented scenery

Virtual and augmented reality have been used in the performing arts with two main purposes in mind: the design of artificial sceneries and the augmentation of the actor's performance. We are mostly interested in the second application that offers new perspectives for the interaction between actors and digital media. This article describes the design of a new interface for the definition and control of multi-layer interactive 2½D scenes by performers. The resulting virtual and animated environment is a stack of semi-transparent layers associated with physical models. Because of their intuitive physical behaviour and their capacity to be adapted to various geometries, these virtual props are well suited for the stage and their manipulation by performers. The interface used to design and control these objects extends the classical layer/mask paradigm to interactive spatialised scenes made of surfaces controlled by physical models such as mass-spring systems. This work is the result of a collaboration between a laboratory in human computer communication and a theater company. It has been successfully implemented in a single-actor theater play, leading to augmented and embodied expressiveness.

Word Sense Disambiguation by Combining Classifiers with an Adaptive Selection of Context Representation

Word Sense Disambiguation (WSD) is the task of choosing the right sense of a polysemous word given a context. It is obviously essential for many natural language processing applications such as human-computer communication, machine translation, and information retrieval. In recent years, much attention have been paid to improve the performance of WSD systems by using combination of classifiers. In (Kittler, Hatef, Duin, and Matas 1998), six combination rules including product, sum, max, min, median, and majority voting were derived with a number of strong assumptions, that are unrealistic in many situations and especially in text-related applications. This paper considers a framework of combination strategies based on different representations of context in WSD resulting in these combination rules as well, but without the unrealistic assumptions mentioned above. The experiment was done on four words interest, line, hard, serve; on the DSO dataset it showed high accuracies with median and min combination rules.

FACE AND EYE DETECTION FROM HEAD AND SHOULDER IMAGE ON MOBILE DEVICES

With the advance of semiconductor technology, the current mobile devices support multimodal input and multimedia output. In turn, human computer communication applications can be developed in mobile devices such as mobile phone and PDA. This paper addresses the research issues of face and eye detection on mobile devices. The major obstacles that we need to overcome are the relatively low processor speed, low storage memory and low image (CMOS senor) quality. To solve these problems, this paper proposes a novel and efficient method for face and eye detection. The proposed method is based on color information because the computation time is small. However, the color information is sensitive to the illumination changes. In view of this limitation, this paper proposes an adaptive Illumination Insensitive (AI2) Algorithm, which dynamically calculates the skin color region based on an image color distribution. Moreover, to solve the strong sunlight effect, which turns the skin color pixel into saturation, a dual-color-space model is also developed. Based on AI2algorithm and face boundary information, face region is located. The eye detection method is based on an average integral of density, projection techniques and Gabor filters. To quantitatively evaluate the performance of the face and eye detection, a new metric is proposed. 2158 head & shoulder images captured under uncontrolled indoor and outdoor lighting conditions are used for evaluation. The accuracy in face detection and eye detection are 98% and 97% respectively. Moreover, the average computation time of one image using Matlab code in Pentium III 700MHz computer is less than 15 seconds. The computational time will be reduced to tens hundreds of millisecond (ms) if low level programming language is used for implementation. The results are encouraging and show that the proposed method is suitable for mobile devices.

Intelligent Human-Computer Communication of Engineers at Extended Companies

During the past decades, prevailing method of engineering changed from manual drawing to computer modeling. By now, capabilities of modeling and analysis in virtual engineering systems give better results and more quickly than expensive physical prototypes. The next step in advancement of engineering is development of modeling systems for utilization of intelligent computing. The authors propose in this paper a methodology for intelligent communication and change management for engineering modeling. They were motivated by increasing of importance of change management because of continuous product development and high number of custom tailored product variants. Configuration and open architecture features of engineering modeling, portal management, and product data management (PDM) systems are available for implementation of the proposed modeling in the form of an extension to complex industrial engineering system. In this paper, the authors first give a general schema of advanced engineering activities and define role and place of the proposed modeling. Following this, modeling by behavior, adaptivity and design intent descriptions are explained as an integrated method to enhance intelligence of shape centered models. Next computer assisted activity of an active engineer, and procedure of change processing at decision on change information are detailed. Finally, flexible and controlled definition of characteristics of modeled engineering objects and behaviors are emphasized and discussed.

A discourse-based approach to human-computer communication

The term ‘dialogue’ has its origin in the study of human language, where it is regarded primarily as a form of discourse, and hence as a pragmatic-level phenomenon. However, ‘dialogue’ is nowadays also used to denote humancomputer interaction; and in this field it tends to be described in syntactic rather than in pragmatic terms. But to treat dialogue as though the term had two distinct senses is unsatisfactory and unwarranted. Instead, we show how it is possible to maintain a consistent, discourse-based view of dialogue that encompasses not only interpersonal communication but also multimodal human-computer interaction.

Enterprise Resource Planning Interactive Via duct B/w Human & Computer

Understanding human thinking is crucial in the design and evaluation of human-computer interaction. Computing devices and applications are at this moment employed ahead of the desktop, in dissimilar environments, and this tendency toward ubiquitous computing is gathering speed. As computers become major necessity and having connectivity widespread, we are increasingly becoming competent to access computer power, data, information and knowledge from anyplace and at anytime. Conversely, in order to fetch the benefits of such accessible intelligence (commonly known as ‘ERP’ or a latest buzzword in a contemporary scenario and in the field of information technology too); we should not overlook the ongoing evolutions and revolutions in human-computer communications and its interfaces. Indeed, as the human factors of information systems and knowledge systems emerge as a research area in and of itself, it is thoughtful to go on board on this electrifying field of study. The operation of the Human-Computer with a flavour of ERP is to encourage interdisciplinary study and education in user-centered computer systems. The location of ERP is to make interactive and intelligent human-computer interfaces, in order to effectively enable users to accomplish their desired tasks. This paper present a personal outlook of the HCI landscape in a historical perspective. The paper also aims part to support newcomers in the filed to grasp the origins of HCI and in part to provide grounds for a discussion of the field of usability that is being challenged by the social and cultural developments (Jorgensen 2000). This paper has argued that in order to properly understand the interaction between ERP system and human computer interactions networks one must scrutinize the mutual flows of influence and the dynamic interaction between the two. Thus to bridge this gap, the paper critically reviews the existing ERP in a humanity context and upgrade decision-drivers, synthesizes a framework based on the literature, and extends the framework as necessary. At last but not least the paper show-off a personal, historical overview of these develoments in accompanying ERP system as seen form a HCI perspective.

Virtual characters facial and body animation through the edition and interpretation of mark-up languages

The virtual characters are starting to be widely used in user interfaces in order to improve the human–computer communication. However, the design of avatar animation is still largely restricted to specialized users, revealing a current lack of intuitive and easy-to-use editing tools. In this paper, we propose to develop a graphic editor based on mark-up language. After analyzing the main existing mark-up languages, we decided to follow the specifications of the virtual human mark-up language (VHML). In this paper, we present the development of the graphic editor based on this mark-up language and its interpreter for generating the real-time avatar animation.