Subtle Cues Research Articles

Daily Sound Awareness of CI Users

Daily Sound Awareness of CI Users

Gaze-Contingent Auditory Displays for Improved Spatial Attention in Virtual Reality

Virtual reality simulations of group social interactions are important for many applications, including the virtual treatment of social phobias, crowd and group simulation, collaborative virtual environments (VEs), and entertainment. In such scenarios, when compared to the real world, audio cues are often impoverished. As a result, users cannot rely on subtle spatial audio-visual cues that guide attention and enable effective social interactions in real-world situations. We explored whether gaze-contingent audio enhancement techniques driven by inferring audio-visual attention in virtual displays could be used to enable effective communication in cluttered audio VEs. In all of our experiments, we hypothesized that visual attention could be used as a tool to modulate the quality and intensity of sounds from multiple sources to efficiently and naturally select spatial sound sources. For this purpose, we built a gaze-contingent display (GCD) that allowed tracking of a user’s gaze in real-time and modifying the volume of the speakers’ voices contingent on the current region of overt attention. We compared six different techniques for sound modulation with a base condition providing no attentional modulation of sound. The techniques were compared in terms of source recognition and preference in a set of user studies. Overall, we observed that users liked the ability to control the sounds with their eyes. They felt that a rapid change in attenuation with attention but not the elimination of competing sounds (partial rather than absolute selection) was most natural. In conclusion, audio GCDs offer potential for simulating rich, natural social, and other interactions in VEs. They should be considered for improving both performance and fidelity in applications related to social behaviour scenarios or when the user needs to work with multiple audio sources of information.

A Comparison of Children's Ability to Read Children's and Adults' Mental States in an Adaptation of the Reading the Mind in the Eyes Task.

The ability to read mental states from subtle facial cues is an important part of Theory of Mind, which can contribute to children's daily life social functioning. Mental state reading performance is influenced by the specific interactions in which it is applied; familiarity with characteristics of these interactions (such as the person) can enhance performance. The aim of this research is to gain insight in this context effect for mental state reading in children, assessed with the Reading the Mind in the Eyes (RME) task that originally consists of pictures of adults' eyes. Because of differences between children and adults in roles, development and frequency of interaction, children are more familiar with mental state reading of other children. It can therefore be expected that children's mental state reading depends on whether this is assessed with children's or adults' eyes. A new 14 item version of the RME for children was constructed with pictures of children instead of adults (study 1). This task was used and compared to the original child RME in 6–10 year olds (N = 718, study 2) and 8–14 year olds (N = 182, study 3). Children in both groups performed better on the new RME than on the original RME. Item level findings of the new RME were in line with previous findings on the task and test re-test reliability (in a subgroup of older children, n = 95) was adequate (0.47). This suggests that the RME with children's eyes can assess children's daily life mental state reading and supplement existing ToM tasks.

Framing “the Other” in Times of Conflicts: CNN’s Coverage of the 2003 Iraq War

Abstract This study is explored by a qualitative analysis of visual media practices in times of international conflicts. The analysis focuses on one of the leading sources of television news in the world, namely CNN, during its coverage of the 2003 Iraq War. Due to its national and international character and its popularity in coverage of war and international conflicts, CNN is thought of as a world leader in covering global conflicts. Accordingly, this research is directed toward the ways public perceptions were formed about particular ideas through CNN’s coverage. In order to develop an accurate sense of the programming that aired during the period under study, a qualitative content analysis was conducted in which a selected sample was selected and analyzed. This sample consisted of 20 CNN news stories during the first two months of the 2003 Iraq War. Relying on transcripts and videotapes of the key events of the first two months of the 2003 Iraq War CNN’ such as “Decapitation Strike”, “Shock and Awe”, Toppling of Saddam’s Statue and the bombing of Al Jazeera Office in Iraq, the qualitative analysis aims at discerning intonation, verbal and visual emphases and the subtle cues that are uniquely embedded in the visual medium. The analytical tool that is used to conduct the qualitative analysis of the selected sequences from CNN’s coverage of the 2003 Iraq War is grounded in framing analysis. The content and qualitative framing analysis of the selected sample of the CNN’s news stories about the 2003 Iraq War reveal that CNN echoed the American centered perspectives, aligning with the official war narrative supporting the war cause, and abiding by the U.S. military censorship measures.

Social distance influences the outcome evaluation of cooperation and conflict: Evidence from event-related potentials

Previous research shows that social distance plays an important role in promoting cooperation and that subtle cues that reduce social distance increase the tendency to cooperate. However, it is unclear how social distance influences our outcome evaluation of cooperative and conflict feedback. The present study investigated the influence of social distance on cooperative and conflict behavior and the evaluation process of the cooperative and conflict outcomes, using the event-related potentials (ERPs) technique. We recorded ERPs from 14 normal adults playing a social game task against a friend and a stranger. The results showed that the FRN (Feedback Related Negativity) and P300 were affected by the opponent’s choice to cooperate or aggress; however, only the P300 was affected by social distance. Specifically, when the opponent chose to cooperate, the feedback elicited a smaller FRN and a larger P300 amplitude; and compared with playing against friends, the P300 had a larger amplitude when participants gaming with strangers. Our results indicate that at the early stage of the evaluation of cooperation and conflict outcomes, individuals may initially and quickly encode the valence of outcomes, judging whether an outcome is consistent with their expectations. However, at the late stage, which involves a top-down cognitive appraisal process, some social factors, such as social distance, may moderate processing of attention resource allocation of feedback about outcomes, and of higher-level motivation/affective appraisal.

Sensorimotor Coarticulation in the Execution and Recognition of Intentional Actions.

Humans excel at recognizing (or inferring) another's distal intentions, and recent experiments suggest that this may be possible using only subtle kinematic cues elicited during early phases of movement. Still, the cognitive and computational mechanisms underlying the recognition of intentional (sequential) actions are incompletely known and it is unclear whether kinematic cues alone are sufficient for this task, or if it instead requires additional mechanisms (e.g., prior information) that may be more difficult to fully characterize in empirical studies. Here we present a computationally-guided analysis of the execution and recognition of intentional actions that is rooted in theories of motor control and the coarticulation of sequential actions. In our simulations, when a performer agent coarticulates two successive actions in an action sequence (e.g., “reach-to-grasp” a bottle and “grasp-to-pour”), he automatically produces kinematic cues that an observer agent can reliably use to recognize the performer's intention early on, during the execution of the first part of the sequence. This analysis lends computational-level support for the idea that kinematic cues may be sufficiently informative for early intention recognition. Furthermore, it suggests that the social benefits of coarticulation may be a byproduct of a fundamental imperative to optimize sequential actions. Finally, we discuss possible ways a performer agent may combine automatic (coarticulation) and strategic (signaling) ways to facilitate, or hinder, an observer's action recognition processes.

Do You Always Choose What You Like? Subtle Social Cues Increase Preference-Choice Consistency among Japanese But Not among Americans.

Previous research has suggested that stability of self-concept differs across cultures: in North American cultural contexts, people’s self-concept is stable across social contexts, whereas in Japan, different self-concepts are activated within specific social contexts. We examined the implications of this cultural difference for preference-choice consistency, which is people’s tendency to make choices that are consistent with their preferences. We found that Japanese were less likely than Americans to choose items that they liked the most, showing preference-choice inconsistency. We also investigated the conditions in which Japanese might exhibit greater preference-choice consistency. Consistent with research showing that in Japanese culture, the self is primarily conceptualized and activated by social contexts, we found that subtle social cues (e.g., schematic representations of human faces) increased preference-choice consistency among Japanese, but not among Americans. These findings highlight that choices do not reveal preferences to the same extent in all cultures, and that the extent to which choices reveal preferences depends on the social context.

Verticality in product labels and shelves as a metaphorical cue to quality

This study investigates how subtle visual cues related to the design of a product's package (i.e., label position) and the context (i.e., shelf orientation) influence consumer evaluation and behavioral intention. Extending research on metaphorical cues, Study 1 shows that consumers perceive a product as more powerful when the label on the package is placed in a higher (vs. lower) vertical position. Extending the focus from package design to the display context of packages, Study 2 shows that consumer perception of a product's power is similarly enhanced when the package is placed on a shelf that is vertically (vs. horizontally) orientated. Across both studies effects of enhanced power perception extend to positively influence product quality inferences and behavioral intentions. These findings add to current knowledge on metaphorical cues in package design and the package's presentation context and offer insights into the underlying mechanism.

Video-based emotion recognition in the wild using deep transfer learning and score fusion

Multimodal recognition of affective states is a difficult problem, unless the recording conditions are carefully controlled. For recognition “in the wild”, large variances in face pose and illumination, cluttered backgrounds, occlusions, audio and video noise, as well as issues with subtle cues of expression are some of the issues to target. In this paper, we describe a multimodal approach for video-based emotion recognition in the wild. We propose using summarizing functionals of complementary visual descriptors for video modeling. These features include deep convolutional neural network (CNN) based features obtained via transfer learning, for which we illustrate the importance of flexible registration and fine-tuning. Our approach combines audio and visual features with least squares regression based classifiers and weighted score level fusion. We report state-of-the-art results on the EmotiW Challenge for “in the wild” facial expression recognition. Our approach scales to other problems, and ranked top in the ChaLearn-LAP First Impressions Challenge 2016 from video clips collected in the wild.

The Role of Generic Language in the Early Development of Social Categorization.

Classifying people into categories not only helps humans simplify a complex social world but also contributes to stereotyping and discrimination. This research examines how social categorization develops by testing how language imbues with meaning otherwise arbitrary differences between people. Experimental studies (N=129) with 2-year-olds showed that generic language-language that refers to abstract kinds-guides the development of social categorization. Toddlers learned a new category after hearing generic language about individuals who shared an arbitrary perceptual feature but not after hearing matched specific language, simple labels, or plural (but nongeneric) language about the same set of individuals. These findings show how subtle linguistic cues shape the development of social categorization.

Sleep deprivation impairs recognition of specific emotions

Emotional processing is particularly sensitive to sleep deprivation, but research on the topic has been limited and prior studies have generally evaluated only a circumscribed subset of emotion categories. Here, we evaluated the effects of one night of sleep deprivation and a night of subsequent recovery sleep on the ability to identify the six most widely agreed upon basic emotion categories (happiness, surprise, fear, sadness, disgust, anger). Healthy adults (29 males; 25 females) classified a series of 120 standard facial expressions that were computer morphed with their most highly confusable expression counterparts to create continua of expressions that differed in discriminability between emotion categories (e.g., combining 70% happiness+30% surprise; 90% surprise+10% fear). Accuracy at identifying the dominant emotion for each morph was assessed after a normal night of sleep, again following a night of total sleep deprivation, and finally after a night of recovery sleep. Sleep deprivation was associated with significantly reduced accuracy for identifying the expressions of happiness and sadness in the morphed faces. Gender differences in accuracy were not observed and none of the other emotions showed significant changes as a function of sleep loss. Accuracy returned to baseline after recovery sleep. Findings suggest that sleep deprivation adversely affects the recognition of subtle facial cues of happiness and sadness, the two emotions that are most relevant to highly evolved prosocial interpersonal interactions involving affiliation and empathy, while the recognition of other more primitive survival-oriented emotional face cues may be relatively robust against sleep loss.

Attention Orienting in Response to Non-conscious Hierarchical Arrows: Individuals with Higher Autistic Traits Differ in Their Global/Local Bias.

One aspect of the social communication impairments that characterize autism spectrum disorder (ASD) include reduced use of often subtle non-verbal social cues. People with ASD, and those with self-reported sub-threshold autistic traits, also show impairments in rapid visual processing of stimuli unrelated to social or emotional properties. Hence, this study sought to investigate whether perceptually non-conscious visual processing is related to autistic traits. A neurotypical sample of thirty young adults completed the Subthreshold Autism Trait Questionnaire and a Posner-like attention cueing task. Continuous Flash Suppression (CFS) was employed to render incongruous hierarchical arrow cues perceptually invisible prior to consciously presented targets. This was achieved via a 10 Hz masking stimulus presented to the dominant eye that suppressed information presented to the non-dominant eye. Non-conscious arrows consisted of local arrow elements pointing in one direction, and forming a global arrow shape pointing in the opposite direction. On each trial, the cue provided either a valid or invalid cue for the spatial location of the subsequent target, depending on which level (global or local) received privileged attention. A significant autism-trait group by global cue validity interaction indicated a difference in the extent of non-conscious local/global cueing between groups. Simple effect analyses revealed that whilst participants with lower autistic traits showed a global arrow cueing effect, those with higher autistic traits demonstrated a small local arrow cueing effect. These results suggest that non-conscious processing biases in local/global attention may be related to individual differences in autistic traits.

The role of predictability in cooperative and competitive joint action.

Predictability may be an important component of cooperative action, or it may arise as a by-product of involuntary entrainment with another's behavior. Further, differences previously observed in cooperative versus competitive actions may represent a fundamental distinction between behaviors with opposite goals, or they may simply reflect the output of different physical actions. The role of predictability in cooperative versus competitive behavior was directly tested using a joint sequential button-pressing task in which Participant 1 (P1) pressed a key followed by P2 pressing a key. In the cooperative condition, both actors shared the goal of minimizing P2's response times (RTs). In the competitive condition, P1 tried to maximize P2's RTs, whereas P2 continued to try to minimize them. It was found that P1 was much more predictable in the timing of his or her presses in the cooperative condition than in the competitive condition, and this coincided with faster P2 responses when cooperating than when competing. A 2nd experiment showed the effects of the predictability of P1's responses on the speed of P2 responses were similar when P1 was replaced by a schematic hand, showing the responses could not have been due to the transmission of subtle nonverbal cues by P1. These results demonstrate that being predictable is an important strategy in the timing of cooperative joint action, whereas being unpredictable is an important strategy in competition, and that they have opposite effects on a coactor's ability to respond quickly. (PsycINFO Database Record

If nearly all Airbnb reviews are positive, does that make them meaningless?

Peer-to-peer business models rely on interpersonal communication for their success. In this article, we focus on Airbnb – an exemplar of the so-called ‘sharing economy’ – and more specifically, on Airbnb’s reciprocal reviewing system, which enables both hosts and guests to review one another. Our study takes a computer-assisted, qualitative approach to explore linguistic patterns of evaluation in Airbnb reviews. Our findings indicate that Airbnb reviews tend to comprise a very restricted set of linguistic resources, establishing the site’s norm of highly positive commentary, which in turn makes Airbnb reviews, on the surface, appear to be quite similar to one another. However, a micro-analytic comparison of positive reviews reveals that less-than-positive experiences are sometimes communicated using more nuanced, subtle cues. This study contributes to existing literature on electronic word of mouth in the tourism industry by highlighting how evaluation is communicated, while simultaneously responding to hospitality scholars’ calls for analyses which extend beyond the star ratings and also take into account consumers’ constructions of experience in the review texts themselves.

“Gaydar”

Though many of people’s impressions about each other stem from qualities that are obvious or apparent, social perceptions also rely on a variety of subtle cues that guide judgment and behavior. For example, emerging work has increasingly elucidated the conditions and means by which individuals’ accuracy in judging others’ sexual orientation is better than chance. We discuss these here, focusing on four domains from which people draw cues to accurately perceive sexual orientation: how people adorn themselves (adornment), how they move (actions), how they sound (acoustics), and how they look (appearance). Moreover, we describe how certain factors, such as one’s own sexual orientation, can constrain or facilitate this accuracy and describe the various negative social and occupational consequences that may result from cues that someone is gay or straight.

Real‐Time Coordination in Human‐Robot Interaction Using Face and Voice

When humans interact and collaborate with each other, they coordinate their turn‐taking behaviors using verbal and nonverbal signals, expressed in the face and voice. If robots of the future are supposed to engage in social interaction with humans, it is essential that they can generate and understand these behaviors. In this article, I give an overview of several studies that show how humans in interaction with a humanlike robot make use of the same coordination signals typically found in studies on human‐human interaction, and that it is possible to automatically detect and combine these cues to facilitate real‐time coordination. The studies also show that humans react naturally to such signals when used by a robot, without being given any special instructions. They follow the gaze of the robot to disambiguate referring expressions, they conform when the robot selects the next speaker using gaze, and they respond naturally to subtle cues, such as gaze aversion, breathing, facial gestures, and hesitation sounds.

How to Best Assess Violence Risk of Youth in Emergency Department

How to Best Assess Violence Risk of Youth in Emergency Department

Macaques attend to scratching in others

Self-directed behaviours in primates as a response to increasing psychological or physiological stress are a well-studied phenomenon. There is some evidence that these behaviours can be contagious when observed by conspecifics, but the adaptive function of this process is unclear. The ability to perceive stress in others and respond to it could be an important part of sustaining cohesiveness in social primates, but spontaneously acquiring stress-related behaviours (and potentially emotional states) from all group mates via contagion could be maladaptive. To investigate this, a group of captive Barbary macaques, Macaca sylvanus, were presented with videos of conspecifics engaging in self-directed behaviour (scratching) and neutral behaviour. Behavioural responses as a result of exposure to the stimuli were compared (1) between familiar and unfamiliar individuals, and (2) within familiar individuals to consider the modulating effects of social relationships. Our results did not show contagious scratching in this species. However, there were differences in how individuals attended to the scratching stimuli. Subjects were more attentive to scratching videos than to neutral videos and familiar than unfamiliar individuals. Within the familiar individuals, subjects were more attentive to those to whom they were weakly bonded. We suggest that increased attention to scratching behaviours may be adaptive in order to monitor and avoid stressed group mates, whose subsequent behaviour may be unpredictable and aggressive. Monitoring group mates who are not allies may also be adaptive as they may pose the biggest risk. These findings will help increase our understanding of subtle cues that can be communicative in primates, and also the evolutionary steps towards understanding others.

Subtle cues missed: Impaired perception of emotion from gait in relation to schizotypy and autism spectrum traits

BackgroundDeficits in emotion perception are central features of schizophrenia and autism spectrum disorders. These conditions are also associated with disrupted embodiment and impaired processing of biological motion. However, medication and the impact of illness over time complicate the study of socioemotional processing in such neuropsychiatric populations. Thus, the current study investigated the perception of emotional cues from gait, in relation to autistic and schizotypal traits in the general population. MethodsSelf-report measures of schizotypy and autism-spectrum were obtained from 107 healthy participants. An affective biological motion task that required participants to discriminate emotions from the gait patterns of polygonal avatars at varying levels of emotional intensity was used to assess accuracy of emotion perception. ResultsEmotion perception accuracy depended on the stimulus intensity. Those with elevated autism spectrum quotient and those with elevated positive syndrome (cognitive-perceptual) schizotypy showed deficits in emotion perception from gait. ConclusionsPerception of emotion from low-intensity gait cues is compromised in those who may carry liability for autism or psychosis. Emotion perception deficits may be a core feature of autism and schizophrenia, rather than simply being a downstream consequence of illness duration or medication.

Why Psychotherapy Exposure is Relevant for Medical Students

Why Psychotherapy Exposure is Relevant for Medical Students