Perceptual Salience Research Articles

Unsupervised repetition enables rapid perceptual learning

This study examined how listeners disambiguate an auditory scene comprising multiple competing unknown sources and determine a salient source. Experiment 1 replicated findings from McDermott, Wrobleski, and Oxenham. [(2011). Proc. Natl. Acad. Sci. U. S. A. 108(3), 1188-1193] using a multivariate Gaussian model to generate mixtures of two novel sounds. The results showed that listeners were unable to identify either sound in the mixture despite repeated exposure unless one sound was repeated several times while being mixed with a different distractor each time. The results support the idea that repetition provides a basis for segregating a single source from competing novel sounds. In subsequent experiments, the previous identification task was extended to a recognition task and the results were modeled. To confirm the repetition benefit, experiment 2 asked listeners to recognize a temporal ramp in either a repeating sound or non-repeating sounds. The results showed that perceptual salience of the repeating sound allowed robust recognition of its temporal ramp, whereas similar features were ignored in the non-repeating sounds. The response from two neural models of learning, generalized Hebbian learning and anti-Hebbian learning, were compared with the human listener results from experiment 2. The Hebbian network showed a similar response pattern as for the listener results, whereas the opposite pattern was observed for the anti-Hebbian output.

The Role of Emotional Content and Perceptual Saliency During the Programming of Saccades Toward Faces

Previous studies have shown that the human visual system can detect a face and elicit a saccadic eye movement toward it very efficiently compared to other categories of visual stimuli. In the first experiment, we tested the influence of facial expressions on fast face detection using a saccadic choice task. Face-vehicle pairs were simultaneously presented and participants were asked to saccade toward the target (the face or the vehicle). We observed that saccades toward faces were initiated faster, and more often in the correct direction, than saccades toward vehicles, regardless of the facial expressions (happy, fearful, or neutral). We also observed that saccade endpoints on face images were lower when the face was happy and higher when it was neutral. In the second experiment, we explicitly tested the detection of facial expressions. We used a saccadic choice task with emotional-neutral pairs of faces and participants were asked to saccade toward the emotional (happy or fearful) or the neutral face. Participants were faster when they were asked to saccade toward the emotional face. They also made fewer errors, especially when the emotional face was happy. Using computational modeling, we showed that this happy face advantage can, at least partly, be explained by perceptual factors. Also, saccade endpoints were lower when the target was happy than when it was fearful. Overall, we suggest that there is no automatic prioritization of emotional faces, at least for saccades with short latencies, but that salient local face features can automatically attract attention.

Addicted to green: priming effect of menthol cigarette packaging on brain response to smoking cues

IntroductionMentholated tobacco cigarettes are believed to be more addictive than non-menthol ones. Packaging of most menthol cigarette brands includes distinctive green hues, which may act as conditioned stimuli (ie, cues)...

The effect of the angry emoji position on consumers’ perception of the sender’s anger

<p id="C2">Emoji are widely adopted in smartphones, for input methods, and on social networks. As ubiquitous characters, emoji transcend linguistic borders and are gaining worldwide popularity. The purpose of this paper is to examine the effect of the position of the angry emoji in negative online consumer reviews on the consumers’ perceptions of the sender’s anger. The present study first proposed the main location effect of the position of the angry emoji on the consumers’ perception of the sender’s anger. That is, compared with the angry emoji at the end of a sentence, the angry emoji in the middle of a sentence led to a stronger perception of anger. Based on visual information processing of the location effect, the current research proposed that the position salience perception and the sentiment-strengthening perception of the angry emoji serially mediated the above main effect. Further, we hypothesized that word review extremity moderated the effect of the position of the angry emoji on the consumers’ perceptions of the sender’s anger. <br/>For this paper, we conducted one eye-tracking experiment and three laboratory experiments. In Study 1, we conducted a pretest, which was the eye-tracking experiment. The product used in the pretest was a thermos mug. Study 1 was a 3 (one emoji at the end of a sentence vs. one in the middle of a sentence vs. no emoji) × 2 (feature description: feature one precedes feature two vs. feature two precedes feature one) between-subjects design. The product used in Study 1 was a laptop. Study 2 was a 2 (the position of the angry emoji at the end vs. in the middle of a sentence) × 2 (feature description: feature one precedes feature two vs. feature two precedes feature one) between-subjects design. Study 2 used a gel-ink pen refill as the target product. In Study 2, we measured the consumers’ perceptions of the sender’s anger, the angry emoji sentiment-strengthening perception, and the position salience perception created by the angry emoji. Study 3 was a 2 (the position of the angry emoji at the end vs. in the middle of a sentence) × 2 (word review extremity: moderate vs. extreme) between-subjects design. Study 3 used a coat as the target product. <br/>The results of the pretest demonstrated the effectiveness of visual information processing on the location effect. The position of the angry emoji influenced the participants’ attention. The angry emoji in the middle of a sentence led to higher fixation counts and longer fixation durations. The results of Study 1 demonstrated the main effect in this paper, which was that an angry emoji in the middle of a sentence led to a stronger perception of the sender’s anger than did an angry emoji at the end of a sentence. The results of Study 2 replicated the results of Study 1 and tested the serial-mediating roles of the position salience perception and the sentiment- strengthening perception of the angry emoji. The results of Study 3 replicated the results of Study 2 and tested the moderating role of word review extremity in the relationship between the position of the angry emoji and the consumers’ perception of the sender’s anger. When we considered the extreme word review, the influence of the position of the angry emoji on the sender’s perception of anger was not significant; however, when we considered the moderate word review, the angry emoji in the middle of a sentence significantly enhanced the consumers’ perception of the sender’s anger. <br/>The current research extended the extant literature in several dimensions. First, it supplemented the literature in the field of marketing on the effects of the emoji on consumers’ responses. Second, it supplemented the literature of application contexts and the influence of the location effect. Third, the present research provided empirical evidence for emoji functions. Fourth, the present study supplemented the literature of online consumer reviews.

How top-down and bottom-up attention modulate risky choice

We examine how bottom-up (or stimulus-driven) and top-down (or goal-driven) processes govern the distribution of attention in risky choice. In three experiments, participants chose between a certain payoff and the chance of receiving a payoff drawn randomly from an array of eight numbers. We tested the hypothesis that initial attention is driven by perceptual properties of the stimulus (e.g., font size of the numbers), but subsequent choice is goal-driven (e.g., win the best outcome). Two experiments in which task framing (goal driven) and font size (stimulus driven) were manipulated demonstrated that payoffs with the highest values and the largest font sizes had the greatest impact on choice. The third experiment added a number in large font to the array, which could not be an outcome of the gamble (i.e., a distractor). Eye movement and choice data indicated that although the distractor attracted attention, it had no influence on option selection. Together with computational modeling analyses, the results suggest that perceptual salience can induce bottom-up effects of overt selection but that the perceived value of information is the crucial arbiter of intentional control over risky choice.

The Effects of 40-Hz Binaural Beat on Working Memory

Aim of the study is to determine whether the auditory processing of temporal fine structure (TFS) is affected with normal aging, even in the presence of normal audiometric hearing and fine cognitive state; and, if it is, to see whether a comparable effect is also observed in the processing of a diotic change in sound envelope. The event-related potentials (ERPs) to binaural beats (BBs), which are the responses of the binaural mechanisms processing TFS of a sound, and the ERPs to diotic amplitude modulation (AM) stimuli, which are the responses of the monaural mechanisms processing the changes in its envelope, were recorded from thirteen young university students and ten senior but active university professors, all with normal hearing in low frequencies. To obtain directly the specific BB responses without confounding monaural frequency change-evoked responses, we used single-cycle BB stimuli with temporary sub-threshold frequency shifts. BBs of a 250-Hz tone and diotic AM of the same tone with similar perceptual salience were presented with 2-second stimulus onset asynchrony. The N1 components of the ERPs to both stimuli displayed notable age-dependent changes in their scalp topography and significant amplitude reduction and latency prolongation in the elderly. These amplitude and latency changes were at similar rates for the two stimulus types, implying that the auditory TFS and envelope processing mechanisms are proportionally affected by physiological aging. These results may serve as control data in future studies investigating the effect of aging-associated cognitive pathologies on auditory TFS processing.

Towards understanding how we pay attention in naturalistic visual search settings

Research on attentional control has largely focused on single senses and the importance of behavioural goals in controlling attention. However, everyday situations are multisensory and contain regularities, both likely influencing attention. We investigated how visual attentional capture is simultaneously impacted by top-down goals, the multisensory nature of stimuli, and the contextual factors of stimuli's semantic relationship and temporal predictability. Participants performed a multisensory version of the Folk et al. (1992) spatial cueing paradigm, searching for a target of a predefined colour (e.g. a red bar) within an array preceded by a distractor. We manipulated: 1) stimuli's goal-relevance via distractor's colour (matching vs. mismatching the target), 2) stimuli's multisensory nature (colour distractors appearing alone vs. with tones), 3) the relationship between the distractor sound and colour (arbitrary vs. semantically congruent) and 4) the temporal predictability of distractor onset. Reaction-time spatial cueing served as a behavioural measure of attentional selection. We also recorded 129-channel event-related potentials (ERPs), analysing the distractor-elicited N2pc component both canonically and using a multivariate electrical neuroimaging framework. Behaviourally, arbitrary target-matching distractors captured attention more strongly than semantically congruent ones, with no evidence for context modulating multisensory enhancements of capture. Notably, electrical neuroimaging of surface-level EEG analyses revealed context-based influences on attention to both visual and multisensory distractors, in how strongly they activated the brain and type of activated brain networks. For both processes, the context-driven brain response modulations occurred long before the N2pc time-window, with topographic (network-based) modulations at ∼30 ms, followed by strength-based modulations at ∼100 ms post-distractor onset. Our results reveal that both stimulus meaning and predictability modulate attentional selection, and they interact while doing so. Meaning, in addition to temporal predictability, is thus a second source of contextual information facilitating goal-directed behaviour. More broadly, in everyday situations, attention is controlled by an interplay between one's goals, stimuli's perceptual salience, meaning and predictability. Our study calls for a revision of attentional control theories to account for the role of contextual and multisensory control.

Linking knowledge with action when engagement is out of reach: three contextual features of effective public health communication.

Scholars and practitioners often promote direct engagement between policymakers, health workers and researchers as a strategy for overcoming barriers to utilizing scientific knowledge in health policy. However, in many settings public health officials rarely have opportunities to interact with researchers, which is a problem further exacerbated by the coronavirus disease 2019 pandemic. One prominent theory argues that policy actors will trust and utilize research findings when they perceive them to be salient, credible and legitimate. We draw on this theory to examine the conditions facilitating greater uptake of new knowledge among health officials when engagement is out of reach and they are instead exposed to new ideas through written mass communication. Using data from a survey experiment with about 260 health workers and administrators in Honduras, we find that messages from a technocratic sender based on statistical evidence improved perceptions of salience, credibility and legitimacy (SCL). Additionally, perceptions of SCL are three contextual features that operate as joint mediators between knowledge and action, and several individual characteristics also influence whether officials trust research findings enough to apply them when formulating and implementing health policies. This research can help inform the design of context-sensitive knowledge translation and exchange strategies to advance the goals of evidence-based public health, particularly in settings where direct engagement is difficult to achieve.

Neural dynamics between anterior insular cortex and right supramarginal gyrus dissociate genuine affect sharing from perceptual saliency of pretended pain.

Empathy for pain engages both shared affective responses and self-other distinction. In this study, we addressed the highly debated question of whether neural responses previously linked to affect sharing could result from the perception of salient affective displays. Moreover, we investigated how the brain network involved in affect sharing and self-other distinction underpinned our response to a pain that is either perceived as genuine or pretended (while in fact both were acted for reasons of experimental control). We found stronger activations in regions associated with affect sharing (anterior insula [aIns] and anterior mid-cingulate cortex) as well as with affective self-other distinction (right supramarginal gyrus [rSMG]), in participants watching video clips of genuine vs. pretended facial expressions of pain. Using dynamic causal modeling, we then assessed the neural dynamics between the right aIns and rSMG in these two conditions. This revealed a reduced inhibitory effect on the aIns to rSMG connection for genuine pain compared to pretended pain. For genuine pain only, brain-to-behavior regression analyses highlighted a linkage between this inhibitory effect on the one hand, and pain ratings as well as empathic traits on the other. These findings imply that if the pain of others is genuine and thus calls for an appropriate empathic response, neural responses in the aIns indeed seem related to affect sharing and self-other distinction is engaged to avoid empathic over-arousal. In contrast, if others merely pretend to be in pain, the perceptual salience of their painful expression results in neural responses that are down-regulated to avoid inappropriate affect sharing and social support.

Neurophysiology of non-native sound discrimination: Evidence from German vowels and consonants in successive French–German bilinguals using an MMN oddball paradigm

Abstract The present electroencephalographical multi-speaker MMN oddball experiment was designed to study the phonological processing of German native and non-native speech sounds. Precisely, we focused on the perception of German /ɪ-iː/, /ɛ-ɛː/, /a-aː/ and the fricatives [ʃ] and [ç] in German natives (GG) and French learners of German (FG). As expected, our results showed that GG were able to discriminate all the critical vowel contrasts. In contrast, FG, despite their high L2 proficiency level, were only marginally sensitive to vowel length variations. Finally, neither GG nor FG discriminated the opposition between [ʃ] and [ç], as revealed by the absence of MMN response. This latter finding was interpreted in terms of low perceptual salience. Taken together, the present findings lend partial support to the Perceptual Assimilation Model for late bilinguals (PAM-L2) for speech perception of non-native phonological contrasts.

Stakeholder Salience and Firm Responses to Stakeholder Claims: Insights from Family Firms

Addressing the claims of multiple and diverse stakeholders is a critical managerial task, which involves trade-offs and compromises. Drawing on the application of stakeholder theory to family businesses, our study provides insights on the attributes and cognitive mechanisms that affect perceptions of stakeholders salience in these unique type of organizations. Buiding on the key tenet that the coexistence of family and business systems creates a unique stakeholder setting, we offer a typology of response scenarios to stakeholder claims that bridges relational (i.e., stakeholder-firm relationship) and cognitive (i.e., goals) elements. Our study yields a novel perspective which illuminates the mechanisms that drive family firms’ response to stakeholder claims.

An exploration into Penultimate and Final Lengthening in Tswana (Southern Bantu)

This study investigates the segmental lengthening patterns resulting from prosodic boundaries in Tswana, a Southern Bantu language. The aim is to shed light on the interaction between Penultimate Lengthening and Final Lengthening, providing the first quantitative investigation of these phenomena in Tswana. We conducted a production experiment that applies a widely tested design to elicit production data of two different phrasal structures in coordinated noun phrases. The results suggest that Penultimate Lengthening and Final Lengthening constitute independent mechanisms, which both apply in Tswana. Penultimate Lengthening occurs before prosodic phrase boundaries as well as before word boundaries, yet at differing degrees. Before phrase boundaries, it involves a strong lengthening effect on the vowel of the penultimate syllable. Before word boundaries, the amount of lengthening is smaller. Final lengthening operates on the final syllable before a phrase boundary, involving a larger amount on the final vowel than on the preceding consonant. This pattern is in line with the pattern observed in other languages. The amount of lengthening on the final vowel is comparable to the amount on the penultimate vowel. Given that a large increase of lengthening on the penultimate syllable has not been observed in connection with Final Lengthening, we assume that Penultimate Lengthening constitutes a language-specific mechanism that applies independently. Final Lengthening, on the other hand, might be a universal phenomenon. The perceptual salience of Penultimate Lengthening, which has been widely reported in the literature for Bantu languages, might have to do with the dynamics within the lengthening domains, namely that the lengthening in penultimate position is abrupt and relatively stronger than in final position when compared to the preceding syllable.

Baseline levels of alertness influence tES effects along different age-related directions

Normal aging is usually accompanied by several structural and functional physiological changes of the brain, which are closely related to alterations of cognitive functions (e.g., visual short-term memory). As the average age of the population increases, it has become crucial to identify cognitive-behavioural interventions to maintain a healthy level of cognitive performance. Among a variety of approaches, the targeting of specific intrinsic alertness mechanisms has shown a solid rationale and beneficial effects in both healthy and pathological ageing. In a similar vein, the use of non-invasive transcranial electrical stimulation (tES) represents another promising approach to induce an alerting state that can produce advantages in the information processing in the brain and therefore behaviour. Here, we investigated whether time-locked bursts of tES (i.e., transcranial random noise stimulation) were effective in inducing behavioural and physiological changes, consistently with an alertness increase, in both young and older healthy adults. Namely, we expected to find a beneficial alerting effect on visual short-term memory performance as a function of stimulus perceptual salience and tES. The initial results showed that the performance of younger adults was not affected by tES, while older adults scored lower correct responses for high-salience stimuli during real tES with respect to sham stimulation. However, after including a baseline measure of subjective level of alertness in the analyses, a tES-induced memory improvement did emerge in the less alerted younger adults, while only the more alerted older adults were subject to the worsening effect by tES. We discuss these results in consideration of the evidence on critical age-related differences as well as the interaction between neurostimulation and baseline alerting mechanisms.

Focus Attracts Attachment.

There is growing evidence that pitch accents as well as prosodic boundaries can affect syntactic attachment. But is this an effect of their perceptual salience (the Salience Hypothesis), or is it because accents mark the position of focus (the Focus Attraction Hypothesis)? A pair of auditory comprehension experiments shows that focus position, as indicated by preceding wh-questions instead of by pitch accents, affects attachment by drawing the ambiguous phrase to the focus. This supports the Focus Attraction Hypothesis (or a pragmatic version of salience) for both these results and previous results of accents on attachment. These experiments show that information structure, as indicated with prosody or other means, influences sentence interpretation, and suggests a view on which modifiers are drawn to the most important information in a sentence.

Listeners with congenital amusia are sensitive to context uncertainty in melodic sequences

In typical listeners, the perceptual salience of a surprising auditory event depends on the uncertainty of its context. For example, in melodies, pitch deviants are more easily detected and generate larger neural responses when the context is highly predictable than when it is less so. However, it is not known whether amusic listeners with abnormal pitch processing are sensitive to the degree of uncertainty of pitch sequences and, if so, whether they are to a different extent than typical non-musician listeners. To answer this question, we manipulated the uncertainty of short melodies while participants with and without congenital amusia underwent EEG recordings in a passive listening task. Uncertainty was manipulated by presenting melodies with different levels of complexity and familiarity, under the assumption that simpler and more familiar patterns would enhance pitch predictability. We recorded mismatch negativity (MMN) responses to pitch, intensity, timbre, location, and rhythm deviants as a measure of auditory surprise. In both participant groups, we observed reduced MMN amplitudes and longer peak latencies for all sound features with increasing levels of complexity, and putative familiarity effects only for intensity deviants. No significant group-by-complexity or group-by-familiarity interactions were detected. However, in contrast to previous studies, pitch MMN responses in amusics were disrupted in high complexity and unfamiliar melodies. The present results thus indicate that amusics are sensitive to the uncertainty of melodic sequences and that preattentive auditory change detection is greatly spared in this population across sound features and levels of predictability. However, our findings also hint at pitch-specific impairments in this population when uncertainty is high, thus suggesting that pitch processing under high uncertainty conditions requires an intact frontotemporal loop.

When the Body Belies the Words: Embodied Agency With darf/kann ich? (“May/Can I?”) in German

Research on multimodal interaction has shown that simultaneity of embodied behavior and talk is constitutive for social action. In this study, we demonstrate different temporal relationships between verbal and embodied actions. We focus on uses of German darf/kann ich? (“may/can I?”) in which speakers initiate, or even complete the embodied action that is addressed by the turn before the recipient's response. We argue that through such embodied conduct, the speaker bodily enacts high agency, which is at odds with the low deontic stance they express through their darf/kann ich?-TCUs. In doing so, speakers presuppose that the intersubjective permissibility of the action is highly probable or even certain. Moreover, we demonstrate how the speaker's embodied action, joint perceptual salience of referents, and the projectability of the action addressed with darf/kann ich? allow for a lean syntactic design of darf/kann ich?-TCUs (i.e., pronominalization, object omission, and main verb omission). Our findings underscore the reflexive relationship between lean syntax, sequential organization and multimodal conduct.

Neuronal figure-ground responses in primate primary auditory cortex.

SummaryFigure-ground segregation, the brain’s ability to group related features into stable perceptual entities, is crucial for auditory perception in noisy environments. The neuronal mechanisms for this process are poorly understood in the auditory system. Here, we report figure-ground modulation of multi-unit activity (MUA) in the primary and non-primary auditory cortex of rhesus macaques. Across both regions, MUA increases upon presentation of auditory figures, which consist of coherent chord sequences. We show increased activity even in the absence of any perceptual decision, suggesting that neural mechanisms for perceptual grouping are, to some extent, independent of behavioral demands. Furthermore, we demonstrate differences in figure encoding between more anterior and more posterior regions; perceptual saliency is represented in anterior cortical fields only. Our results suggest an encoding of auditory figures from the earliest cortical stages by a rate code.

Top-down and bottom-up guidance in normal aging during scene search.

Age-related differences in visual search have been extensively studied using simple item arrays, showing an attentional decline. Little is known about how aging affects attentional guidance during search in more complex scenes. To study this issue, we analyzed eye-movement behavior in realistic scene search. We examined age-related differences in top-down guidance, manipulating target template specificity (picture vs. word cue) and target-scene semantic consistency (consistent vs. inconsistent), and in bottom-up guidance, manipulating perceptual salience (high vs. low) of targets and distractors. Compared to young adults (YA), older adults (OA) were overall slower, from the first saccade in the scene. They showed a smaller benefit of a specific target template, suggesting that precision of visual information in working memory may decrease with age. The benefit of semantic consistency did not depend on age, suggesting a preserved ability in OA to use knowledge about object occurrence in scenes. OA showed greater bottom-up search facilitation due to target's high salience, which may depend on reduced selection of low-salience stimuli. Attentional capture by distractors was greater in OA than YA, with respect to engagement (probability of distractor fixation), but only following a picture cue, and disengagement (fixation duration on distractors) in all conditions. Overall, our study shows that age-related differences in visual selection of targets and distractors depend on specific task demands in terms of top-down and bottom-up guidance. It also indicates that scene search difficulties in OA can be limited by cognitive and perceptual forms of environmental support. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

When Home is Not Safe: Media Coverage and Issue Salience of Child Maltreatment during the COVID-19 Pandemic

While staying at home is crucial for controlling the COVID-19 pandemic, there is concern that such public health measures may increase the risk for child maltreatment (CM). Using a qualitative content analysis of news coverage and a quantitative survey (N = 250) of media consumers, this study explored the framing of CM as an issue during COVID-19, as well as audience recall and perceived efficacy to prevent maltreatment. Findings from the content analysis indicate that domestic violence and CM are frequently discussed together, and that less frequent interaction with mandatory reporters during the pandemic was often cited as a problem. Survey results suggest that social media and public service announcements are more important compared to news media for increasing audience perceptions of salience and efficacy around CM during a pandemic. Implications for studying media coverage of intertwined public health issues, like a pandemic and CM, are discussed.

Identifying songs from their piano-driven opening chords

It is currently believed that timbre plays a primary role in the identification of songs from very brief excerpts of music. However, its specific contribution, and those of other characteristics of the music, remain unclear. The aim of the present study was to investigate the contributions of timbre and chord type, voicing, and duration to participants’ ability to identify songs from their opening chords, played on the piano alone or on the piano and one other instrument. Ninety-three participants were asked to identify 20 songs from their opening chords. They were also asked to estimate the similarity between pairs of chords. We evaluated the contribution of 10 characteristics of chords to song identification rates, including brightness, pitch register, and duration, because of their high perceptual salience, and others chosen on the basis of theoretical predictions relating to auditory long-term memory. Song identification rates were associated with the chords’ brightness, familiarity and, to a lesser extent, pitch register, but not participants’ musical background. The results of the study suggest that listeners with and without musical training can identify songs from their opening chords, cued by both their timbral and non-timbral characteristics.