Perceptual Judgments Research Articles

Memory-based predictions facilitate perceptual judgements across head-turns in naturalistic scene perception

Memory-based predictions facilitate perceptual judgements across head-turns in naturalistic scene perception

Tactile estimation of hedonic and sensory properties during active touch: An electroencephalography study.

Perceptual judgements about our physical environment are informed by somatosensory information. In real-world exploration, this often involves dynamic hand movements to contact surfaces, termed active touch. The current study investigated cortical oscillatory changes during active exploration to inform the estimation of surface properties and hedonic preferences of two textured stimuli: smooth silk and rough hessian. A purpose-built touch sensor quantified active touch, and oscillatory brain activity was recorded from 129-channel electroencephalography. By fusing these data streams at a single trial level, oscillatory changes within the brain were examined while controlling for objective touch parameters (i.e., friction). Time-frequency analysis was used to quantify changes in cortical oscillatory activity in alpha (8-12 Hz) and beta (16-24 Hz) frequency bands. Results reproduce findings from our lab, whereby active exploration of rough textures increased alpha-band event-related desynchronisation in contralateral sensorimotor areas. Hedonic processing of less preferred textures resulted in an increase in temporoparietal beta-band and frontal alpha-band event-related desynchronisation relative to most preferred textures, suggesting that higher order brain regions are involved in the hedonic processing of texture. Overall, the current study provides novel insight into the neural mechanisms underlying texture perception during active touch and how this process is influenced by cognitive tasks.

Continuous synthesis of artificial speech sounds from human cortical surface recordings during silent speech production

Objective. Brain–computer interfaces can restore various forms of communication in paralyzed patients who have lost their ability to articulate intelligible speech. This study aimed to demonstrate the feasibility of closed-loop synthesis of artificial speech sounds from human cortical surface recordings during silent speech production. Approach. Ten participants with intractable epilepsy were temporarily implanted with intracranial electrode arrays over cortical surfaces. A decoding model that predicted audible outputs directly from patient-specific neural feature inputs was trained during overt word reading and immediately tested with overt, mimed and imagined word reading. Predicted outputs were later assessed objectively against corresponding voice recordings and subjectively through human perceptual judgments. Main results. Artificial speech sounds were successfully synthesized during overt and mimed utterances by two participants with some coverage of the precentral gyrus. About a third of these sounds were correctly identified by naïve listeners in two-alternative forced-choice tasks. A similar outcome could not be achieved during imagined utterances by any of the participants. However, neural feature contribution analyses suggested the presence of exploitable activation patterns during imagined speech in the postcentral gyrus and the superior temporal gyrus. In future work, a more comprehensive coverage of cortical surfaces, including posterior parts of the middle frontal gyrus and the inferior frontal gyrus, could improve synthesis performance during imagined speech. Significance. As the field of speech neuroprostheses is rapidly moving toward clinical trials, this study addressed important considerations about task instructions and brain coverage when conducting research on silent speech with non-target participants.

A cognitive dissonance approach to moderating listener perception of L2 English speakers

ABSTRACT Research has shown that listener bias and stereotyping affect listeners’ attitudes towards L2 English speakers [Lindemann, S., Litzenberg, J., & Subtirelu, N. (2014). Problematizing the Dependence on L1 Norms in Pronunciation Teaching: Attitudes Toward Second-Language Accents. In J. Levis & A. Moyer (Eds.). Social Dynamics in Second Language Accent (171–194)]. However, little research has explored ways to mitigate such prejudice to combat the linguistic discrimination prevalent in our society [Kang, O., D. Rubin, and S. Lindemann. 2015. “Mitigating U.S. Undergraduates’ Attitudes Toward International Teaching Assistants.” TESOL Quarterly 49 (4): 681–706; Subtirelu, N. C., and S. Lindemann. 2016. “Teaching First Language Speakers to Communicate Across Linguistic Difference: Addressing Attitudes, Comprehension, and Strategies.” Applied Linguistics 37 (6): 765–783]. The present study explored the effect of a one-week intervention on U.S. undergraduate students’ perception of L2 speakers. This study included three intact undergraduate-level writing classes (n = 25 each), two intervention groups and one control. Before the intervention, all students completed a perception questionnaire to measure listener perceptual judgement of language attitude, comprehensibility, and accentedness of L2 English speakers. The intervention included (a) one 50-minute discussion which explicitly addressed social justice issues related to multilingual speakers, designed according to the cognitive dissonance theory [Festinger, L. 1957. A Theory of Cognitive Dissonance. Evanston, IL: Row, Peterson] and (b) three 50-minute laboratory sessions for reflection papers. An immediate post-test and a delayed post-test (11 weeks after) were administered. Linear mixed-effects models showed significant and sustained improvement of language attitude and comprehensibility ratings for the intervention groups across time, but not for the control group. The findings provide a relatively short, easily replicable, and sustainably effective intervention program to mitigate listener bias against L2 English speakers.

Do children better understand adults or themselves? An acoustic and perceptual study of the complex sibilant system of Polish

This paper reports a developmental production-perception study of the three-way Polish sibilant contrast /s, ʂ, ɕ/ in typically developing children (N = 76). Children aged 2;11–7;11 produced words with sibilants in word-medial and initial position. They then identified the same words they produced, and the words as produced by an unknown adult female. Results show higher identification accuracy for adult productions across all ages. Production and perception data suggest that the alveolo-palatal /ɕ/ is acquired first, and that it is differentiated mainly by formant patterns. In the perceptual discrimination task, most errors were found for child-produced /ʂ/, and this persisted into the oldest ages. Early acquisition of /ɕ/ has been observed in other languages and may reflect motoric considerations as well as a focus on formant information in child speech perception. Cue weighting appears to change over age in sibilant-specific ways. While all children weight formants highest for /ɕ/, spectral cues appear to be more important for /s/ and /ʂ/, and reliance on formants may decrease with age. This work contributes to the study of cross-language differences in acquisition, provides an acoustic characterization of child-produced Polish sibilants, and elucidates the acoustic characteristics that children use in perceptual judgments of sibilants.

Advances in Clinical Voice Quality Analysis with VOXplot.

The assessment of voice quality can be evaluated perceptually with standard clinical practice, also including acoustic evaluation of digital voice recordings to validate and further interpret perceptual judgments. The goal of the present study was to determine the strongest acoustic voice quality parameters for perceived hoarseness and breathiness when analyzing the sustained vowel [a:] using a new clinical acoustic tool, the VOXplot software. A total of 218 voice samples of individuals with and without voice disorders were applied to perceptual and acoustic analyses. Overall, 13 single acoustic parameters were included to determine validity aspects in relation to perceptions of hoarseness and breathiness. Four single acoustic measures could be clearly associated with perceptions of hoarseness or breathiness. For hoarseness, the harmonics-to-noise ratio (HNR) and pitch perturbation quotient with a smoothing factor of five periods (PPQ5), and, for breathiness, the smoothed cepstral peak prominence (CPPS) and the glottal-to-noise excitation ratio (GNE) were shown to be highly valid, with a significant difference being demonstrated for each of the other perceptual voice quality aspects. Two acoustic measures, the HNR and the PPQ5, were both strongly associated with perceptions of hoarseness and were able to discriminate hoarseness from breathiness with good confidence. Two other acoustic measures, the CPPS and the GNE, were both strongly associated with perceptions of breathiness and were able to discriminate breathiness from hoarseness with good confidence.

Performance variability and affordance perception: practice effects on perceptual judgments for walking versus throwing.

To judge whether an action is possible, people must perceive "affordances"-the fit between features of the environment and aspects of their own bodies and motor skills that make the action possible or not. But for some actions, performance is inherently variable. That is, people cannot consistently perform the same action under the same environmental conditions with the same level of success. Decades of research show that practice performing an action improves perception of affordances. However, prior work did not address whether practice with more versus less variable actions is equally effective at improving perceptual judgments. Thirty adults judged affordances for walking versus throwing a beanbag through narrow doorways before and after 75 practice trials walking and throwing beanbags through doorways of different widths. We fit a "success" function through each participant's practice data in each task and calculated performance variability as the slope of the function. Performance for throwing was uniformly more variable than for walking. Accordingly, absolute judgment error was larger for throwing than walking at both pretest and posttest. However, absolute error reduced proportionally in both tasks with practice, suggesting that practice improves perceptual judgments equally well for more and less variable actions. Moreover, individual differences in variability in performance were unrelated to absolute, constant, and variable error in perceptual judgments. Overall, results indicate that practice is beneficial for calibrating perceptual judgments, even when practice provides mixed feedback about success under the same environmental conditions.

Improving causality perception judgments in schizophrenia spectrum disorder via transcranial direct current stimulation.

Deficient causality perception and attribution may underlie key symptoms of schizophrenia spectrum disorder (SSD), such as delusions and ideas of reference. Although transcranial direct current stimulation (tDCS) can increase the influence of spatial information on perceptual causality judgments among healthy participants, its effect among patients with SSD remains unknown. We sought to determine whether tDCS modulates the contribution of stimulus characteristics to perceptual causality judgments among patients with SSD; we predicted that right parietal tDCS would increase the influence of spatial stimulus characteristics on patients' causality perception. Patients with SSD received frontal, parietal, frontoparietal and sham tDCS in 4 separate sessions. Pre- and post-tDCS, patients viewed video clips of ball A colliding with ball B. Spatial linearity (ball B's angle of egress) and temporal contiguity (delay between collision and ball B's movement) varied parametrically. After each launching event, patients rated perceived causality. Among 19 patients with SSD, we found a brain region-dependent effect of tDCS regarding sensitivity to violations of spatial linearity. After right parietal anodal tDCS, the influence of angle variations on patients' perceptual causality judgments increased, reflected by a higher probability of perceived causality for stimuli with small angles and a lower probability of perceived causality for stimuli with high angles. Transcranial direct current stimulation increased the influence of spatial stimulus characteristics on causality perception among patients with SSD. Future research should explore potential links between tDCS-induced changes in basic perceptual processes and clinical symptoms, such as delusions and ideas of reference.

Serial dependence in perception across naturalistic generative adversarial network-generated mammogram.

Human perception and decisions are biased toward previously seen stimuli. This phenomenon is known as serial dependence and has been extensively studied for the last decade. Recent evidence suggests that clinicians' judgments of mammograms might also be impacted by serial dependence. However, the stimuli used in previous psychophysical experiments on this question, consisting of artificial geometric shapes and healthy tissue backgrounds, were unrealistic. We utilized realistic and controlled generative adversarial network (GAN)-generated radiographs to mimic images that clinicians typically encounter. Mammograms from the digital database for screening mammography (DDSM) were utilized to train a GAN. This pretrained GAN was then adopted to generate a large set of authentic-looking simulated mammograms: 20 circular morph continuums, each with 147 images, for a total of 2940 images. Using these stimuli in a standard serial dependence experiment, participants viewed a random GAN-generated mammogram on each trial and subsequently matched the GAN-generated mammogram encountered using a continuous report. The characteristics of serial dependence from each continuum were analyzed. We found that serial dependence affected the perception of all naturalistic GAN-generated mammogram morph continuums. In all cases, the perceptual judgments of GAN-generated mammograms were biased toward previously encountered GAN-generated mammograms. On average, perceptual decisions had 7% categorization errors that were pulled in the direction of serial dependence. Serial dependence was found even in the perception of naturalistic GAN-generated mammograms created by a GAN. This supports the idea that serial dependence could, in principle, contribute to decision errors in medical image perception tasks.

Modulation of response activation leads to biases in perceptuomotor decision making.

Humans are constantly enacting motor responses based on perceptual judgments or decisions. Recent work suggests that accumulating evidence for a decision and planning the action to enact the decision are coupled. Further, decision commitment may occur when the action reaches its motor threshold. Across several experiments, this coupled perception-action account of perceptuomotor decision making was tested by determining if increasing response activation corresponding to one decision influenced the evidence needed to make that decision. Participants were presented with stimuli that contained varying ratios of yellow-to-blue squares and made a speeded left/right-hand response to report whether the stimulus had more yellow or blue squares, respectively. Response activation was modulated by presenting stimuli laterally on the screen-spatially compatible or incompatible with the color reports. When stimuli appeared leftward (spatially compatible with a left response/"yellow" report), the threshold for a "yellow" perceptuomotor decision was reduced-consistent with the hypothesis that increasing "yellow" response activation would lead to a "yellow" reporting bias. Further, when stimuli appeared rightward (spatially compatible with a right response/"blue" report), the threshold for a "blue" perceptuomotor decision was reduced. An additional experiment revealed that directional saccades occurring during the task were unlikely to account for biases. Overall, spatially induced response activation influenced the decision outcomes, providing support for a tightly coupled perception-action system underlying perceptuomotor decisions. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Late Blindness and Deafness are Associated with Decreased Tactile Sensitivity, But Early Blindness is Not

Perceptual experience is shaped by a complex interaction between our sensory systems in which each sense conveys information on specific properties of our surroundings. This multisensory processing of complementary information improves the accuracy of our perceptual judgments and leads to more precise and faster reactions. Sensory impairment or loss in one modality leads to information deficiency that can impact other senses in various ways. For early auditory or visual loss, impairment and/or compensatory increase of the sensitivity of other senses are equally well described. Investigating individuals with deafness (N = 73), early (N = 51), late blindness (N = 49) and corresponding controls, we compared tactile sensitivity using the standard monofilament test on two locations, the finger and handback. Results indicate lower tactile sensitivity in people with deafness and late blindness but not in people with early blindness compared to respective controls, irrespective of stimulation location, gender, and age. Results indicate that neither sensory compensation nor simple use-dependency or a hindered development of the tactile sensory system is sufficient to explain changes in somatosensation after the sensory loss but that a complex interaction of effects is present.

PeCo: Perceptual Codebook for BERT Pre-training of Vision Transformers

This paper explores a better prediction target for BERT pre-training of vision transformers. We observe that current prediction targets disagree with human perception judgment. This contradiction motivates us to learn a perceptual prediction target. We argue that perceptually similar images should stay close to each other in the prediction target space. We surprisingly find one simple yet effective idea: enforcing perceptual similarity during the dVAE training. Moreover, we adopt a self-supervised transformer model for deep feature extraction and show that it works well for calculating perceptual similarity. We demonstrate that such learned visual tokens indeed exhibit better semantic meanings, and help pre-training achieve superior transfer performance in various downstream tasks. For example, we achieve 84.5% Top-1 accuracy on ImageNet-1K with ViT-B backbone, outperforming the competitive method BEiT by +1.3% under the same pre-training epochs. Our approach also gets significant improvement on object detection and segmentation on COCO and semantic segmentation on ADE20K. Equipped with a larger backbone ViT-H, we achieve the state-of-the-art ImageNet accuracy (88.3%) among methods using only ImageNet-1K data.

Comparison of intelligibility measures for children with velopharyngeal insufficiency: visual analog scale ratings, interval scales, and orthographic transcription (OT)-based measures

ABSTRACT Regardless of the underlying cause for speech impairment in speakers with cleft palate, a universal consequence of cleft palate is reduced speech intelligibility. Still, there is no standardised approach for measuring intelligibility for speakers with cleft speech. The current study aimed to determine the relationship between orthographic transcription (OT)-based measures, interval-scale ratings, and visual analog scale (VAS) ratings for perceptual judgements of intelligibility in speakers with cleft palate as judged by speech-language pathologists (SLPs). The speaker participants were six speakers with velopharyngeal insufficiency secondary to cleft palate. Four sets of sentences from the Hearing in Noise Test were recorded from each speaker. A total of 14 SLPs provided their intelligibility judgement on these speaker’s recordings by word-by-word orthographic transcriptions, a visual analog scale (0–100), and a 5-point interval rating scale. A Spearman rank correlation test indicated a negative, strong correlation between OT-based measurements and VAS scores (r = −.94; p = 0.01) and between OT-based measurements and interval rating scores (r = −.77, p = 0.01). A strong, positive correlation was found between scores obtained from VAS and interval rating scales (r = .83, p = 0.05). The strong relationship between the objective measure of intelligibility (i.e. OT-based measure) and a subjective measure of intelligibility (i.e. VAS and interval scale) supports using a less time-consuming VAS as a substitute for orthographic transcription in measuring intelligibility in cleft palate speech.

Sensorimotor expertise influences perceptual weight judgments during observation of a sport-specific gesture.

This study aimed to investigate the role of sensorimotor expertise in evaluating relative weight of a lifted object during the observation of a sport-specific gesture, namely the deadlift. Fifty-six participants, assigned to three groups according to their experience in weight lifting, powerlifters, CrossFit® practitioners and naïve participants (controls), performed a perceptual weight judgments task. Participants observed videos showing a powerlifter executing a deadlift at the 80%, 90% and 100% of 1 repetition maximum (1RM) and answered a question about the weight of the lifted object. Participants' response accuracy and variability were evaluated. Findings showed that powerlifters were more accurate than controls. No differences appeared between powerlifter and CrossFit® practitioners, and between CrossFit® practitioners and controls. Response variability was similar in the three groups. These findings suggest that a fine sensorimotor expertise specific for the observed gesture is crucial to detect the weight of the object displayed in the observed movement, since it might allow detecting small changes in the observed movement kinematics, which we speculate are at the basis of the object weight recognition.

Research on parametric design of men's suit lapel based on knowledge

PurposeThe purpose of this paper is to improve the efficiency of pattern-making for suit lapels in the apparel industry, to master the perceptual knowledge of suit lapels and to establish a mapping relationship between suit lapel styles and perceptual judgment.Design/methodology/approachIn this paper, notch lapel, peak lapel and shawl lapel are studied, and the authors extract the structural features in the order of drafting as the input values for model training. At the same time, after the expert screening, four perceptual evaluation dimensions based on a priori knowledge are selected as output values, which are finally classified using a decision tree algorithm.FindingsThe results show that different design parameters produce different perceptions of people's vision and, thus, different perceptual judgments. The decision tree model can effectively classify the perceptual judgment of the lapel shape.Originality/valueThe findings of this study help garment factories to provide optimal judgment of basic parameters before the production of a suit lapel and to improve the efficiency of the design.

The Oxford Face Matching Test: Short-form alternative.

A recently published test of face perception, the Oxford Face Matching Test, asks participants to make two judgements: whether two faces are of the same individual and how perceptually similar the two faces are. In this study, we sought to determine to what extent the test can be shortened by removing the perceptual similarity judgements and whether this affects test performance. In Experiment 1, participants completed two versions of the test, with and without similarity judgements, in separate sessions in counterbalanced order. The version without similarity judgements took approximately 40% less time to complete. Performance on the matching judgements did not differ across versions and the correlation in accuracy across the two versions was comparable with the originally reported test-retest reliability value. Experiment 2 validated the version without similarity judgements against other measures, demonstrating moderate relationships with other face matching, memory, and self-report face perception measures. These data indicate that a test version without the similarity judgements can substantially reduce administration time without affecting test performance.

Social interoception: Perceiving events during cardiac afferent activity makes people more suggestible to other people's influence

Our judgements are often influenced by other people's views and opinions. Interoception also influences decision making, but little is known about its role in social influence and particularly, the extent to which other people may influence our decisions. Across two experiments, using different forms of social influence, participants judged the trustworthiness of faces presented either during the systolic phase of the cardiac cycle, when baroreceptors convey information from the heart to the brain, or during diastolic phase, when baroreceptors are quiescent. We quantified the extent to which participants changed their minds (as an index of social influence) following the social feedback, in order to compare two competing hypotheses. According to the Arousal-Confidence Hypothesis, cardiac signals create a context of heightened bodily arousal that increases confidence in perceptual judgements. People should, therefore, be less subject to social influence during systole. By contrast, according to the Uncertainty-Conformity Hypothesis, cardiac signals increase neural noise and sensory attenuation, such that people should display greater effects of social influence during systole, as they then underweight private interoceptive signals in favour of the external social information. Across two studies that used different kind of social interactions, we found that participants changed their minds more when faces were presented at systole. Our results, therefore, support the Uncertainly-Conformity hypothesis and highlight how cardiac afferent signals contribute to shape our social decision-making in different types of social interactions.

A Systematic Analysis of Non-accidental Visual-Spatial Properties in Chinese Brand Names and Their Esthetic Associations

Despite the vast and growing body of literature on brand naming, most theories and principles were developed in Western markets and based on Western languages, and therefore have limited application in a Chinese-speaking context. Building on the psychogeometric theory, this study systematically examined the role of non-accidental visual-spatial properties of ‘symmetry’ and ‘closure’ in Chinese brand names. A content analysis of 15,065 newly registered Chinese brands was first conducted to reveal the pattern of visual spatial properties in Chinese brand names. This is followed by a survey study of 760 non-Chinese speaking participants about their perceptions of the visual spatial properties of the Chinese brand names. It was found that Chinese brand names utilized a high proportion of symmetry but a low proportion of closure, with their distributions varying significantly across product categories. The survey results further indicate that Chinese brand names possessing these two visual properties triggered specific esthetic associations and were believed to be more appropriate for certain product categories. These findings are useful for new brands seeking visual-spatial cues with which to positively influence consumers’ perceptual processing and judgments.

Learning spatial frequency identification through reweighted decoding.

Perceptual learning, the improvement of perceptual judgments with practice, occurs in many visual tasks. There are, however, relatively fewer studies examining perceptual learning in spatial frequency judgments. In addition, perceptual learning has generally been studied in two-alternative tasks, occasionally in n-alternative tasks, and infrequently in identification. Recently, perceptual learning was found in an orientation identification task (eight-alternatives) and was well accounted for by a new identification integrated reweighting theory (I-IRT) (Liu et al., submitted). Here, we examined perceptual learning in a similar eight-alternative spatial frequency absolute identification task in two different training protocols, finding learning in the majority but not all observers. We fit the I-IRT to the spatial frequency learning data and discuss possible model explanations for variations in learning.

Head and body cues guide eye movements and facilitate target search in real-world videos.

Static gaze cues presented in central vision result in observer shifts of covert attention and eye movements, and benefits in perceptual performance in the detection of simple targets. Less is known about how dynamic gazer behaviors with head and body motion influence search eye movements and performance in perceptual tasks in real-world scenes. Participants searched for a target person (yes/no task, 50% presence), whereas watching videos of one to three gazers looking at a designated person (50% valid gaze cue, looking at the target). To assess the contributions of different body parts, we digitally erase parts of the gazers in the videos to create three different body parts/whole conditions for gazers: floating heads (only head movements), headless bodies (only lower body movements), and the baseline condition with intact head and body. We show that valid dynamic gaze cues guided participants' eye movements (up to 3 fixations) closer to the target, speeded the time to foveate the target, reduced fixations to the gazers, and improved target detection. The effect of gaze cues in guiding eye movements to the search target was the smallest when the gazer's head was removed from the videos. To assess the inherent information about gaze goal location for each body parts/whole condition, we collected perceptual judgments estimating gaze goals by a separate group of observers with unlimited time. Observers' perceptual judgments showed larger estimate errors when the gazer's head was removed. This suggests that the reduced eye movement guidance from lower body cueing is related to observers' difficulty extracting gaze information without the presence of the head. Together, the study extends previous work by evaluating the impact of dynamic gazer behaviors on search with videos of real-world cluttered scenes.