Perceptual Foundations Research Articles

Perceptual Foundation and Extension to Phase Tagging for Rapid Invisible Frequency Tagging (RIFT)

Abstract Recent years have seen the emergence of a visual stimulation protocol called Rapid Invisible Frequency Tagging (RIFT) in cognitive neuroscience. In RIFT experiments, visual stimuli are presented at a rapidly and sinusoidally oscillating luminance, using high refresh rate projection equipment. Such stimuli result in strong steady-state responses in visual cortex, measurable extracranially using EEG or MEG. The high signal-to-noise ratio of these neural signals, combined with the alleged invisibility of the manipulation, make RIFT a potentially promising technique to study the neural basis of visual processing. In this study, we set out to resolve two fundamental, yet still outstanding, issues regarding RIFT; as well as to open up a new avenue for taking RIFT beyond frequency tagging per se. First, we provide robust evidence that RIFT is indeed subjectively undetectable, going beyond previous anecdotal reports. Second, we demonstrate that full-amplitude luminance or contrast manipulation offer the best tagging results. Third and finally, we demonstrate that, in addition to frequency tagging, phase tagging can reliably be used in RIFT studies, opening up new avenues for constructing RIFT experiments. Together, this provides a solid foundation for using RIFT in visual cognitive neuroscience.

Visual significations of Monkey King: Hero is Back and Nezha: Birth of the Demon Child

Visual signs can be differentiated into denotative and connotative messages, where denotative messages form the perceptual foundation of an image, and connotative messages engage with a deeper, culturally cognisant layer, imbued with subjective interpretations and aesthetic significations. This study embarks on a qualitative textual analysis with the main aim to elucidate the connotation and denotation of visual significations in two pivotal Chinese animated films, Monkey King: Hero is Back and Nezha: Birth of the Demon Child. Guided by Roland Barthes’ Semiotic theory and Chen’s study, the research delves into the connotative and denotative meanings embodied in the films’ visual elements. The focus is primarily on facial design, physical appearance, clothing, and props, providing a comparative analysis of how these elements function within each film’s narrative framework. The key findings reveal that the visual significations in both films are not merely aesthetic choices but serve as substantial cultural and narrative tools. The characters’ faces, physical appearances, clothing, and props are intricately tied to themes like Chinese opera masks, subversive reconstructions, natural elements, and intangible cultural heritage. These visual cues play a crucial role in reinforcing cultural heritage, spurring innovation, invoking nature reverence, and bolstering national sentiment within film storytelling. Contrasting with previous research that predominantly focused on characters, this study expands the analytical scope to include props, recognising their significance as visual signs in animation. By expanding the analysis to include props alongside characters and visual elements into the analysis, this research offers a more comprehensive and nuanced understanding of Chinese mythological animations. It enriches the academic discourse on animation studies, demonstrating how visual elements can profoundly influence narrative interpretation and cultural representation. The research affirms the cultural and narrative potency of visual signification in animation and underscores the dynamic interplay between tradition and innovation within the realm of Chinese animated films.

The Perception of Similarity, Difference and Opposition.

After considering the pervasiveness of same/different relationships in Psychology and the experimental evidence of their perceptual foundation in Psychophysics and Infant and Comparative Psychology, this paper develops its main argument. Similarity and diversity do not complete the panorama since opposition constitutes a third relationship which is distinct from the other two. There is evidence of this in the previous literature investigating the perceptual basis of opposition and in the results of the two new studies presented in this paper. In these studies, the participants were asked to indicate to what extent pairs of simple bi-dimensional figures appeared to be similar, different or opposite to each other. A rating task was used in Study 1 and a pair comparison task was used in Study 2. Three main results consistently emerged: Firstly, opposition is distinct from similarity and difference which, conversely, are in a strictly inverse relationship. Secondly, opposition is specifically linked to something which points in an allocentrically opposite direction. Thirdly, alterations to the shape of an object are usually associated with the perception of diversity rather than opposition. The implications of a shift from a dyadic (same/different) to a triadic (similar/different/opposite) paradigm are discussed in the final section.

Insights into brain perceptions of the different taste qualities and hedonic valence of food via scalp electroencephalogram

Investigating brain activity is essential for exploring taste-experience related cues. The paper aimed to explore implicit (unconscious) emotional or physiological responses related to taste experiences using scalp electroencephalogram (EEG). We performed implicit measures of tastants of differing perceptual types (bitter, salty, sour and sweet) and intensities (low, medium, and high). The results showed that subjects were partially sensitive to different sensory intensities, i.e., for high intensities, taste stimuli could induce activation of different rhythm signals in the brain, with α and θ bands possibly being more sensitive to different taste types. Furthermore, the neural representations and corresponding sensory qualities (e.g., “sweet: pleasant” or “bitter: unpleasant”) of different tastes could be discriminated at 250–1,500 ms after stimulus onset, and different tastes exhibited distinct temporal dynamic differences. Source localization indicated that different taste types activate brain areas associated with emotional eating, reward processing, and motivated tendencies, etc. Overall, our findings reveal a larger sophisticated taste map that accounted for the diversity of taste types in the human brain and assesses the emotion, reward, and motivated behavior represented by different tastes. This study provided basic insights and a perceptual foundation for the relationship between taste experience-related decisions and the prediction of brain activity.

Individual differences in simultaneous perceptual compensation for coarticulatory and lexical cues

Abstract Idiosyncratic perceptual compensation behaviors are considered to have a bearing on the perceptual foundation of sound change. We investigate how compensation processes driven by lexical and coarticulatory contexts simultaneously affect listeners’ perception of a single segment and the individual differences in the compensation patterns. Sibilants on an /s-ʃ/ continuum were embedded into four lexical frames that differed in whether the lexical context favored /s/ or /ʃ/ perceptually and whether the vocalic context favored /s/ or not. Forty-two participants took a lexical decision task to decide whether each stimulus was a word or not. They also completed the autism-spectrum quotient questionnaire. The aggregate results of the lexical decision task show coexistence of lexically induced and coarticulatorily induced perceptual shifts in parallel. A negative correlation was found between the two kinds of perceptual shifts for individual listeners in lexical decisions, lending support to a potential trade-off between compensation magnitudes on different levels of cue integration.

Math anxiety differentially impairs symbolic, but not nonsymbolic, fraction skills across development.

Although important for the acquisition of later math skills, fractions are notoriously difficult. Previous studies have shown that higher math anxiety (MA) is associated with lower performance in symbolic fraction tasks in adults and have suggested that MA may negatively impact the acquisition of fractions in children. However, the effects of MA on fraction skills in school-aged children remain underexplored. We, therefore, investigated the impact of MA on the performance of younger (second and third graders) and older (fifth and sixth graders) children in math fluency (MF), written calculation, fraction knowledge (FK), and symbolic fraction and nonsymbolic ratio processing. On the basis of our prior work suggesting a perceptual foundation for fraction processing, we predicted that symbolic, but not nonsymbolic, math skills (especially fractions) would be impaired by MA. As predicted, higher MA was associated with lower performance in general mathematics achievement and symbolic fraction tasks, but nonsymbolic ratio processing was not affected by MA in either age group. Furthermore, working memory capacity partially mediated the effects of MA on general mathematics achievement, FK, and symbolic fraction processing. These results suggest that understanding the bidirectional interactions between MA and fractions may be important for helping children acquire these critical skills.

A Neural Dynamic Model of the Perceptual Grounding of Spatial and Movement Relations.

How does the human brain link relational concepts to perceptual experience? For example, a speaker may say "the cup to the left of the computer" to direct the listener's attention to one of two cups on a desk. We provide a neural dynamic account for both perceptual grounding, in which relational concepts enable the attentional selection of objects in the visual array, and for the generation of descriptions of the visual array using relational concepts. In the model, activation in neural populations evolves dynamically under the influence of both inputs and strong interaction as formalized in dynamic field theory. Relational concepts are modeled as patterns of connectivity to perceptual representations. These generalize across the visual array through active coordinate transforms that center the representation of target objects in potential reference objects. How the model perceptually grounds or generates relational descriptions is probed in 104simulations that systematically vary the spatial and movement relations employed, the number of feature dimensions used, and the number of matching and nonmatching objects. We explain how sequences of decisions emerge from the time- and state-continuous neural dynamics, how relational hypotheses are generated and either accepted or rejected, followed by the selection of new objects or the generation of new relational hypotheses. Its neural realism distinguishes the model from information processing accounts, its capacity to autonomously generate sequences of processing steps distinguishes it from deep neural network accounts. The model points toward a neural dynamic theory of highercognition.

Improved Workflow for Fault Detection and Extraction Using Seismic Attributes and Orientation Clustering

Faults represent important analytical targets for the identification of perceptual ground motions and associated seismic hazards. In particular, during oil production, important data such as the path and flow rate of fluid flows can be obtained from information on fault location and their connectivity. Seismic attributes are conventional methods used for fault detection, whereby information obtained from seismic data are analyzed using various property processing methods. The analyzed data eventually provide information on fault properties and imaging of fault surfaces. In this study, we propose an efficient workflow for fault detection and extraction of requisite information to construct a fault surface model using 3D seismic cubes. This workflow not only improves the ability to detect faults but also distinguishes the edges of a fault more clearly, even with the application of fewer attributes compared to conventional workflows. Thus, the computing time of attribute processing is reduced, and fault surface cubes are generated more rapidly. In addition, the reduction in input variables reduces the effect of the interpreter’s subjective intervention on the results. Furthermore, the clustering method can be applied to the azimuth and dip of the fault to be extracted from the complexly intertwined fault faces and subsequently imaged. The application of the proposed workflow to field data obtained from the Vincentian oil field in Australia resulted in a significant reduction in noise compared to conventional methods. It also led to clearer and continuous edge detection and extraction.

Reconstructing maps from text

Previous research has demonstrated that Distributional Semantic Models (DSMs) are capable of reconstructing maps from news corpora (Louwerse & Zwaan, 2009) and novels (Louwerse & Benesh, 2012). The capacity for reproducing maps is surprising since DSMs notoriously lack perceptual grounding. In this paper we investigate the statistical sources required in language to infer maps, and the resulting constraints placed on mechanisms of semantic representation. Study 1 brings word co-occurrence under experimental control to demonstrate that standard DSMs cannot reproduce maps when word co-occurrence is uniform. Specifically, standard DSMs require that direct co-occurrences between city names in a corpus mirror the proximity between the city locations in the map in order to successfully reconstruct the spatial map. Study 2 presents an instance-based DSM that is capable of reconstructing maps independent of the frequency of co-occurrence of city names.

Ratio-based perceptual foundations for rational numbers, and perhaps whole numbers, too?

Clarke and Beck suggest that the ratio processing system (RPS) may be a component of the approximate number system (ANS), which they suggest represents rational numbers. We argue that available evidence is inconsistent with their account and advocate for a two-systems view. This implies that there may be many access points for numerical cognition - and that privileging the ANS may be a mistake.

Exposing futility by searching beneath the concept

The concept of futility in medicine refers to the incapability of an intervention to achieve its goal. Futility determinations form the basis for withholding and withdrawing life-sustaining interventions. Criticisms of attempted futility definitions relate to inconstant probability and value judgements concerning the goal pursued. This variability frustrates efforts to define futility. Language modifications and procedural approaches, both important ancillary measures, inherently lack the ability to resolve this difficulty. Beneath the notion of futility lie foundational factors whose revised understanding is required to advance a definition. These factors include autonomy, death and the goals of medicine. Reconsidering the essence and influence of foundational factors is necessary to move beyond a seemingly irresolvable problem. In this essay, I assert that defining futility is not pointless but rather possible, necessary and unavoidable. With this assertion, I respond to the criticisms of futility. These responses together with a corrective understanding of foundational factors lead to a definition of futility. This definition balances respect for patients’ autonomy whilst allowing for interventions that do not undermine the essence of medicine and integrity of those practising it. Defining futility is an exercise in necessity requiring renewed perceptual foundations.

SineStream: Improving the Readability of Streamgraphs by Minimizing Sine Illusion Effects.

In this paper, we propose SineStream, a new variant of streamgraphs that improves their readability by minimizing sine illusion effects. Such effects reflect the tendency of humans to take the orthogonal rather than the vertical distance between two curves as their distance. In SineStream, we connect the readability of streamgraphs with minimizing sine illusions and by doing so provide a perceptual foundation for their design. As the geometry of a streamgraph is controlled by its baseline (the bottom-most curve) and the ordering of the layers, we re-interpret baseline computation and layer ordering algorithms in terms of reducing sine illusion effects. For baseline computation, we improve previous methods by introducing a Gaussian weight to penalize layers with large thickness changes. For layer ordering, three design requirements are proposed and implemented through a hierarchical clustering algorithm. Quantitative experiments and user studies demonstrate that SineStream improves the readability and aesthetics of streamgraphs compared to state-of-the-art methods.

The neural substrates of visual organization in children and adolescents: An fMRI study

Deficient visual organization ability not only indicates possible brain dysfunctions but further affects an individual’s daily activities. This study aimed to use functional magnetic resonance imaging (fMRI) to investigate the neural network contributing to visual organization abilities in children and adolescents. A two-choice version of the Hooper Visual Organization Test (T-HVOT) was adapted as the fMRI task for the present study. The effects of age and gender on overall visual perceptual functions and related neural foundations were also analyzed. Seventy children and adolescents were administered with the Test of Visual Perceptual Skill-Third Edition and 41 completed the fMRI scans. The whole-brain fMRI mapping results showed the cortical activation of multiple brain areas relating to visual organization. The greatest cortical activities were seen in the middle occipital gyrus, middle temporal gyrus, middle frontal gyrus and inferior frontal gyrus, and two age groups showed significant differences in cortical activation patterns as well. Gender had no significant effects on visual perceptual functions nor related cortical activation patterns. The overall visual perception functions improve with age, and the different cortical activation patterns indicated that the two groups adopt different strategies while performing visual organization tasks. The sensitivity and spatial resolution of fMRI allowed us to make specific conclusions about cortical regions involved in visual organization function and to provide a reference for objectively judging rehabilitative outcomes.

The Visuality of Professionalised Sousveillance

This contribution addresses the visuality deployed in the practice of professionalised sousveillance. I draw on research undertaken with sousveillance activists in Brazilian favelas. By recognising vision as a site of power and identifying the particular visuality central to the policing of favelas, I draw an uncomfortable link between professionalised sousveillance and this police visuality. In acknowledging this relationship, it can be argued that professionalised sousveillance practice unintentionally works to preserve the perceptual foundations of the favela’s social order. I conclude that we should also seek forms of sousveillance practice that engage alternative visualities.

Research on the Application of Reductive Active Learning Method in the Design of Transmission Teaching Aids

In view of the dual pressure of examination oriented and extra-curricular counseling in primary education, this paper discusses the relationship between knowledge acquisition and perceptual experience through the design of teaching aids according to the educational concept of reductive active learning method. Based on life style as logic, the interesting transmission mode is established, and the mechanical knowledge related to force and transmission is transformed into teaching aids that conform to the cognitive law of children aged 6-12. Children get sensory experience through practical operation. Therefore, it enriches the content of science course in primary school, and establishes the perceptual experience foundation for the later learning of mathematics, machinery and physics.

Towards a standard model of musical improvisation.

Musical improvisation is a sophisticated cognitive process that combines creativity, goal-directed action, sensory monitoring and social interaction. With a renewed interest in quantifying creative processes facilitated by recent advances in neuroimaging technology, musical improvisation has emerged as an ideal paradigm to study creativity. However, many studies isolate the top-down processes related to creativity from those related to production and auditory perception, leaving the question of how creative behaviours integrate sensory information with higher cognitive processes unanswered. The bottom-up neural correlates of music perception have been extensively quantified, comprising networks for auditory processing and parsing semantic and syntactic content. In studies of spontaneously generated music and domain-general creativity, executive control and goal-directed movement networks are added to the perceptual foundation. This review summarises previous work on music perception and improvisation and presents a conceptual model of musical improvisation with known neural correlates. We make recommendations on future directions for the study of improvisation and discuss the challenges posed by this endeavour.

Image-Based Aspect Ratio Selection.

Selecting a good aspect ratio is crucial for effective 2D diagrams. There are several aspect ratio selection methods for function plots and line charts, but only few can handle general, discrete diagrams such as 2D scatter plots. However, these methods either lack a perceptual foundation or heavily rely on intermediate isoline representations, which depend on choosing the right isovalues and are time-consuming to compute. This paper introduces a general image-based approach for selecting aspect ratios for a wide variety of 2D diagrams, ranging from scatter plots and density function plots to line charts. Our approach is derived from Federer's co-area formula and a line integral representation that enable us to directly construct image-based versions of existing selection methods using density fields. In contrast to previous methods, our approach bypasses isoline computation, so it is faster to compute, while following the perceptual foundation to select aspect ratios. Furthermore, this approach is complemented by an anisotropic kernel density estimation to construct density fields, allowing us to more faithfully characterize data patterns, such as the subgroups in scatterplots or dense regions in time series. We demonstrate the effectiveness of our approach by quantitatively comparing to previous methods and revisiting a prior user study. Finally, we present extensions for ROI banking, multi-scale banking, and the application to image data.

Interoception: the forgotten modality in perceptual grounding of abstract and concrete concepts.

Conceptual representations are perceptually grounded, but when investigating which perceptual modalities are involved, researchers have typically restricted their consideration to vision, touch, hearing, taste and smell. However, there is another major modality of perceptual information that is distinct from these traditional five senses; that is, interoception, or sensations inside the body. In this paper, we use megastudy data (modality-specific ratings of perceptual strength for over 32 000 words) to explore how interoceptive information contributes to the perceptual grounding of abstract and concrete concepts. We report how interoceptive strength captures a distinct form of perceptual experience across the abstract-concrete spectrum, but is markedly more important to abstract concepts (e.g. hungry, serenity) than to concrete concepts (e.g. capacity, rainy). In particular, interoception dominates emotion concepts, especially negative emotions relating to fear and sadness, moreso than other concepts of equivalent abstractness and valence. Finally, we examine whether interoceptive strength represents valuable information in conceptual content by investigating its role in concreteness effects in word recognition, and find that it enhances semantic facilitation over and above the traditional five sensory modalities. Overall, these findings suggest that interoception has comparable status to other modalities in contributing to the perceptual grounding of abstract and concrete concepts.This article is part of the theme issue 'Varieties of abstract concepts: development, use and representation in the brain'.

Grounding as a Side-Effect of Grounding.

In relation to semantics, "grounding" has (at least) two relevant meanings. "Symbol grounding" is the process of connecting symbols (e.g., words) to perception and the world. "Communicative grounding" is the process of interactively adding to common ground in dialog. Strategies for grounding in human communication include, crucially, strategies for resolving troubles caused by various kinds of miscommunication. As it happens, these two processes of grounding are closely related. As a side-effect of grounding an utterance, dialog participants (DPs) may adjust the meanings they assign to linguistic expressions, in a process of semantic coordination. Meanings of at least some expressions (e.g., concrete nouns) include perceptual aspects which enable DPs to classify entities as falling under the expression or not based on their perception of those entities. We show how perceptual grounding of symbols can be achieved in a process of interactively adding to common ground. This requires that perceptual aspects of meaning can be updated as a result of participating in linguistic interaction, thereby enabling fine-grained semantic coordination of perceptually grounded linguistic meanings. A formal semantics for low-level perceptual aspects of meaning is presented, tying these together with the logical-inferential aspects of meaning traditionally studied in formal semantics. The key idea is to model perceptual meanings as classifiers of perceptual input. This requires a framework where intensions are (a) represented independently of extensions, and (b) structured objects which can be modified as a result of learning. We use Type Theory with Records (TTR), a formal semantics framework which starts from the idea that information and meaning are founded on our ability to perceive and classify the world, that is, to perceive objects and situations as being of types. As an example of our approach, we show how a simple classifier of spatial information based on the Perceptron can be cast in TTR.

Identification of opposites and intermediates by eye and by hand

In this eye-tracking and drawing study, we investigate the perceptual grounding of different types of spatial dimensions such as dense–sparse and top–bottom, focusing both on the participants' experiences of the opposite regions, e.g., O1: dense; O2: sparse, and the region that is experienced as intermediate, e.g., INT: neither dense nor sparse. Six spatial dimensions expected to have three different perceptual structures in terms of the point and range nature of O1, INT and O2 were analysed. Presented with images, the participants were instructed to identify each region (O1, INT, O2), first by looking at the region, and then circumscribing it using the computer mouse. We measured the eye movements, identification times and various characteristics of the drawings such as the relative size of the three regions, overlaps and gaps. Three main results emerged. Firstly, generally speaking, intermediate regions were not different from the poles on any of the indicators: overall identification times, number of fixations, and locations. Some differences emerged with regard to the duration of fixations for point INTs and the number of fixations for range INTs between two range poles (O1, O2). Secondly, the analyses of the fixation locations showed that the poles support the identification of the intermediate region as much as the intermediate region supports the identification of the poles. Finally, the relative size of the three areas selected in the drawing task were consistent with the classification of the regions as points or ranges. The analyses of the gaps and the overlaps between the three areas showed that the intermediate is neither O1 nor O2, but an entity in its own right.