Local Cues Research Articles

Inferring Word Class and Meaning From Spoken and Written Texts: A Comparison of Children With and Without Developmental Language Disorder.

The aim of the study was to determine the ability of children with developmental language disorder (DLD) to infer word class and meaning from text and to document variations by word class (noun, verb, adjective) and modality (listening, reading). We also asked whether the children could integrate global cues across the entire passage as well as local cues from the immediate sentence frame to support inferences. Fourth graders with DLD (n = 28) and typical language development (TLD; n = 41) read and listened to expository texts and guessed the noun, verb, and adjective removed from each. Adults (n = 20) completed the task to establish a baseline of correct responses. We used latent semantic analysis (LSA) to determine the semantic fit of the responses to the texts and to determine whether global cues were more difficult for children with DLD than local cues. The DLD group was 24% less accurate than the TLD group. In both diagnostic groups, accuracy varied by word class (nouns > adjectives > verbs) but not modality (reading = listening). Word class errors were rare, and errors of semantic fit were frequent. LSA cosines were higher for correct responses relative to the passage as a whole than the immediate sentence frame, suggesting that both groups mined the more extensive information in the global cues to support inferences. Compared to the TLD group, the DLD group tended to make "worse" errors: repeating words from the sentence frame or coming up with no response at all. Accuracy in the DLD group, but not the TLD group, was related to vocabulary knowledge. When the two groups were collapsed, scores on verbal short-term/working memory and sustained attention also predicted performance, but weaknesses in these aspects of executive function on the part of individuals with DLD did not fully explain the difference between the performance of the DLD and TLD groups. Whether listening or reading, fourth graders with DLD are less able to infer word meaning from texts than their age-mates. The problem reflects, in part, deficits in executive function and lexical semantic knowledge.

TPTE: Text-Guided Patch Token Exploitation for Unsupervised Fine-Grained Representation Learning

Recent advances in pre-trained vision-language models have successfully boosted the performance of unsupervised image representation in many vision tasks. Most of existing works focus on learning global visual features with Transformers and neglect detailed local cues, leading to suboptimal performance in fine-grained vision tasks. In this article, we propose a text-guided patch token exploitation framework to enhance the discriminative power of unsupervised representation by exploiting more detailed local features. Our text-guided decoder extracts local features with the guidance of texts or learned prompts describing discriminative object parts. We hence introduce a local-global relation distillation loss to promote the joint optimization of local and global features. The proposed method allows to flexibly extract either global or global-local features as the image representation. It significantly outperforms previous methods in fine-grained image retrieval and base-to-new fine-grained classification tasks. For instance, our Recall@1 metric surpasses the recent unsupervised retrieval method STML by 6.0% on the SOP dataset. The code is publicly available at https://github.com/maosnhehe/TPTE .

AKAP1/PKA-mediated GRP75 phosphorylation at mitochondria-associated endoplasmic reticulum membranes protects cancer cells against ferroptosis.

Emerging evidence suggests that signaling pathways can be spatially regulated to ensure rapid and efficient responses to dynamically changing local cues. Ferroptosis is a recently defined form of lipid peroxidation-driven cell death. Although the molecular mechanisms underlying ferroptosis are emerging, spatial aspects of its signaling remain largely unexplored. By analyzing a public database, we found that a mitochondrial chaperone protein, glucose-regulated protein 75 (GRP75), may have a previously undefined role in regulating ferroptosis. This was subsequently validated. Interestingly, under ferroptotic conditions, GRP75 translocated from mitochondria to mitochondria-associated endoplasmic reticulum (ER) membranes (MAMs) and the cytosol. Further mechanistic studies revealed a highly spatial regulation of GRP75-mediated antiferroptotic signaling. Under ferroptotic conditions, lipid peroxidation predominantly accumulated at the ER, which activated protein kinase A (PKA) in a cAMP-dependent manner. In particular, a signaling microdomain, the outer mitochondrial membrane protein A-kinase anchor protein 1 (AKAP1)-anchored PKA, phosphorylated GRP75 at S148 in MAMs. This caused GRP75 to be sequestered outside the mitochondria, where it competed with Nrf2 for Keap1 binding through a conserved high-affinity RGD-binding motif, ETGE. Nrf2 was then stabilized and activated, leading to the transcriptional activation of a panel of antiferroptotic genes. Blockade of the PKA/GRP75 axis dramatically increased the responses of cancer cells to ferroptosis both in vivo and in vitro. Our identification a localized signaling cascade involved in protecting cancer cells from ferroptosis broadens our understanding of cellular defense mechanisms against ferroptosis and also provides a new target axis (AKAP1/PKA/GRP75) to improve the responses of cancer cells to ferroptosis.

Happy new ears: rapid adaptation to novel spectral cues in vertical sound localization.

Happy new ears: rapid adaptation to novel spectral cues in vertical sound localization.

Combined Effect of Noise Reduction, FBS-Based Spectral Splitting, and Dynamic Range Compression of Speech Signal on Source Localization in Binaural Hearing Aids

Localizing sound sources in three spatial dimensions (azimuth, elevation, and distance) is critical for human hearing comfort. It relies on two binaural cues: interaural time difference (ITD) and interaural level difference (ILD). Cochlear or auditory nerve injury can result in sensorineural hearing loss (SNHL). Hearing aids enable people with sensorineural hearing loss to converse more effectively and hear better. However, there is an apprehension that the binaural hearing aids may degrade the localization cues, thus affecting the source localization. In response to this concern, the current study investigates how the binaural hearing aid algorithm affects source localization by adopting a cascaded structure of noise reduction technique (wiener filter) followed by filter bank summation (FBS) based spectral splitting and dynamic range compression for binaural dichotic presentation. Listening tests for seven different azimuth angles (-90⁰, -60⁰, -30⁰, 0⁰, 30⁰, 60⁰, and - 90⁰) were conducted on six listeners with normal hearing under different signal-to-noise ratio (SNR) conditions as well as on six subjects with mild bilateral sensorineural hearing impairment. Test stimuli included background glass-breaking sound and broadband noise for participants with normal hearing. In an experiment with hearing-impaired subjects, the glass-breaking sound served as one of the test stimuli. The result showed that these binaural hearing aid algorithms had no adverse effects on localization ability.

The pyruvate–GPR31 axis promotes transepithelial dendrite formation in human intestinal dendritic cells

The intestinal lumen is rich in gut microbial metabolites that serve as signaling molecules for gut immune cells. G-protein-coupled receptors (GPCRs) sense metabolites and can act as key mediators that translate gut luminal signals into host immune responses. However, the impacts of gut microbe-GPCR interactions on human physiology have not been fully elucidated. Here, we show that GPR31, which is activated by the gut bacterial metabolite pyruvate, is specifically expressed on type 1 conventional dendritic cells (cDC1s) in the lamina propria of the human intestine. Using human induced pluripotent stem cell-derived cDC1s and a monolayer human gut organoid coculture system, we show that cDC1s extend their dendrites toward pyruvate on the luminal side, forming transepithelial dendrites (TED). Accordingly, GPR31 activation via pyruvate enhances the fundamental function of cDC1 by allowing efficient uptake of gut luminal antigens, such as dietary compounds and bacterial particles through TED formation. Our results highlight the role of GPCRs in tuning the human gut immune system according to local metabolic cues.

Transfer-learning enabled micro-expression recognition using dense connections and mixed attention

Micro-expression recognition (MER) is a challenging computer vision problem, where the limited amount of available training data and insufficient intensity of the facial expressions are among the main issues adversely affecting the performance of existing recognition models. To address these challenges, this paper explores a transfer–learning enabled MER model using a densely connected feature extraction module with mixed attention. Unlike previous works that utilize transfer learning to facilitate MER and extract local facial-expression information, our model relies on pretraining with three diverse macro-expression datasets and, as a result, can: (i) overcome the problem of insufficient sample size and limited training data availability, (ii) leverage (related) domain-specific information from multiple datasets with diverse characteristics, and (iii) improve the model adaptability to complex scenes. Furthermore, to enhance the intensity of the micro-expressions and improve the discriminability of the extracted features, the Euler video magnification (EVM) method is adopted in the preprocessing stage and then used jointly with a densely connected feature extraction module and a mixed attention mechanism to derive expressive feature representations for the classification procedure. The proposed feature extraction mechanism not only guarantees the integrity of the extracted features but also efficiently captures local texture cues by aggregating the most salient information from the generated feature maps, which is key for the MER task. The experimental results on multiple datasets demonstrate the robustness and effectiveness of our model compared to the state-of-the-art.

Multi-layer feature fusion and attention enhancement for fine-grained vehicle recognition research

Abstract Vehicle recognition technology is widely applied in automatic parking, traffic restrictions, and public security investigations, playing a significant role in the construction of intelligent transportation systems. Fine-grained vehicle recognition seeks to surpass conventional vehicle recognition by concentrating on more detailed sub-classifications. This task is more challenging due to the subtle inter-class differences and significant intra-class variations. Localization-classification subnetworks represent an efficacious approach frequently employed for this task, but previous research has typically relied on CNN deep feature maps for object localization, which suffer from the low resolution, leading to poor localization accuracy. The multi-layer feature fusion localization method proposed by us fuses the high-resolution feature map of the shallow layer of CNN with the deep feature map, and makes full use of the rich spatial information of the shallow feature map to achieve more precise object localization. In addition, traditional methods acquire local attention information through the design of complex models, frequently resulting in regional redundancy or information omission. To address this, we introduce an attention module that adaptively enhances the expressiveness of global features and generates global attention features. These global attention features are then integrated with object-level features and local attention cues to achieve a more comprehensive attention enhancement. Lastly, we devise a multi-branch model and employ the aforementioned object localization and attention enhancement methods for end-to-end training to make the multiple branches collaborate seamlessly to adequately extract fine-grained features. Extensive experiments conducted on the Stanford Cars dataset and the self-built Cars-126 dataset have demonstrated the effectiveness of our method, achieving a leading position among existing methods with 97.7% classification accuracy on the Stanford Cars dataset.

Retinoic acid and TGF-β orchestrate organ-specific programs of tissue residency

Tissue-resident memory T (TRM) cells are integral to tissue immunity, persisting in diverse anatomical sites where they adhere to a common transcriptional framework. How these cells integrate distinct local cues to adopt the common TRM cell fate remains poorly understood. Here, we show that whereas skin TRM cells strictly require transforming growth factor β (TGF-β) for tissue residency, those in other locations utilize the metabolite retinoic acid (RA) to drive an alternative differentiation pathway, directing a TGF-β-independent tissue residency program in the liver and synergizing with TGF-β to drive TRM cells in the small intestine. We found that RA was required for the long-term maintenance of intestinal TRM populations, in part by impeding their retrograde migration. Moreover, enhanced RA signaling modulated TRM cell phenotype and function, a phenomenon mirrored in mice with increased microbial diversity. Together, our findings reveal RA as a fundamental component of the host-environment interaction that directs immunosurveillance in tissues.

Dynamic estimation of the attentional field from visual cortical activity.

This study explores whether spatial attention can dynamically adapt by shifting and broadening the attentional field. While previous research has focused on the modulation of neural responses at attended locations, less is known about how the size of the attentional field is represented within visual cortex. Using fMRI, we developed a novel paradigm to estimate the spatial tuning of the attentional field and demonstrate that we were able to recover both the location as well as the width of the attentional field. Our findings offer new insights into the neural mechanisms underlying the deployment of spatial attention, contributing to a deeper understanding of how spatial attention supports visual perception.

Comparable Theta Phase Coding Dynamics Along the Transverse Axis of CA1.

Topographical projection patterns from the entorhinal cortex to area CA1 of the hippocampus have led to a hypothesis that proximal CA1 (pCA1, closer to CA2) is spatially more selective than distal CA1 (dCA1, closer to the subiculum). While earlier studies have shown evidence supporting this hypothesis, we recently showed that this difference does not hold true under all experimental conditions. In a complex environment with distinct local texture cues on a circular track and global visual cues, pCA1 and dCA1 display comparable spatial selectivity. Correlated with the spatial selectivity differences, the earlier studies also showed differences in theta phase coding dynamics between pCA1 and dCA1 neurons. Here we show that there are no differences in theta phase coding dynamics between neurons in these two regions under the experimental conditions where pCA1 and dCA1 neurons are equally spatially selective. These findings challenge the established notion of dCA1 being inherently less spatially selective and theta modulated than pCA1 and suggest further experiments to understand theta-mediated activation of the CA1 sub-networks to represent space.

Assessment of transparent alternative listening devices' effects on localization cues using head-related transfer function measurements

The past few years have seen a meteoric rise in technological advancements in the hearing health industry. New alternative listening devices, often referred to as "hearables", aim to become real "bionic ears" offering hearing protection, amplification, monitoring and even biosensing functionalities. With the recent approval of the "Over-the-Counter Hearing Aid Act" in the United States and the introduction of so-called "OTC" hearing aids, these alternative listening devices now have the potential to revolutionize the world of traditional auditory amplification. Since these devices may be used by individuals with hearing loss, it is important to consider how they might influence spatial auditory awareness. Therefore, this paper studies the effect of alternative listening devices on localization cues using the Head Related Transfer Function (HRTF). In this purpose, we measured the HRTFs on a Head and Torso Simulator (HATS) with and without digital listening devices. To evaluate the acoustic performance of these devices, the devices were set into their "acoustically transparent" mode. These measures enable a preliminary characterization of the effect of hearables and OTC devices on localization cues.

Evaluating on the spatial localization cues of binaural sound pressure recorded via behind-the-ear microphones in a hearing aid

Spatial hearing ability enables people with normal hearing to localize a sound source and utilizes the cocktail party effect to detect the target speech information in a noise environment. Hearing-impairment causes not only hearing loss but also the degradation of spatial auditory ability. Hearing aid is desired to improve the spatial auditory ability of some hearing-impaired people, in addition to compensating hearing loss. However, the microphones for conventional behind-the-ear (BTE) hearing aid are located behind the pinnae rather than in the entrances of ear canal, which may cause distortion in spatial cues in the recorded binaural signals. The present work comprehensively evaluates the spatial hearing cues recorded by BTE-microphones. The head-related transfer functions (HRTF) for a KEMAR artificial head and eight human subjects, at three BTE positions and the entrances of blocked ear-canal, are measured respectively. Analysis from the HRTF data indicates that BTE microphone recording basically reserves the interaural time difference and interaural level difference as lateral-direction information. It also reserves the dynamic cues, but obvious distortions appear in the spectral cues at high frequencies. However, due to the redundancy among different spatial information, it can be inferred that dynamic cues alone may provide appropriate front-back and vertical-direction information.

The Effect of Local Festival Environmental Cues on Image, Satisfaction, and Revisit Intention: Focusing on the Hwaseong Boat Festival

The Effect of Local Festival Environmental Cues on Image, Satisfaction, and Revisit Intention: Focusing on the Hwaseong Boat Festival

How Does Cultural and Colonial Heritage Affect Optimal Branding Strategies? Evidence From the Rice Sector in Senegal

ABSTRACTAfrica's cultural and colonial heritage has profoundly segmented rice markets. Whereas in ancient centers of rice domestication, consumers maintained preferences for local rice consistent with their cultural heritage, preferences have shifted toward imported Asian rice in coastal areas around seaports, due to prior exposure to colonial import substitution policies. To enhance the competitiveness of locally produced rice relative to imported versions, it is necessary to tailor new local rice products to both market segments. A study was conducted in Senegal to test branding strategies for local rice in a country where both market segments coexist. Brands that mimic local and international labels were developed for local rice, and urban consumers bid to upgrade non‐preferred to preferred brands through the Becker–DeGroot–Marschak (BDM) mechanism. Contrary to expectations, results from an endogenous switching regression show that descendants from ancient Senegalese rice domesticators placed premiums on local rice with foreign‐looking brands, indicating that foreignness is perceived as a quality cue even in market segments rooted in cultural heritage. Thus, branding local rice using a combination of local and foreign cues could be an effective strategy in promoting domestic rice to both segments shaped by cultural and colonial heritage.

Attentional templates for target features versus locations

Visual search is guided by visual working memory representations (i.e., attentional templates) that are activated prior to search and contain target-defining features (e.g., color). In the present study, we tested whether attentional templates can also contain spatial target properties (knowing where to look for) and whether attentional selection guided by such feature-specific templates is equally efficient than selection that is based on feature-specific templates (knowing what to look for). In every trial, search displays were either preceded by semantic color or location cues, indicating the upcoming target color or location, respectively. Qualitative differences between feature- and location-based template guidance were substantiated in terms of selection efficiency in low-load (one target color/location) versus high-load trials (two target colors/locations). Behavioral and electrophysiological (N2pc) measures of target selection speed and accuracy were combined for converging evidence. In line with previous studies, we found that color search was highly efficient, even under high-low conditions, when multiple attentional templates were activated to guide attentional selection in a spatially global fashion. Importantly, results in the location task almost perfectly mirrored the findings of the color task, suggesting that multiple templates for different target locations were activated concurrently when two possible target locations were task relevant. Our findings align with accounts that assume a common neuronal network during preparation for location and color search, but regard spatial and feature-based selection mechanisms as independent.

Cell signaling facilitates apical constriction by basolaterally recruiting Arp2/3 via Rac and WAVE.

Apical constriction is a critical cell shape change that bends tissues. How precisely-localized actomyosin regulators drive apical constriction remains poorly understood. C. elegans gastrulation provides a valuable model to address this question. The Arp2/3 complex is essential in C. elegans gastrulation. To understand how Arp2/3 is locally regulated, we imaged embryos with endogenously-tagged Arp2/3 and its nucleation-promoting factors (NPFs). The three NPFs - WAVE, WASP, and WASH - colocalized with Arp2/3 and controlled Arp2/3 localization at distinct subcellular locations. We exploited this finding to study distinct populations of Arp2/3 and found that only WAVE depletion caused penetrant gastrulation defects. WAVE localized basolaterally with Arp2/3 at cell-cell contacts, dependent on CED-10/Rac. Establishing ectopic cell contacts recruited WAVE and Arp2/3, identifying contact as a symmetry-breaking cue for localization of these proteins. These results suggest that cell-cell signaling via Rac activates WAVE and Arp2/3 basolaterally, and that basolateral Arp2/3 is important for apical constriction.

Head-orienting behaviors during simultaneous speech detection and localization.

Head movement plays a vital role in auditory processing by contributing to spatial awareness and the ability to identify and locate sound sources. Here we investigate head-orienting behaviors using a dual-task experimental paradigm to measure: (a) localization of a speech source; and (b) detection of meaningful speech (numbers), within a complex acoustic background. Ten younger adults with normal hearing and 20 older adults with mild-to-severe sensorineural hearing loss were evaluated in the free field on two head-movement conditions: (1) head fixed to the front and (2) head moving to a source location; and two context conditions: (1) with audio only or (2) with audio plus visual cues. Head-tracking analyses quantified the target location relative to head location, as well as the peak velocity during head movements. Evaluation of head-orienting behaviors revealed that both groups tended to undershoot the auditory target for targets beyond 60° in azimuth. Listeners with hearing loss had higher head-turn errors than the normal-hearing listeners, even when a visual location cue was provided. Digit detection accuracy was better for the normal-hearing than hearing-loss groups, with a main effect of signal-to-noise ratio (SNR). When performing the dual-task paradigm in the most difficult listening environments, participants consistently demonstrated a wait-and-listen head-movement strategy, characterized by a short pause during which they maintained their head orientation and gathered information before orienting to the target location.

Sensory augmentation for a rapid motor task in a multisensory environment.

Sensory substitution and augmentation systems (SSASy) seek to either replace or enhance existing sensory skills by providing a new route to access information about the world. Tests of such systems have largely been limited to untimed, unisensory tasks. To test the use of a SSASy for rapid, ballistic motor actions in a multisensory environment. Participants played a stripped-down version of air hockey in virtual reality with motion controls (Oculus Touch). They were trained to use a simple SASSy (novel audio cue) for the puck's location. They were tested on ability to strike an oncoming puck with the SASSy, degraded vision, or both. Participants coordinated vision and the SSASy to strike the target with their hand more consistently than with the best single cue alone, t(13) = 9.16, p <.001, Cohen's d = 2.448. People can adapt flexibly to using a SSASy in tasks that require tightly timed, precise, and rapid body movements. SSASys can augment and coordinate with existing sensorimotor skills rather than being limited to replacement use cases - in particular, there is potential scope for treating moderate vision loss. These findings point to the potential for augmenting human abilities, not only for static perceptual judgments, but in rapid and demanding perceptual-motor tasks.

Exploring the synergy between textual identity and visual signals in human-object interaction

Human-Object Interaction (HOI) detection task aims to recognize and understand interactions between humans and objects depicted in images. Unlike instance recognition tasks, which focus on isolated objects, HOI detection requires considering various explanatory factors, such as instance identity, spatial relationships, and scene context. However, previous HOI detection methods have primarily relied on local visual cues, often overlooking the vital role of instance identity and thus limiting the performance of models. In this paper, we introduce textual features to expand the definition of HOI representations, incorporating instance identity into the HOI reasoning process. Drawing inspiration from the human activity perception process, we explore the synergy between textual identity and visual signals to leverage various explanatory factors more effectively and enhance HOI detection performance. Specifically, our method extracts HOI explanatory factors using both modal representations. Visual features capture interactive cues, while textual features explicitly denote instance identities within human-object pairs, delineating relevant interaction categories. Additionally, we utilize Contrastive Language-Image Pre-training (CLIP) to enhance the semantic alignment between visual and textual features and design a cross-modal learning module for integrating HOI multimodal information. Extensive experiments on several benchmarks demonstrate that our proposed framework surpasses most existing methods, achieving outstanding performance with a mean average precision (mAP) of 33.95 on the HICO-DET dataset and 63.2 mAP on the V-COCO dataset.