Additional Cues Research Articles

Olfactory Inspection of Female Reproductive States in Chimpanzees

In mammalian species, olfactory cues are important for within and between species communication. These cues can be part of multimodal signals indicating, for example, female fertility potentially perceived by male conspecifics. However, a large gap exists in our understanding of multimodal signaling in non-human catarrhines. Chimpanzees (Pan troglodytes) live in fission-fusion societies, mate promiscuously and express high levels of male-male competition. Females show a striking visual signal, an exaggerated sexual swelling, known to be a proxy of ovulation, while the maximum swelling is not matching the exact time of ovulation. The question remains if males use additional olfactory cues when being able to approach females closely. This would allow males to pinpoint the exact timing of ovulation and could be one reason why high-ranking males sire offspring more successfully than other males. Here, we present the first systematic test of such multimodal signaling by investigating male sniffing behavior directed to females in relation to their fertility in a group of 13 captive chimpanzees. Our results show that male sniffing behavior significantly increased with female swelling size, with female age as well as when fewer male competitors were present. Hence, odors might be part of a multimodal fertility cue, supporting the idea that males monitor both visual and olfactory cues to gain comprehensive information on female fertility.

MTOR-Dependent Autophagy Regulates Slit Diaphragm Density in Podocyte-like Drosophila Nephrocytes.

Both mTOR signaling and autophagy are important modulators of podocyte homeostasis, regeneration, and aging and have been implicated in glomerular diseases. However, the mechanistic role of these pathways for the glomerular filtration barrier remains poorly understood. We used Drosophila nephrocytes as an established podocyte model and found that inhibition of mTOR signaling resulted in increased spacing between slit diaphragms. Gain-of-function of mTOR signaling did not affect spacing, suggesting that additional cues limit the maximal slit diaphragm density. Interestingly, both activation and inhibition of mTOR signaling led to decreased nephrocyte function, indicating that a fine balance of signaling activity is needed for proper function. Furthermore, mTOR positively controlled cell size, survival, and the extent of the subcortical actin network. We also showed that basal autophagy in nephrocytes is required for survival and limits the expression of the sns (nephrin) but does not directly affect slit diaphragm formation or endocytic activity. However, using a genetic rescue approach, we demonstrated that excessive, mTOR-dependent autophagy is primarily responsible for slit diaphragm misspacing. In conclusion, we established this invertebrate podocyte model for mechanistic studies on the role of mTOR signaling and autophagy, and we discovered a direct mTOR/autophagy-dependent regulation of the slit diaphragm architecture.

Towards Light-Weight and Real-Time Line Segment Detection

Previous deep learning-based line segment detection (LSD) suffers from the immense model size and high computational cost for line prediction. This constrains them from real-time inference on computationally restricted environments. In this paper, we propose a real-time and light-weight line segment detector for resource-constrained environments named Mobile LSD (M-LSD). We design an extremely efficient LSD architecture by minimizing the backbone network and removing the typical multi-module process for line prediction found in previous methods. To maintain competitive performance with a light-weight network, we present novel training schemes: Segments of Line segment (SoL) augmentation, matching and geometric loss. SoL augmentation splits a line segment into multiple subparts, which are used to provide auxiliary line data during the training process. Moreover, the matching and geometric loss allow a model to capture additional geometric cues. Compared with TP-LSD-Lite, previously the best real-time LSD method, our model (M-LSD-tiny) achieves competitive performance with 2.5% of model size and an increase of 130.5% in inference speed on GPU. Furthermore, our model runs at 56.8 FPS and 48.6 FPS on the latest Android and iPhone mobile devices, respectively. To the best of our knowledge, this is the first real-time deep LSD available on mobile devices.

Working together or separately? The role of different review arguments in consumers' home-sharing service purchasing: evidence from China

PurposeThis study aims to distinguish between service arguments and communication arguments within a home-sharing review and to investigate their roles in consumer purchase decision-making.Design/methodology/approachBased on the setting of Airbnb, a 3 (service argument valence: positive, neutral, and negative) × 3 (communication argument valence: positive, neutral, and negative) online experiment was conducted. Data collected from 379 participants were used to test the hypotheses.FindingsThe three main determinants of purchase intention: perceived host service quality, perceived facility service quality, and perceived social value, are affected by both service arguments and communication arguments. Service arguments positively influence perceived host service quality and perceived facility service quality, while communication arguments contribute significantly to perceived host service quality and perceived social value. However, perceived facility service quality is affected by the combination of service arguments and communication arguments rather than by the service arguments only, because service argument trustworthiness, a factor influencing the effect of service arguments, varies across the combination of two types of arguments.Practical implicationsThis research helps home-sharing platform managers to understand how to facilitate transaction success through displaying different review arguments needed by consumers. Additionally, the dual role of communication arguments emphasizes a necessity for hosts to encourage positive communication arguments and provide additional cues on the facility service quality.Originality/valueThe service arguments and communication arguments in home-sharing reviews are distinguished, and their distinct roles in consumers' purchase intention have been uncovered.

Encoding of spatial patterns using electrotactile stimulation via a multi-pad electrode placed on the torso.

Tactile stimulation can be used to convey information to a user in different scenarios while avoiding overloading other senses. Tactile messages can be transmitted as spatial patterns, potentially allowing for a high information throughput. The aim of the present study was to design and test different encoding schemes to determine the best approach for conveying spatial patterns. Encoding schemes with simultaneous (SIM) and sequential pad activation (SEQ) were evaluated, including four SEQ variants designed to potentially facilitate the recognition. In SEQ-col and SEQ-row, the column and row of the activated pad were signified using different frequencies, while SEQ-all and SEQ-all-fast included the activation of all pads where those belonging to the pattern were indicated by changes in frequency (ON pads). The success rate (SR) of the pattern identification and the response time were quantified in 15 participants who recognized 20 patterns delivered through a 3 × 2 pad matrix placed on the lateral torso. SIM was not a feasible method to present the patterns (median, 15%; IQR, 5%). The SR improved with SEQ (median, 60%; IQR, 20%) and further increased with additional cues, particularly with SEQ-row (median, 78.3%; IQR, 23.3%) and SEQ-all (median, 96.7%; IQR, 5%). Importantly, the stimulation time of SEQ-all could be decreased without a substantial drop in accuracy (SEQ-all-fast: median, 89.2%; IQR, 19.2%). The spatiotemporal stimulation with sequential activation of all pads (SEQ-all) seems to be the method of choice when conveying tactile messages as spatial patterns. This is an important outcome for increasing the information bandwidth of communication through the tactile channel.

Improving safety in the operating room: Medication icon labels increase visibility and discrimination

Misreading labels, syringes, and ampoules is reported to make up a 54.4% of medication administration errors. The addition of icons to medication labels in an operating room setting could add additional visual cues to the label, allowing for improved discrimination, visibility, and easily processed information that might reduce medication administration errors. A multi-disciplinary team proposed a method of enhancing visual cues and visibility of medication labels applied to vasoactive medication infusions by adding icons to the labels. Participants were 1.12 times more likely to correctly identify medications from farther away (p < 0.001, AOR = 1.12, 95% CI: 1.02, 1.22) with icons. When icons were present, participants were 2.16 times more likely to be more confident in their identifications (p < 0.001, AOR = 2.16, 95%CI: 1.80, 2.57). Carefully designed icons may offer an additional method for identifying medications, and thus reducing medication administration errors.

The Avatar's Gist: How to Transfer Affective Components From Dynamic Walking to Static Body Postures.

Dynamic virtual representations of the human being can communicate a broad range of affective states through body movements, thus effectively studying emotion perception. However, the possibility of modeling static body postures preserving affective information is still fundamental in a broad spectrum of experimental settings exploring time-locked cognitive processes. We propose a novel automatic method for creating virtual affective body postures starting from kinematics data. Exploiting body features related to postural cues and movement velocity, we transferred the affective components from dynamic walking to static body postures of male and female virtual avatars. Results of two online experiments showed that participants coherently judged different valence and arousal levels in the avatar’s body posture, highlighting the reliability of the proposed methodology. In addition, esthetic and postural cues made women more emotionally expressive than men. Overall, we provided a valid methodology to create affective body postures of virtual avatars, which can be used within different virtual scenarios to understand better the way we perceive the affective state of others.

Perception of speaker sincerity in complex social interactions by cochlear implant users.

Understanding insincere language (sarcasm and teasing) is a fundamental part of communication and crucial for maintaining social relationships. This can be a challenging task for cochlear implant (CIs) users who receive degraded suprasegmental information important for perceiving a speaker’s attitude. We measured the perception of speaker sincerity (literal positive, literal negative, sarcasm, and teasing) in 16 adults with CIs using an established video inventory. Participants were presented with audio-only and audio-visual social interactions between two people with and without supporting verbal context. They were instructed to describe the content of the conversation and answer whether the speakers meant what they said. Results showed that subjects could not always identify speaker sincerity, even when the content of the conversation was perfectly understood. This deficit was greater for perceiving insincere relative to sincere utterances. Performance improved when additional visual cues or verbal context cues were provided. Subjects who were better at perceiving the content of the interactions in the audio-only condition benefited more from having additional visual cues for judging the speaker’s sincerity, suggesting that the two modalities compete for cognitive recourses. Perception of content also did not correlate with perception of speaker sincerity, suggesting that what was said vs. how it was said were perceived using unrelated segmental versus suprasegmental cues. Our results further showed that subjects who had access to lower-order resolved harmonic information provided by hearing aids in the contralateral ear identified speaker sincerity better than those who used implants alone. These results suggest that measuring speech recognition alone in CI users does not fully describe the outcome. Our findings stress the importance of measuring social communication functions in people with CIs.

Influence of Auditory Cues on the Neuronal Response to Naturalistic Visual Stimuli in a Virtual Reality Setting.

Virtual reality environments offer great opportunities to study the performance of brain-computer interfaces (BCIs) in real-world contexts. As real-world stimuli are typically multimodal, their neuronal integration elicits complex response patterns. To investigate the effect of additional auditory cues on the processing of visual information, we used virtual reality to mimic safety-related events in an industrial environment while we concomitantly recorded electroencephalography (EEG) signals. We simulated a box traveling on a conveyor belt system where two types of stimuli – an exploding and a burning box – interrupt regular operation. The recordings from 16 subjects were divided into two subsets, a visual-only and an audio-visual experiment. In the visual-only experiment, the response patterns for both stimuli elicited a similar pattern – a visual evoked potential (VEP) followed by an event-related potential (ERP) over the occipital-parietal lobe. Moreover, we found the perceived severity of the event to be reflected in the signal amplitude. Interestingly, the additional auditory cues had a twofold effect on the previous findings: The P1 component was significantly suppressed in the case of the exploding box stimulus, whereas the N2c showed an enhancement for the burning box stimulus. This result highlights the impact of multisensory integration on the performance of realistic BCI applications. Indeed, we observed alterations in the offline classification accuracy for a detection task based on a mixed feature extraction (variance, power spectral density, and discrete wavelet transform) and a support vector machine classifier. In the case of the explosion, the accuracy slightly decreased by –1.64% p. in an audio-visual experiment compared to the visual-only. Contrarily, the classification accuracy for the burning box increased by 5.58% p. when additional auditory cues were present. Hence, we conclude, that especially in challenging detection tasks, it is favorable to consider the potential of multisensory integration when BCIs are supposed to operate under (multimodal) real-world conditions.

Mouth Movements as Possible Cues of Social Interest at Birth: New Evidences for Early Communicative Behaviors.

Previous studies evidenced that different interactive contexts modulate the visual attention of newborns. In the present study, we investigated newborns' motor feedback as an additional cue to neonates' expression of interest. Using videos of interactive faces and a familiarization-test procedure, three different groups of newborns were assigned to three different conditions (i.e., one condition with a talking face during familiarization and silently moving faces at test, silently moving/silently moving condition, or talking/static condition). Following studies on neonatal imitation, mouth movements were analyzed as indicators of social interest. We expected the occurrence of mouth movements in the newborns to differ according to different conditions: (a) whether or not the face in front of them was talking and (b) if the person had been already seen or was new. Results revealed that a talking face elicited more motor feedback from the newborns than a silent one and that there was no difference in front of the familiar face or the novel one. Finally, frequencies of mouth movements were greater, and latencies of appearance of the first mouth movement were shorter, in front of a static vs. a dynamic face. These results are congruent with the idea of the existence of “a sense” for interaction at birth, and therefore new approaches in newborn studies are discussed.

MONOCULAR DEPTH PREDICTION IN PHOTOGRAMMETRIC APPLICATIONS

Abstract. Despite the recent success of learning-based monocular depth estimation algorithms and the release of large-scale datasets for training, the methods are limited to depth map prediction and still struggle to yield reliable results in the 3D space without additional scene cues. Indeed, although state-of-the-art approaches produce quality depth maps, they generally fail to recover the 3D structure of the scene robustly. This work explores supervised CNN architectures for monocular depth estimation and evaluates their potential in 3D reconstruction. Since most available datasets for training are not designed toward this goal and are limited to specific indoor scenarios, a new metric, large-scale synthetic benchmark (ArchDepth) is introduced that renders near real-world scenarios of outdoor scenes. A encoder-decoder architecture is used for training, and the generalization of the approach is evaluated via depth inference in unseen views in synthetic and real-world scenarios. The depth map predictions are also projected in the 3D space using a separate module. Results are qualitatively and quantitatively evaluated and compared with state-of-the-art algorithms for single image 3D scene recovery.

The influence of event‐time (vs. clock‐time) scheduling style on satiation

AbstractConsumers often need to schedule different activities. While consumers who adopt a clock‐time scheduling style decide when to transition from one activity to the next according to external temporal cues (e.g., clock), those who adopt an event‐time scheduling style tend to perform each activity until they feel internally that it is completed. This research showed that consumers' scheduling style (clock‐time vs. event‐time) could influence their satiation with repeated consumption. Four studies involving actual consumption across various domains (e.g., music, artwork, food) demonstrated that an event‐time scheduling style leads to more rapid satiation with repeated consumption than a clock‐time scheduling style because event‐timers (vs. clock‐timers) have higher private self‐focus. The results further revealed that the satiation effect of scheduling style is mitigated when consumers are distracted from their private self or informed of additional sensitization cues in the consumption stimuli.

More robust object tracking via shape and motion cue integration

Most current trackers utilise an appearance model to localise the target object in each frame. However, such approaches often fail when there are similar looking distractor objects in the surrounding background. This paper promotes an approach that can be combined with many existing trackers to tackle this issue and improve tracking robustness. The proposed approach makes use of two additional cues to target location: shape cues which are exploited through offline training of the appearance model, and motion cues which are exploited online to predict the target object’s future position based on its history of past locations. Combining these additional mechanisms with the existing trackers SiamFC, SiamFC++, Super_DiMP and ARSuper_DiMP all resulted in an increase in the tracking accuracy compared to that achieved by the corresponding underlying tracker alone. When combined with ARSuper_DiMP the resulting tracker is shown to outperform all popular state-of-the-art trackers on three benchmark datasets (OTB-100, NFS, and LaSOT), and produce performance that is competitive with the state-of-the-art on the UAV123, Trackingnet, GOT-10K and VOT2020 datasets.

The Efficacy of a Newly Developed Cueing Device for Gait Mobility in Parkinson's Disease.

Background External cues are effective in improving gait in people with Parkinson's disease (PD). However, the most effective cueing method has yet to be determined. Objective The aim of this study was to compare the immediate effects of using visual, auditory, or somatosensory cues on their own or in combination during walking compared to no cues in people with PD. Methods This was a single blinded, randomly selected, controlled study. Twenty people with PD with an age range of 46–79 years and Hoehn and Yahr scores of 1–3 were recruited. Participants were studied under 4 cueing conditions; no cue, visual, auditory, or somatosensory cues, which were randomly selected individually or in a combination. Results A repeated measures ANOVA with pairwise comparisons using Bonferroni correction showed that any single or combination of the cues resulted in an improvement in gait velocity and stride length compared to no cue. Some significant differences were also seen when comparing different combinations of cues, specifically stride length showed significant improvements when additional cues were added to the light cue. The statistically significant difference was set at p < 0.05. Conclusions Walking using visual, auditory, or somatosensory cues can immediately improve gait mobility in people with PD. Any or a combination of the cues tested could be chosen depending on the ability of the individual to use that cue.

Neural Stem Cell Reactivation in Cultured Drosophila Brain Explants.

Neural stem cells (NSCs) have the ability to proliferate, differentiate, undergo apoptosis, and even enter and exit quiescence. Many of these processes are controlled by the complex interplay between NSC intrinsic genetic programs with NSC extrinsic factors, local and systemic. In the genetic model organism, Drosophila melanogaster, NSCs, known as neuroblasts (NBs), switch from quiescence to proliferation during the embryonic to larval transition. During this time, larvae emerge from their eggshells and begin crawling, seeking out dietary nutrients. In response to animal feeding, the fat body, an endocrine organ with lipid storage capacity, produces a signal, which is released systemically into the circulating hemolymph. In response to the fat body-derived signal (FBDS), Drosophila insulin-like peptides (Dilps) are produced and released from brain neurosecretory neurons and glia, leading to downstream activation of PI3-kinase growth signaling in NBs and their glial and tracheal niche. Although this is the current model for how NBs switch from quiescence to proliferation, the nature of the FBDS extrinsic cue remains elusive. To better understand how NB extrinsic systemic cues regulate exit from quiescence, a method was developed to culture early larval brains in vitro before animal feeding. With this method, exogenous factors can be supplied to the culture media and NB exit from quiescence assayed. We found that exogenous insulin is sufficient to reactivate NBs from quiescence in whole-brain explants. Because this method is well-suited for large-scale screens, we aim to identify additional extrinsic cues that regulate NB quiescence versus proliferation decisions. Because the genes and pathways that regulate NSC proliferation decisions are evolutionarily conserved, results from this assay could provide insight into improving regenerative therapies in the clinic.

3D-TSV: The 3D trajectory-based stress visualizer

In this paper, we present novel algorithms for visualizing the three mutually orthogonal principal stress directions in 3D solids under load and we discuss the efficient integration of these algorithms into the 3D Trajectory-based Stress Visualizer (3D-TSV), a visual analysis tool for the exploration of the principal stress directions of 3D stress field. In the design of 3D-TSV, several perceptual problems have been solved. We present a novel algorithm for generating a space-filling and evenly spaced set of stress lines. The algorithm obtains a more regular appearance by considering the locations of lines, and enables the extraction of a level-of-detail representation with adjustable sparseness of the trajectories along a certain stress direction. A new combined visualization of two principal directions via oriented ribbons enables to convey ambiguities in the orientation of the principal stress directions. Additional depth cues have been added to improve the perception of the spatial relationships between trajectories. 3D-TSV provides a modular and generic implementation of key algorithms required for a trajectory-based visual analysis of principal stress directions, including the automatic seeding of space-filling stress lines, their extraction using numerical schemes, their mapping to an effective renderable representation, and rendering options to convey structures with special mechanical properties. 3D-TSV is accessible to end users via a C++- and OpenGL-based rendering frontend that is seamlessly connected to a MatLab-based extraction backend. The code (BSD license) of 3D-TSV as well as scripts to make ANSYS and ABAQUS simulation results accessible to the 3D-TSV backend are publicly available.

Evaluation of Spatial Directional Guidance Using Cheek Haptic Stimulation in a Virtual Environment

Spatial cues play an important role in navigating people in both physical and virtual spaces. In spatial navigation, visual information with additional cues, such as haptic cues, enables effective guidance. Most haptic devices are applied to various body parts to make mechanical stimuli, while few devices stimulate a head despite the excellent sensitivity. This article presents Virtual Whiskers, a spatial directional guidance technique by cheek haptic stimulation using tiny robot arms attached to a Head-Mounted Display (HMD). The tip of the robotic arm has photo reflective sensors to detect the distance between the tip and the cheek surface. Using the robot arms, we stimulate a point on the cheek obtained by calculating an intersection between the cheek surface and the target direction. In the directional guidance experiment, we investigated how accurately participants identify the target direction provided by our guidance method. We evaluated an error between the actual target direction and the participant's pointed direction. The experimental result shows that our method achieves the average absolute directional error of 2.54° in the azimuthal plane and 6.54° in the elevation plane. We also conducted a spatial guidance experiment to evaluate task performance in a target search task. We compared the condition of visual information, visual and audio information, and visual information and cheek haptics for task completion time, System Usability Scale (SUS) score, NASA-TLX score. The averages of task completion time were M = 6.39 s, SD = 3.34 s, and M = 5.62 s, SD = 3.12 s, and M = 4.35 s, SD = 2.26 s, in visual-only condition, visual+audio condition, and visual+haptic condition, respectively. In terms of the SUS score, visual condition, visual+audio condition, and visual+haptic condition achieved M = 55.83, SD = 20.40, and M = 47.78, SD = 20.09, and M = 80.42, SD = 10.99, respectively. As for NASA-TLX score, visual condition, visual+audio condition, and visual+haptic condition resulted in M = 75.81, SD = 16.89, and M = 67.57, SD = 14.96, and M = 38.83, SD = 18.52, respectively. Statistical tests revealed significant differences in task completion time, SUS score, and NASA-TLX score between the visual and the visual+haptic condition and the visual+audio and the visual+haptic condition.

MSL3D: 3D object detection from monocular, stereo and point cloud for autonomous driving

In this paper, we propose a novel deep architecture by combining multiple sensors for 3D object detection, named MSL3D. While recently LiDAR-Camera methods introduce additional semantic cues, working with fewer false detections, there is still a performance gap compared LiDAR-only methods. We argue that this gap is caused for two reasons: 1) the 3D spherical receptive fields of the set abstraction of the point clouds are not aligned with the 2D pixel-level receptive fields of the image. 2) the premature introduction of image information makes it is difficult to apply data augmentation both LiDAR and image synchronously. For the first problem, we extend 3D set abstraction to a 2D set abstraction that can transform the 2D image features to the 3D sphere to unify the receptive field of multi-modal data. For the second problem, we design a novel two-stage 3D detection framework that employs the LiDAR-only backbone in the first stage to estimate high-recall and high-quality proposals and then integrates the image and point clouds information for box refinement and confidence prediction. Besides, we add two auxiliary networks to effectively learn image features and point cloud features when using different multi-modal data augmentation strategies synchronously. Moreover, we design a consistency-structure generator using stereo images to determine whether any of a point in the 3D space belongs to the contour of the object, thereby supplementing the sparse point cloud information. Extensive experiments on the popular KITTI 3D objects detection dataset show that our proposed MSL3D achieves better performance comparing with other LiDAR-Only or LiDAR-Camera fusion approaches.

Two Means Together? Effects of Response Bias and Sensitivity on Communicative Action Detection.

Numerous lines of research suggest that communicative dyadic actions elicit preferential processing and more accurate detection compared to similar but individual actions. However, it is unclear whether the presence of the second agent provides additional cues that allow for more accurate discriminability between communicative and individual intentions or whether it lowers the threshold for perceiving third-party encounters as interactive. We performed a series of studies comparing the recognition of communicative actions from single and dyadic displays in healthy individuals. A decreased response threshold for communicative actions was observed for dyadic vs. single-agent animations across all three studies, providing evidence for the dyadic communicative bias. Furthermore, consistent with the facilitated recognition hypothesis, congruent response to a communicative gesture increased the ability to accurately interpret the actions. In line with dual-process theory, we propose that both mechanisms may be perceived as complementary rather than competitive and affect different stages of stimuli processing.

Explaining away results in more robust visual tracking

Many current trackers utilise an appearance model to localise the target object in each frame. However, such approaches often fail when there are similar-looking distractor objects in the surrounding background, meaning that target appearance alone is insufficient for robust tracking. In contrast, humans consider the distractor objects as additional visual cues, in order to infer the position of the target. Inspired by this observation, this paper proposes a novel tracking architecture in which not only is the appearance of the tracked object, but also the appearance of the distractors detected in previous frames, taken into consideration using a form of probabilistic inference known as explaining away. This mechanism increases the robustness of tracking by making it more likely that the target appearance model is matched to the true target, rather than similar-looking regions of the current frame. The proposed method can be combined with many existing trackers. Combining it with SiamFC, DaSiamRPN, Super_DiMP, and ARSuper_DiMP all resulted in an increase in the tracking accuracy compared to that achieved by the underlying tracker alone. When combined with Super_DiMP and ARSuper_DiMP, the resulting trackers produce performance that is competitive with the state of the art on seven popular benchmarks.