Multimodal Shift Research Articles

Automatic detection of prostate cancer grades and chronic prostatitis in biparametric MRI

Background and objective:With emerging evidence to improve prostate cancer (PCa) screening, multiparametric magnetic prostate imaging is becoming an essential noninvasive component of the diagnostic routine. Computer-aided diagnostic (CAD) tools powered by deep learning can help radiologists interpret multiple volumetric images. In this work, our objective was to examine promising methods recently proposed in the multigrade prostate cancer detection task and to suggest practical considerations regarding model training in this context.Methods:We collected 1647 fine-grained biopsy-confirmed findings, including Gleason scores and prostatitis, to form a training dataset. In our experimental framework for lesion detection, all models utilized 3D nnU-Net architecture that accounts for anisotropy in the MRI data. First, we explore an optimal range of b-values for diffusion-weighted imaging (DWI) modality and its effect on the detection of clinically significant prostate cancer (csPCa) and prostatitis using deep learning, as the optimal range is not yet clearly defined in this domain. Next, we propose a simulated multimodal shift as a data augmentation technique to compensate for the multimodal shift present in the data. Third, we study the effect of incorporating the prostatitis class alongside cancer-related findings at three different granularities of the prostate cancer class (coarse, medium, and fine) and its impact on the detection rate of the target csPCa. Furthermore, ordinal and one-hot encoded (OHE) output formulations were tested.Results: An optimal model configuration with fine class granularity (prostatitis included) and OHE has scored the lesion-wise partial Free-Response Receiver Operating Characteristic (FROC) area under the curve (AUC) of 1.94 (CI 95%: 1.76–2.11) and patient-wise ROC AUC of 0.874 (CI 95%: 0.793–0.938) in the detection of csPCa. Inclusion of the auxiliary prostatitis class has demonstrated a stable relative improvement in specificity at a false positive rate (FPR) of 1.0 per patient, with an increase of 3%, 7%, and 4% for coarse, medium, and fine class granularities.Conclusions: This paper examines several configurations for model training in the biparametric MRI setup and proposes optimal value ranges. It also shows that the fine-grained class configuration, including prostatitis, is beneficial for detecting csPCa. The ability to detect prostatitis in all low-risk cancer lesions suggests the potential to improve the quality of the early diagnosis of prostate diseases. It also implies an improved interpretability of the results by the radiologist.

Aggression and multi-modal signaling in noise in a common urban songbird

Anthropogenic noise may disrupt signals used to mediate aggressive interactions, leading to more physical aggression between opponents. One solution to this problem is to switch signaling effort to a less noisy modality (e.g., the visual modality). In the present study, we investigate aggressive behaviors and signaling in urban and rural male European robins (Erithacus rubecula) in response to simulated intrusions with or without experimental noise. First, we predicted that urban birds, living in noisier habitats, would be generally more aggressive than rural birds. We also predicted that during simulated intrusions with experimental noise, robins would increase their physical aggression and show a multi-modal shift, i.e., respond with more visual threat displays and sing fewer songs. Finally, we expected the multi-modal shift in response to noise to be stronger in urban birds compared to rural birds. The results showed that urban birds were more aggressive than rural robins, but an increase in aggression with experimental noise was seen only in the rural birds. Urban but not rural birds decreased their song rate in response to noise. Contrary to the multi-modal shift hypothesis, however, there was no evidence of a concurrent increase in visual signals. These results point to a complex role of immediate plasticity and longer-term processes in affecting communication during aggressive interactions under anthropogenic noise. Human activity has an enormous effect on wildlife, including on their social behavior. Animals living in urban areas often tend to be more aggressive than those living in rural areas, which may be due to urban acoustic noise making communication between individuals more difficult. In a study with a common songbird, the European robin, we investigated the role of urban acoustic noise in aggression and territorial communication. Urban robins were more aggressive than rural robins, and additional noise in the territory increased aggression in rural but not urban robins. While urban robins decreased their singing effort with additional noise, they did not increase visual signals concurrently. These results suggest that noise can indeed make animals behave more aggressively although the effect may depend on how noisy it is already. These results further our understanding of how human-made noise changes animal communication and social behavior.

When and why do people choose automated buses over conventional buses? Results of a context-dependent stated choice experiment

The sustainable and continuous development of public transport systems is crucial to ensuring robust and resilient transport and economic activity whilst improving the urban environment. Through technological improvement, cities can increase the competitiveness of public transport, promote equality and pursue a multi-modal shift to greener solutions. The introduction of vehicle automation technology into existing public transport systems has potential impacts on mobility behaviours and may replace conventional bus service in the future. This study examines travellers’ preferences for automated buses versus conventional buses, using a context-dependent stated choice experiment. This experiment measured the effects of context variables (such as trip purpose, travel distance, time of day, weather conditions and travel companion) on the choice of automated buses versus conventional buses. The results were analysed using mixed logit models, and the findings indicate that, in general, choice behaviours do not diverge much between the choice of automated bus and conventional bus. However, individuals’ choices are more elastic towards the changes in automated bus service levels compared to conventional bus service. The results show that poor weather conditions may lower the quality and reliability of public transport service, and the probability of choosing an automated bus over a conventional bus is reduced due to such disruptions. In addition, passengers travelling for work purposes, covering long distances, or travelling with companions are more likely to choose conventional buses than automated buses.

A Novel Multimode Hybrid Control Method for Cooperative Driving of an Automated Vehicle Platoon

A multimode hybrid automaton is proposed for setting vehicle platoon modes with velocity, distance, length, lane position, and other state information. Based on a vehicle platoon shift movement under different modes, decisions are made based on key conditional actions, such as sudden acceleration changes because of vehicle distance changes, emergency braking to avoid collisions and free-lane changing choices adapted to various traffic conditions, so as to ensure effortless movement and safety in the multimode shift. With a 3-degree (longitudinal, lateral, and yaw directions) of the freedom coupled model, a hybrid vehicle platoon controller is proposed using nonsingular terminal sliding-mode control to ensure fast and steady tracking on the hybrid automaton outputs during the multimode shift process. The convergence of the hybrid controller in finite time is also analyzed with the Lyapunov exponential stability. The analysis result proves that the proposed controller not only ensures the stability of the individual vehicle and the vehicle platoon but also ensures the stability of the multimode shift movement system. The proposed cooperative driving strategy for vehicle platoon is evaluated using simulations, where varying traffic conditions and the influence of cutting off are considered in conjunction with demonstration simulations of a vehicle platoon's cruising, following, lane changing, overtaking, and moving in/out of garage functions.

Novel Low-Complexity and Low-Power Flip-Flop Design

In this paper, a compact and low-power true single-phase flip-flop (FF) design with fully static operations is presented. The design is developed by using various circuit-reduction schemes and features a hybrid logic style employing both pass transistor logic (PTL) and static complementary metal-oxide semiconductor (CMOS) logic to reduce circuit complexity. These circuit optimization measures pay off in various aspects, including smaller clock-to-Q (CQ) delay, lower average power, lower leakage power, and smaller layout area; and the transistor-count is only 17. Fabricated in TSMC 180 nm CMOS technology, it reduces by over 29% the chip area compared to the conventional transmission gate FF (TGFF). To further show digital circuit/system level advantages, a multi-mode shift register has been realized. Experimental measurement results at 1.8 V/4 MHz show that, compared with the TGFF design, the proposed design saves 64.7% of power consumption while reducing chip area by 26.2%.

Are signals of aggressive intent less honest in urban habitats?

AbstractHow anthropogenic change affects animal social behavior, including communication is an important question. Urban noise often drives shifts in acoustic properties of signals but the consequences of noise for the honesty of signals—that is, how well they predict signaler behavior—is unclear. Here we examine whether honesty of aggressive signaling is compromised in male urban song sparrows (Melospiza melodia). Song sparrows have two honest close-range signals: the low amplitude soft songs (an acoustic signal) and wing waves (a visual signal), but whether the honesty of these signals is affected by urbanization has not been examined. If soft songs are less effective in urban noise, we predict that they should predict attacks less reliably in urban habitats compared to rural habitats. We confirmed earlier findings that urban birds were more aggressive than rural birds and found that acoustic noise was higher in urban habitats. Urban birds still sang more soft songs than rural birds. High rates of soft songs and low rates of loud songs predicted attacks in both habitats. Thus, while urbanization has a significant effect on aggressive behaviors, it might have a limited effect on the overall honesty of aggressive signals in song sparrows. We also found evidence for a multimodal shift: urban birds tended to give proportionally more wing waves than soft songs than rural birds, although whether that shift is due to noise-dependent plasticity is unclear. These findings encourage further experimental study of the specific variables that are responsible for behavioral change due to urbanization.Soft song, the low amplitude songs given in close range interactions, is an honest threat signal in urban song sparrows. Given its low amplitude, soft songs may be a less effective signal in noisy urban habitats. However, we found that soft song remained an honest signal predicting attack in urban habitats. We also found that birds may use more visual signals (rapid fluttering of wings) in urban habitats to avoid masking from acoustic noise.

Multi-modal communication: song sparrows increase signal redundancy in noise.

Although the effects of anthropogenic noise on animal communication have been studied widely, most research on the effect of noise in communication has focused on signals in a single modality. Consequently, how multi-modal communication is affected by anthropogenic noise is relatively poorly understood. Here, we ask whether song sparrows (Melospiza melodia) show evidence of plasticity in response to noise in two aggressive signals in acoustic and visual modalities. We test two hypotheses: (i) that song sparrows will shift signalling effort to the visual modality (the multi-modal shift hypothesis) and (ii) that they will increase redundancy of their multi-modal signalling (the back-up signal hypothesis). We presented male song sparrows with song playback and a taxidermic mount with or without a low-frequency acoustic noise from a nearby speaker. We found that males did not switch their signalling effort to visual modality (i.e. wing waves) in response to the noise. However, the correlation between warbled soft songs and wing waves increased in the noise treatment, i.e. signals became more redundant. These results suggest that when faced with anthropogenic noise, song sparrows can increase the redundancy of their multi-modal signals, which may aid in the robustness of the communication system.

Multimodal shifts in noise: switching channels to communicate through rapid environmental change

A multimodal shift is the ability to switch from reliance on one sensory channel to another during communication. The shift can take place during signal production and/or perception. If environmental changes such as urbanization and climate change impair signal transmission in particular channels, it would benefit the animal to be able to switch to a relatively quieter channel. For this strategy to be successful, it requires animals to be able to send redundant information across multiple channels. I develop and explore the argument that the ability of animals to switch from a noisy channel to a relatively quiet one may be key for the animals' ability to cope with rapid anthropogenic environmental change. I review examples of multimodal shifts that occur with environmental noise as well as cases in which a predicted shift did not occur. I survey which sensory channels are used in shifts and whether the signal components are redundant or nonredundant. Most multimodal shift examples include the visual channel as one of the components. The majority of signals involved in shifts appear to be redundant, although the majority of signals involved in multimodal communication in general appear to be nonredundant, especially for chemical/visual combinations. Finally, I discuss how anthropogenic environmental changes can affect signal transmission in different channels and habitats and explain why the ability to shift channels may help animals cope with these changes. Predictions and recommendations for future work are provided.

Multimodality: A way to cope with road traffic noise? The case of European treefrog (Hyla arborea)

In the last decades, traffic noise has become a new challenge for efficient animal communication and several studies suggest that it is involved in population declines. Although poorly investigated in a traffic noise context, communication is generally multimodal, which can be viewed as a way to improve communication efficiency by allowing shift from a sensory modality to another when one modality suffers from noise. In the present study, we investigated multimodal shift in the European treefrog (Hyla arborea), a species using both acoustic and visual cues during male quality assessment task performed by females. Females were used in a discrimination task in two environmental conditions: with or without traffic noise. In traffic noise conditions, we showed that females’ reliance on acoustic signal embedded in noise pollution did not decrease in favour of visual signals, therefore showing that females do not shift between modalities in response to traffic noise. Although, we did not evidence multimodal shift in our study, many species facing traffic noise present multimodal communication, and should be investigated to evaluate the importance of multimodal shift as a way to cope with traffic noise pollution.

Multimodal alarm behavior in urban and rural gray squirrels studied by means of observation and a mechanical robot

Abstract Urbanization of animal habitats has the potential to affect the natural communication systems of any species able to survive in the changed environment. Urban animals such as squirrels use multiple signal channels to communicate, but it is unknown how urbanization has affected these behaviors. Multimodal communication, involving more than one sensory modality, can be studied by use of biomimetic mechanical animal models that are designed to simulate the multimodal signals and be presented to animal subjects in the field. In this way the responses to the various signal components can be compared and contrasted to determine whether the multimodal signal is made up of redundant or nonredundant components. In this study, we presented wild gray squirrels in relatively urban and relatively rural habitats in Western Massachusetts with a biomimetic squirrel model that produced tail flags and alarm barks in a variety of combinations. We found that the squirrels responded to each unimodal component on its own, the bark and tail flag, but they responded most to the complete multimodal signal, containing both the acoustic and the moving visual components, providing evidence that in this context the signal components are redundant and that their combination elicits multimodal enhancement. We expanded on the results of Partan et al. (2009) by providing data on signaling behavior in the presence and absence of conspecifics, suggesting that alarm signaling is more likely if conspecifics are present. We found that the squirrels were more active in the urban habitats and that they responded more to tail flagging in the urban habitats as compared to the rural ones, suggesting the interesting possibility of a multimodal shift from reliance on audio to visual signals in noisier more crowded urban habitats.