Previous Work Research Articles

Wasserstein Auto-Encoders of Merge Trees (and Persistence Diagrams).

This article presents a computational framework for the Wasserstein auto-encoding of merge trees (MT-WAE), a novel extension of the classical auto-encoder neural network architecture to the Wasserstein metric space of merge trees. In contrast to traditional auto-encoders which operate on vectorized data, our formulation explicitly manipulates merge trees on their associated metric space at each layer of the network, resulting in superior accuracy and interpretability. Our novel neural network approach can be interpreted as a non-linear generalization of previous linear attempts (Pont et al. 2023) at merge tree encoding. It also trivially extends to persistence diagrams. Extensive experiments on public ensembles demonstrate the efficiency of our algorithms, with MT-WAE computations in the orders of minutes on average. We show the utility of our contributions in two applications adapted from previous work on merge tree encoding (Pont et al. 2023). First, we apply MT-WAE to merge tree compression, by concisely representing them with their coordinates in the final layer of our auto-encoder. Second, we document an application to dimensionality reduction, by exploiting the latent space of our auto-encoder, for the visual analysis of ensemble data. We illustrate the versatility of our framework by introducing two penalty terms, to help preserve in the latent space both the Wasserstein distances between merge trees, as well as their clusters. In both applications, quantitative experiments assess the relevance of our framework. Finally, we provide a C++ implementation that can be used for reproducibility.

Motion In-Betweening via Deep ∆-Interpolator.

We show that the task of synthesizing human motion conditioned on a set of key frames can be solved more accurately and effectively if a deep learning based interpolator operates in the delta mode using the spherical linear interpolator as a baseline. We empirically demonstrate the strength of our approach on publicly available datasets achieving state-of-the-art performance. We further generalize these results by showing that the ∆-regime is viable with respect to the reference of the last known frame (also known as the zero-velocity model). This supports the more general conclusion that operating in the reference frame local to input frames is more accurate and robust than in the global (world) reference frame advocated in previous work.

A Genetic Causal Explainer for Deep Knowledge Tracing

Knowledge tracing (KT) has become an increasingly relevant problem in intelligent education services. Deep learning-based knowledge tracing (DLKT) achieves superb performance in terms of prediction accuracy, but it lacks of explainability, which makes us hard to trust or understand models. The previous work on explaining DLKT was mainly based on gradients or attention scores, which is susceptible to spurious correlations, reducing the credibility of the explanation. To address this limitation, in this paper, we propose a causal explanation method based on the genetic algorithm (GA), named Genetic Causal Explainer(GCE), which constructs a causal framework to estimate the attribution of subsequence to the predictions of DLKT models, and a genetic coding system is designed. Further, A multi-strategy initialization method inspired by domain prior knowledge is proposed, and a global empirical matrix is introduced to capture the causal correlation knowledge during the search process across instances, and guiding the mutation operators. The GCE as a post hoc explanation method can generate explanation results without affecting model training, and can be applied to analyze different DLKT models. Experimental results demonstrate the GCE perform better than other explanation methods in terms of accuracy and readability in quantitative assessments. Meanwhile, the GCE also shows good application prospects in mining educational laws and comparing KT models.

Image Collage on Arbitrary Shape via Shape-Aware Slicing and Optimization.

Image collage is a very useful tool for visualizing an image collection. Most of the existing methods and commercial applications for generating image collages are designed on simple shapes, such as rectangular and circular layouts. This greatly limits the use of image collages in some artistic and creative settings. Although there are some methods that can generate irregularly-shaped image collages, they often suffer from severe image overlapping and excessive blank space. This prevents such methods from being effective information communication tools. In this article, we present a shape slicing algorithm and an optimization scheme that can create image collages of arbitrary shapes in an informative and visually pleasing manner given an input shape and an image collection. To overcome the challenge of irregular shapes, we propose a novel algorithm, called Shape-Aware Slicing, which partitions the input shape into cells based on medial axis and binary slicing tree. Shape-Aware Slicing,which is designed specifically for irregular shapes, takes human perception and shape structure into account to generate visually pleasing partitions. Then, the layout is optimized by analyzing input images with the goal of maximizing the total salient regions of the images. To evaluate our method, we conduct extensive experiments and compare our results against previous work. The evaluations show that our proposed algorithm can efficiently arrange image collections on irregular shapes and create visually superior results than prior work and existing commercial tools.

Complete 3D Relationships Extraction Modality Alignment Network for 3D Dense Captioning.

3D dense captioning aims to semantically describe each object detected in a 3D scene, which plays a significant role in 3D scene understanding. Previous works lack a complete definition of 3D spatial relationships and the directly integrate visual and language modalities, thus ignoring the discrepancies between the two modalities. To address these issues, we propose a novel complete 3D relationship extraction modality alignment network, which consists of three steps: 3D object detection, complete 3D relationships extraction, and modality alignment caption. To comprehensively capture the 3D spatial relationship features, we define a complete set of 3D spatial relationships, including the local spatial relationship between objects and the global spatial relationship between each object and the entire scene. To this end, we propose a complete 3D relationships extraction module based on message passing and self-attention to mine multi-scale spatial relationship features and inspect the transformation to obtain features in different views. In addition, we propose the modality alignment caption module to fuse multi-scale relationship features and generate descriptions to bridge the semantic gap from the visual space to the language space with the prior information in the word embedding, and help generate improved descriptions for the 3D scene. Extensive experiments demonstrate that the proposed model outperforms the state-of-the-art methods on the ScanRefer and Nr3D datasets.

Sex-dependent, lateralized engagement of anterior insular cortex inputs to the dorsolateral striatum in binge alcohol drinking.

How does alcohol consumption alter synaptic transmission across time, and do these alcohol-induced neuroadaptations occur similarly in both male and female mice? Previous work shows that anterior insular cortex (AIC) projections to the dorsolateral striatum (DLS) are uniquely sensitive to alcohol-induced neuroadaptations in male, but not female mice, and play a role in governing binge alcohol consumption in male mice. Here, by using high-resolution behavior data paired with in-vivo fiber photometry, we show how similar levels of alcohol intake are achieved via different behavioral strategies across sex, and how inter-drinking session thirst states predict future alcohol intakes in females, but not males. Further, we show how presynaptic calcium activity recorded from AIC synaptic inputs in the DLS across 3 weeks of water consumption followed by 3 weeks of binge alcohol consumption change across, fluid, time, sex, and brain circuit lateralization. By time-locking presynaptic calcium activity from AIC inputs to the DLS to peri-initiation of drinking events we also show that AIC inputs into the left DLS robustly encode binge alcohol intake behaviors relative to water consumption and AIC inputs into the right DLS in males, but not females. These findings suggest a fluid-, sex- and lateralization-dependent role for the engagement of AIC inputs into the DLS that encode binge alcohol consumption behaviors and further contextualize alcohol-induced neuroadaptations at AIC inputs to the DLS.

Separation of sticker-spacer energetics governs the coalescence of metastable biomolecular condensates.

Biological condensates often emerge as a multi-droplet state and never coalesce into one large droplet within the experimental timespan. Previous work revealed that the sticker-spacer architecture of biopolymers may dynamically stabilize the multi-droplet state. Here, we simulate the condensate coalescence using metadynamics approach and reveal two distinct physical mechanisms underlying the fusion of droplets. Condensates made of sticker-spacer polymers readily undergo a kinetic arrest when stickers exhibit slow exchange while fast exchanging stickers at similar levels of saturation allow merger to equilibrium states. On the other hand, condensates composed of homopolymers fuse readily until they reach a threshold density. Increase in entropy upon inter-condensate mixing of chains drives the fusion of sticker-spacer chains. We map the range of mechanisms of kinetic arrest from slow sticker exchange dynamics to density mediated in terms of energetic separation of stickers and spacers. Our predictions appear to be in excellent agreement with recent experiments probing dynamic nature of protein-RNA condensates.

Exploiting Optical Flow Guidance for Transformer-Based Video Inpainting.

Transformers have been widely used for video processing owing to the multi-head self attention (MHSA) mechanism. However, the MHSA mechanism encounters an intrinsic difficulty for video inpainting, since the features associated with the corrupted regions are degraded and incur inaccurate self attention. This problem, termed query degradation, may be mitigated by first completing optical flows and then using the flows to guide the self attention, which was verified in our previous work - flow-guided transformer (FGT). We further exploit the flow guidance and propose FGT++ to pursue more effective and efficient video inpainting. First, we design a lightweight flow completion network by using local aggregation and edge loss. Second, to address the query degradation, we propose a flow guidance feature integration module, which uses the motion discrepancy to enhance the features, together with a flow-guided feature propagation module that warps the features according to the flows. Third, we decouple the transformer along the temporal and spatial dimensions, where flows are used to select the tokens through a temporally deformable MHSA mechanism, and global tokens are combined with the inner-window local tokens through a dual-perspective MHSA mechanism. FGT++ is experimentally evaluated to be outperforming the existing video inpainting networks qualitatively and quantitatively.

Video Coding for Machines: Compact Visual Representation Compression for Intelligent Collaborative Analytics.

As an emerging research practice leveraging recent advanced AI techniques, e.g. deep models based prediction and generation, Video Coding for Machines (VCM) is committed to bridging to an extent separate research tracks of video/image compression and feature compression, and attempts to optimize compactness and efficiency jointly from a unified perspective of high accuracy machine vision and full fidelity human vision. With the rapid advances of deep feature representation and visual data compression in mind, in this paper, we summarize VCM methodology and philosophy based on existing academia and industrial efforts. The development of VCM follows a general rate-distortion optimization, and the categorization of key modules or techniques is established including feature-assisted coding, scalable coding, intermediate feature compression/optimization, and machine vision targeted codec, from broader perspectives of vision tasks, analytics resources, etc. From previous works, it is demonstrated that, although existing works attempt to reveal the nature of scalable representation in bits when dealing with machine and human vision tasks, there remains a rare study in the generality of low bit rate representation, and accordingly how to support a variety of visual analytic tasks. Therefore, we investigate a novel visual information compression for the analytics taxonomy problem to strengthen the capability of compact visual representations extracted from multiple tasks for visual analytics. A new perspective of task relationships versus compression is revisited. By keeping in mind the transferability among different machine vision tasks (e.g. high-level semantic and mid-level geometry-related), we aim to support multiple tasks jointly at low bit rates. In particular, to narrow the dimensionality gap between neural network generated features extracted from pixels and a variety of machine vision features/labels (e.g. scene class, segmentation labels), a codebook hyperprior is designed to compress the neural network-generated features. As demonstrated in our experiments, this new hyperprior model is expected to improve feature compression efficiency by estimating the signal entropy more accurately, which enables further investigation of the granularity of abstracting compact features among different tasks.

HairStyle Editing via Parametric Controllable Strokes.

In this work, we propose a stroke-based hairstyle editing network, dubbed HairstyleNet, allowing users to conveniently change the hairstyles of an image in an interactive fashion. Different from previous works, we simplify the hairstyle editing process where users can manipulate local or entire hairstyles by adjusting the parameterized hair regions. Our HairstyleNet consists of two stages: a stroke parameterization stage and a stroke-to-hair generation stage. In the stroke parameterization stage, we first introduce parametric strokes to approximate the hair wisps, where the stroke shape is controlled by a quadratic Bézier curve and a thickness parameter. Since rendering strokes with thickness to an image is not differentiable, we opt to leverage a neural renderer to construct the mapping from stroke parameters to a stroke image. Thus, the stroke parameters can be directly estimated from hair regions in a differentiable way, enabling us to flexibly edit the hairstyles of input images. In the stroke-to-hair generation stage, we design a hairstyle refinement network that first encodes coarsely composed images of hair strokes, face, and background into latent representations and then generates high-fidelity face images with desirable new hairstyles from the latent codes. Extensive experiments demonstrate that our HairstyleNet achieves state-of-the-art performance and allows flexible hairstyle manipulation.

Mitigating Modality Discrepancies for RGB-T Semantic Segmentation.

Semantic segmentation models gain robustness against adverse illumination conditions by taking advantage of complementary information from visible and thermal infrared (RGB-T) images. Despite its importance, most existing RGB-T semantic segmentation models directly adopt primitive fusion strategies, such as elementwise summation, to integrate multimodal features. Such strategies, unfortunately, overlook the modality discrepancies caused by inconsistent unimodal features obtained by two independent feature extractors, thus hindering the exploitation of cross-modal complementary information within the multimodal data. For that, we propose a novel network for RGB-T semantic segmentation, i.e. MDRNet+, which is an improved version of our previous work ABMDRNet. The core of MDRNet+ is a brand new idea, termed the strategy of bridging-then-fusing, which mitigates modality discrepancies before cross-modal feature fusion. Concretely, an improved Modality Discrepancy Reduction (MDR+) subnetwork is designed, which first extracts unimodal features and reduces their modality discrepancies. Afterward, discriminative multimodal features for RGB-T semantic segmentation are adaptively selected and integrated via several channel-weighted fusion (CWF) modules. Furthermore, a multiscale spatial context (MSC) module and a multiscale channel context (MCC) module are presented to effectively capture the contextual information. Finally, we elaborately assemble a challenging RGB-T semantic segmentation dataset, i.e., RTSS, for urban scene understanding to mitigate the lack of well-annotated training data. Comprehensive experiments demonstrate that our proposed model surpasses other state-of-the-art models on the MFNet, PST900, and RTSS datasets remarkably.

Chinese Title Generation for Short Videos: Dataset, Metric and Algorithm.

Previous work for video captioning aims to objectively describe the video content but the captions lack human interest and attractiveness, limiting its practical application scenarios. The intention of video title generation (video titling) is to produce attractive titles, but there is a lack of benchmarks. This work offers CREATE, the first large-scale Chinese shoRt vidEo retrievAl and Title gEneration dataset, to assist research and applications in video titling, video captioning, and video retrieval in Chinese. CREATE comprises a high-quality labeled 210 K dataset and two web-scale 3 M and 10 M pre-training datasets, covering 51 categories, 50K+ tags, 537K+ manually annotated titles and captions, and 10M+ short videos with original video information. This work presents ACTEr, a unique Attractiveness-Consensus-based Title Evaluation, to objectively evaluate the quality of video title generation. This metric measures the semantic correlation between the candidate (model-generated title) and references (manual-labeled titles) and introduces attractive consensus weights to assess the attractiveness and relevance of the video title. Accordingly, this work proposes a novel multi-modal ALignment WIth Generation model, ALWIG, as one strong baseline to aid future model development. With the help of a tag-driven video-text alignment module and a GPT-based generation module, this model achieves video titling, captioning, and retrieval simultaneously. We believe that the release of the CREATE dataset, ACTEr metric, and ALWIG model will encourage in-depth research on the analysis and creation of Chinese short videos.

The effect of combining antibiotics on resistance: A systematic review and meta-analysis.

When and under which conditions antibiotic combination therapy decelerates rather than accelerates resistance evolution is not well understood. We examined the effect of combining antibiotics on within-patient resistance development across various bacterial pathogens and antibiotics. We searched CENTRAL, EMBASE and PubMed for (quasi)-randomised controlled trials (RCTs) published from database inception to November 24th, 2022. Trials comparing antibiotic treatments with different numbers of antibiotics were included. A patient was considered to have acquired resistance if, at the follow-up culture, a resistant bacterium (as defined by the study authors) was detected that had not been present in the baseline culture. We combined results using a random effects model and performed meta-regression and stratified analyses. The trials' risk of bias was assessed with the Cochrane tool. 42 trials were eligible and 29, including 5054 patients, were qualified for statistical analysis. In most trials, resistance development was not the primary outcome and studies lacked power. The combined odds ratio (OR) for the acquisition of resistance comparing the group with the higher number of antibiotics with the comparison group was 1.23 (95% CI 0.68-2.25), with substantial between-study heterogeneity (I2 =77%). We identified tentative evidence for potential beneficial or detrimental effects of antibiotic combination therapy for specific pathogens or medical conditions. The evidence for combining a higher number of antibiotics compared to fewer from RCTs is scarce and overall, is compatible with both benefit or harm. Trials powered to detect differences in resistance development or well-designed observational studies are required to clarify the impact of combination therapy on resistance.

Seeking to be seen as legitimate members of the scientific community? An analysis of British American Tobacco and Philip Morris International’s involvement in scientific events

IntroductionFor decades, tobacco companies manipulated and misused science. They funded and disseminated favourable research and suppressed research that showed the harms of their products, deliberately generating misinformation. While previous work...

Dynamical model for dog clutch shiftability

AbstractThe dog clutch offers advantages in mass and efficiency, but faces challenges in mismatch speed synchronization, which affects its shiftability. Face impact between dog teeth also reduces its lifespan. Our previous work introduced the kinematical shiftability condition that ensures impact-free gearshift but had limitations due to analysis assumptions. This study eliminates those assumptions, but uses a similar approach. Based on our previous work for dog clutch engagement dynamics, we develop the dynamical shiftability condition. Validation with full dog clutch dynamics showed an agreement. Employing another previous work that introduced shiftability map and parametric study method, we study system parameters impact on shiftability but based on the dynamical shiftability condition.

Variations in Student Approaches to Problem Solving in Undergraduate Biology Education.

Existing research has investigated student problem-solving strategies across science, technology, engineering, and mathematics; however, there is limited work in undergraduate biology education on how various aspects that influence learning combine to generate holistic approaches to problem solving. Through the lens of situated cognition, we consider problem solving as a learning phenomenon that involves the interactions between internal cognition of the learner and the external learning environment. Using phenomenography as a methodology, we investigated undergraduate student approaches to problem solving in biology through interviews. We identified five aspects of problem solving (including knowledge, strategy, intention, metacognition, and mindset) that define three qualitatively different approaches to problem solving; each approach is distinguishable by variations across the aspects. Variations in the knowledge and strategy aspects largely aligned with previous work on how the use or avoidance of biological knowledge informed both concept-based and nonconcept-based strategies. Variations in the other aspects revealed intentions spanning complete disengagement to deep interest with the course material, different degrees of metacognitive reflections, and a continuum of fixed to growth mindsets. We discuss implications for how these characterizations can improve instruction and efforts to support development of problem-solving skills.

CSCT: Charging Scheduling for Maximizing Coverage of Targets in WRSNs

In recent years, wireless rechargeable sensor networks (WRSNs), as a crucial technology in cyber-physical-social systems (CPSSs), have gradually become a hotspot of research, with the development of wireless energy transmission technology. In previous works, the objective is to maximize the survival rate of sensor nodes. However, in this article, we focus on maintaining more targets. First, it details the charging scheduling problem of maximizing coverage of targets (CoT) in on-demand charging architecture of WRSNs. Also, the problem is formalized as a multiple-objective optimization problem, which aims at maximizing the CoT and the energy efficiency simultaneously. After that, the charging scheduling for maximizing coverage of targets (CSCT) scheme is proposed to achieve the above objectives. Then, the problem is reformulated as a Deadline-TSP problem that is NP-hard. To address this problem, we design an energy predictive model and propose the CSCT with an n-path (n-CSCT) scheme that has an O(|N|ⁿ) computational complexity. In addition, the resurrection of sensor nodes is considered in this article. Thus, the n-CSCT with node resurrection (n-CSCT-R) scheme is proposed for this case. Finally, we validate the effectiveness of the proposed schemes via extensive simulations.

Online Identification of Nonlinear Systems With Separable Structure.

Separable nonlinear models (SNLMs) are of great importance in system modeling, signal processing, and machine learning because of their flexible structure and excellent description of nonlinear behaviors. The online identification of such models is quite challenging, and previous related work usually ignores the special structure where the estimated parameters can be partitioned into a linear and a nonlinear part. In this brief, we propose an efficient first-order recursive algorithm for SNLMs by introducing the variable projection (VP) step. The proposed algorithm utilizes the recursive least-squares method to eliminate the linear parameters, resulting in a reduced function. Then, the stochastic gradient descent (SGD) algorithm is employed to update the parameters of the reduced function. By considering the tight coupling relationship between linear parameters and nonlinear parameters, the proposed first-order VP algorithm is more efficient and robust than the traditional SGD algorithm and alternating optimization algorithm. More importantly, since the proposed algorithm just uses the first-order information, it is easier to apply it to large-scale models. Numerical results on examples of different sizes confirm the effectiveness and efficiency of the proposed algorithm.

An investigation of the neural basis of anger attributions in irritable youth.

Neurocognitive models of pediatric irritability suggest a prominent role of anger; however, few studies have investigated anger-related biases and their neural correlates. Resting state functional connectivity (rsFC) of the amygdala was examined in relation to anger attribution bias (AAB) in a sample of young children (5-9 years old; N = 60; 55% White, 26.7% Hispanic) with clinically significant irritability characterized by impairing emotional outbursts (IEOs). Children completed a resting state functional magnetic resonance imaging scan as well as the assessment of children's emotional skills (ACES), which yields three measures of AAB in the context of social situations, social behaviors, and facial expressions. ACES scores were entered into a general linear model to examine associations with rsFC of the bilateral amygdalae. Children with IEOs exhibited significant biases in attributing anger to others across all three ACES domains. Greater biases toward attributing anger in social situations were associated with reduced rsFC of the bilateral amygdalae with the fusiform/lingual gyri and lateral occipital cortex. Alternatively, greater biases toward attributing anger to facial expressions positively predicted right amygdala-precuneus rsFC. Greater bias toward attributing anger to others based on their behaviors was associated with heightened rsFC of the right amygdala with the left middle frontal gyrus. Findings extend previous work implicating functional connections among regions of default mode and frontoparietal networks in pediatric irritability. Longitudinal studies are needed to further investigate the putative role of AAB in the etiology and long-term outcomes of pediatric irritability. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Innate and learned components of egg recognition in the ant Camponotus floridanus.

Insect societies discriminate against foreigners to avoid exploitation. In ants, helper workers only accept individuals with the familiar chemical cues of their colony. Similarly, unfamiliar eggs may get rejected at their first appearance in the nest. We investigated egg acceptance mechanisms by introducing different types of foreign eggs into worker groups of the ant Camponotus floridanus. Workers from established colonies familiar with queen-laid eggs always accepted eggs from highly fecund queens, but worker-laid eggs only after exposure for several weeks. Workers naive to eggs only rejected worker-laid eggs once they had prior exposure to eggs laid by highly fecund queens, suggesting that prior exposure to such eggs is necessary for discrimination. The general acceptance of eggs from highly fecund queens, irrespective of previous worker egg exposure, suggests an innate response to the queen pheromone these eggs carry. Workers learned to accept queen-laid eggs from different species, indicating high flexibility in learning egg-recognition cues. In incipient colonies with queen-laid eggs that carry a weak queen pheromone, worker-laid eggs were more likely to get accepted than queen-laid eggs from a different species, suggesting that the similarity of egg-recognition cues between the two types of C. floridanus eggs increases acceptance.