Interactive Modules Research Articles

Choreographing multi-degree of freedom behaviors in large-scale crowd simulations

This study introduces a novel framework for choreographing multi-degree of freedom (MDoF) behaviors in large-scale crowd simulations. The framework integrates multi-objective optimization with spatio-temporal ordering to effectively generate and control diverse MDoF crowd behavior states. We propose a set of evaluation criteria for assessing the aesthetic quality of crowd states and employ multi-objective optimization to produce crowd states that meet these criteria. Additionally, we introduce time offset functions and interpolation progress functions to perform complex and diversified behavior state interpolations. Furthermore, we designed a user-centric interaction module that allows for intuitive and flexible adjustments of crowd behavior states through sketching, spline curves, and other interactive means. Qualitative tests and quantitative experiments on the evaluation criteria demonstrate the effectiveness of this method in generating and controlling MDoF behaviors in crowds. Finally, case studies, including real-world applications in the Opening Ceremony of the 2022 Beijing Winter Olympics, validate the practicality and adaptability of this approach.

Disentangled feature fusion network for lightweight image super-resolution

Recently, the quality of generated images in image super-resolution (SR) has significantly improved due to the widespread application of convolutional neural networks. Existing super-resolution methods often overlook the importance of network width and instead prioritize designing deeper network structures to improve performance. Deeper networks, however, demand greater computational resources and are more challenging to train, making them less suitable for devices with limited performance. To address this issue, we propose a novel method called the disentangled feature fusion network (DFFN). Specifically, we construct dual feature extraction streams (DFES) using the strategies of feature disentanglement and parameter sharing, which increase the network's width without increasing the number of parameters. To facilitate the interaction of information between the dual feature extraction streams, we design a feature interaction module (FIM) that separately enhances high and low-frequency features. Furthermore, a feature fusion module (FFM) is presented to efficiently fuse different levels of high and low-frequency feature information. The proposed DFFN integrates DFES, FIM, and FFM, which not only widens the network without increasing parameters but also minimizes the loss of crucial feature information. Extensive experiments on five benchmark datasets demonstrate that our method significantly outperforms other state-of-the-art lightweight super-resolution methods, achieving a superior balance between parameter quantity, reconstruction performance, and model complexity. The code is available at https://github.com/zhoujy-aust/DFFN.

ScLTdb: a comprehensive single-cell lineage tracing database.

Single-cell lineage tracing (scLT) is a powerful technique that integrates cellular barcoding with single-cell sequencing technologies. This new approach enables the simultaneous measurement of cell fate and molecular profiles at single-cell resolution, uncovering the gene regulatory program of cell fate determination. However, a comprehensive scLT database is not yet available. Here, we present the single-cell lineage tracing database (scLTdb, https://scltdb.com) containing 109 datasets that are manually curated and analyzed through a standard pipeline. The scLTdb provides interactive analysis modules for visualizing and re-analyzing scLT datasets, especially the comprehensive cell fate analysis and lineage relationship analysis. Importantly, scLTdb also allows users to identify fate-related gene signatures. In conclusion, scLTdb provides an interactive interface of scLT data exploration and analysis, and will facilitate the understanding of cell fate decision and lineage commitment in development and diseases.

The future of nutrition education for health systems capacity building

Abstract In the ever-evolving landscape of global health, nutrition education plays a pivotal role in shaping the well-being of populations. The future of nutrition education encompasses a holistic understanding of health, considering not nutritional adequacy in health and disease, but also cultural, social, and environmental factors. Tomorrow’s health professionals must also be equipped to address the interconnectedness of nutrition with mental health, sustainability, and community dynamics. Nutrition education will increasingly involve collaboration across disciplines. Health professionals, educators, policymakers, and community leaders must work together to create a comprehensive ecosystem that fosters nutrition literacy. This collaboration extends beyond traditional healthcare settings to schools, workplaces, and local communities. Furthermore, digital transformation will also revolutionise nutrition education. Online platforms, mobile apps, and virtual simulations will enhance learning experiences whilst interactive modules, webinars, and gamified content will engage learners and facilitate continuous professional development. Moreover, telehealth and tele-nutrition will bridge geographical gaps, ensuring access to quality education globally. Cultural sensitivity in nutrition education is also needed across geo-demographic boundaries to appreciate diverse dietary practices, food taboos, and traditional knowledge. Nutrition education should also empower health professionals to advocate for policy change across food systems, promote sustainable practices, and address food insecurity and therefore understanding policy frameworks and participating in advocacy efforts will be key. Finally, embracing the future requires a commitment to lifelong learning to remain at the forefront of nutrition science and its cutting edge as the questions may remain the same but the answers vary significantly as we garner new evidence to navigate evolving global challenges.

Enhancing Multimodal Emotional Information Extraction in Film and Television through Adaptive Feature Fusion with DenseNe, Transformer, and 3D CNN Models

ABSTRACT The extraction of multimodal emotional information enables a more nuanced representation of the emotional subtleties embedded in film and television works. However, conventional approaches that independently extract features from images and text fail to capture the rich semantic interplay between these modalities, impeding the feature learning process within each modality. To address this, this paper presents an innovative model for extracting emotional information from multimodal film and television content. The model utilizes DenseNe for image feature extraction, enhancing network depth via the MSC module. Text feature extraction is achieved through a Transformer encoder, while video feature extraction employs a 3D CNN model. Refinements are made to the number and placement of convolutional layers, planar convolution size, and 3D convolution depth. Moreover, a multi-head scaled dot-product attention mechanism is incorporated into the interaction module to compute the similarity between each image block within the sequence and every word in the text sequence. Experimental evaluations on the CMU-MOSEI and CMU-MOSI datasets showcase superior performance compared to the baseline model, achieving accuracy and F1 scores of 0.708 and 0.698, respectively. Noteworthy is the proposed adaptive feature fusion module, which enriches the expressiveness of pivotal emotional features while eliminating redundant data.

End-to-end multiple object tracking in high-resolution optical sensors of drones with transformer models

Drone aerial imaging has become increasingly important across numerous fields as drone optical sensor technology continues to advance. One critical challenge in this domain is achieving both accurate and efficient multi-object tracking. Traditional deep learning methods often separate object identification from tracking, leading to increased complexity and potential performance degradation. Conventional approaches rely heavily on manual feature engineering and intricate algorithms, which can further limit efficiency. To overcome these limitations, we propose a novel Transformer-based end-to-end multi-object tracking framework. This innovative method leverages self-attention mechanisms to capture complex inter-object relationships, seamlessly integrating object detection and tracking into a unified process. By utilizing end-to-end training, our approach simplifies the tracking pipeline, leading to significant performance improvements. A key innovation in our system is the introduction of a trajectory detection label matching technique. This technique assigns labels based on a comprehensive assessment of object appearance, spatial characteristics, and Gaussian features, ensuring more precise and logical label assignments. Additionally, we incorporate cross-frame self-attention mechanisms to extract long-term object properties, providing robust information for stable and consistent tracking. We further enhance tracking performance through a newly developed self-characteristics module, which extracts semantic features from trajectory information across both current and previous frames. This module ensures that the long-term interaction modules maintain semantic consistency, allowing for more accurate and continuous tracking over time. The refined data and stored trajectories are then used as input for subsequent frame processing, creating a feedback loop that sustains tracking accuracy. Extensive experiments conducted on the VisDrone and UAVDT datasets demonstrate the superior performance of our approach in drone-based multi-object tracking.

A Multi-Hierarchical Complementary Feature Interaction Network for Accelerated Multi-Modal MR Imaging

Magnetic resonance (MR) imaging is widely used in the clinical field due to its non-invasiveness, but the long scanning time is still a bottleneck for its popularization. Using the complementary information between multi-modal imaging to accelerate imaging provides a novel and effective MR fast imaging solution. However, previous technologies mostly use simple fusion methods and fail to fully utilize their potential sharable knowledge. In this study, we introduced a novel multi-hierarchical complementary feature interaction network (MHCFIN) to realize joint reconstruction of multi-modal MR images with undersampled data and thus accelerate multi-modal imaging. Firstly, multiple attention mechanisms are integrated with a dual-branch encoder–decoder network to represent shared features and complementary features of different modalities. In the decoding stage, the multi-modal feature interaction module (MMFIM) acts as a bridge between the two branches, realizing complementary knowledge transfer between different modalities through cross-level fusion. The single-modal feature fusion module (SMFFM) carries out multi-scale feature representation and optimization of the single modality, preserving better anatomical details. Extensive experiments are conducted under different sampling patterns and acceleration factors. The results show that this proposed method achieves obvious improvement compared with existing state-of-the-art reconstruction methods in both visual quality and quantity.

Global induced local network for infrared: dim small target detection

Abstract It is challenging to detect infrared dim targets submerged in complicated backgrounds due to their small size and faint intensity. The previous attention-based detection networks frequently require global long-range dependence. Significant calculations are required to determine the target's sparse but meaningful position. To prevent wasting calculations on the background, this paper offers a detection network guided by global context for local feature learning, named GILNet (Global Induced Local Network). It designs a global location module (GLM) and a local feature interaction module (LFIM) to capture the global position and features of targets, respectively. More specifically, using global context interaction, the GLM finds the region that might contain dim small targets, that is, the coarse location. In the coarsely located regions, the LFIM further acquires feature information about targets. Next, we also design an eight-directional attention operation to obtain the contour information of targets in the low feature map. It is fused with the high feature map in the multi-directional feature fusion module (MFFM), which retains more semantic and spatial information about targets. Finally, quantitative and qualitative analysis show that the GILNet performs better than eight comparison methods on two public datasets.

SOD‐diffusion: Salient Object Detection via Diffusion‐Based Image Generators

AbstractSalient Object Detection (SOD) is a challenging task that aims to precisely identify and segment the salient objects. However, existing SOD methods still face challenges in making explicit predictions near the edges and often lack end‐to‐end training capabilities. To alleviate these problems, we propose SOD‐diffusion, a novel framework that formulates salient object detection as a denoising diffusion process from noisy masks to object masks. Specifically, object masks diffuse from ground‐truth masks to random distribution in latent space, and the model learns to reverse this noising process to reconstruct object masks. To enhance the denoising learning process, we design an attention feature interaction module (AFIM) and a specific fine‐tuning protocol to integrate conditional semantic features from the input image with diffusion noise embedding. Extensive experiments on five widely used SOD benchmark datasets demonstrate that our proposed SOD‐diffusion achieves favorable performance compared to previous well‐established methods. Furthermore, leveraging the outstanding generalization capability of SOD‐diffusion, we applied it to publicly available images, generating high‐quality masks that serve as an additional SOD benchmark testset.

SPFDNet: Water Extraction Method Based on Spatial Partition and Feature Decoupling

Extracting water information from remote-sensing images is of great research significance for applications such as water resource protection and flood monitoring. Current water extraction methods aggregated richer multi-level features to enhance the output results. In fact, there is a difference in the requirements for the water body and the water boundary. Indiscriminate multi-feature fusion can lead to perturbation and competition of information between these two types of features during the optimization. Consequently, models cannot accurately locate the internal vacancies within the water body with the external boundary. Therefore, this paper proposes a water feature extraction network with spatial partitioning and feature decoupling. To ensure that the water features are extracted with deep semantic features and stable spatial information before decoupling, we first design a chunked multi-scale feature aggregation module (CMFAM) to construct a context path for obtaining deep semantic information. Then, an information interaction module (IIM) is designed to exchange information between two spatial paths with two fixed resolution intervals and the two paths through. During decoding, a feature decoupling module (FDM) is developed to utilize internal flow prediction to acquire the main body features, and erasing techniques are employed to obtain boundary features. Therefore, the deep features of the water body and the detailed boundary information are supplemented, strengthening the decoupled body and boundary features. Furthermore, the integrated expansion recoupling module (IERM) module is designed for the recoupling stage. The IERM expands the water body and boundary features using expansion and adaptively compensates the transition region between the water body and boundary through information guidance. Finally, multi-level constraints are combined to realize the supervision of the decoupled features. Thus, the water body and boundaries can be extracted more accurately. A comparative validation analysis is conducted on the public datasets, including the gaofen image dataset (GID) and the gaofen2020 challenge dataset (GF2020). By comparing with seven SOTAs, the results show that the proposed method achieves the best results, with IOUs of 91.22 and 78.93, especially in the localization of water bodies and boundaries. By applying the proposed method in different scenarios, the results show the stable capability of the proposed method for extracting water with various shapes and areas.

Data-driven collaborative healthcare resource allocation in pandemics

Severe shortages of healthcare resources are major challenges in pandemics, especially in their early stages. To improve emergency management efficiency, this paper proposes a novel rolling predict-then-optimize framework that includes three interactive modules, i.e., data-driven demand prediction, healthcare resource allocation, and parameter rolling update. Such a framework uses historical data to dynamically update the control parameters of the proposed Net-SEIHRD model, which predicts the healthcare needs of each region by jointly considering government interventions and cross-regional travel behaviors. Based on the forecasted healthcare resource demand in real-time, an optimization model is then formulated to realize coordinated resource allocation across multiple regions by minimizing the total generalized cost. To facilitate model solving, the proposed mixed integer nonlinear programming model is converted into an equivalent mixed integer linear model by using some linearization techniques. Finally, the proposed method is applied to the SARS-CoV-2 emergency response and collaborative allocation of healthcare resources in Shanghai, China. The results show that the proposed prediction model can effectively predict the peak and scale of the spread of the virus. Compared with the traditional LM and SEIHR models, the prediction accuracy of the Net-SEIHRD model is improved by 10.76% and 24.11%, respectively. Moreover, coordinated relief activities across regions, such as patient transfer and drug-sharing can improve the efficiency of pandemic control and save social costs.

Post-earthquake inspection of high-speed railway viaducts with multi-scale task interaction deep learning strategy

Automated computer vision-based inspections of railway infrastructures, such as component type, damaged status, and location, have been investigated actively by resorting to task-specific deep learning models. However, task-specific models that fulfill these separate inspection tasks encountered bottlenecks in improving inference accuracy, and bring huge computational costs. Multi-task deep learning, which can fulfill these inspection tasks concurrently, has yet to be fully investigated in the context of structural inspection. In this study, a multi-scale task interaction deep learning strategy is presented towards component recognition, damage segmentation, and depth estimation for a comprehensive post-earthquake inspection of high-speed railway viaducts. Three modules for multi-scale task interaction were proposed to modify the multi-task deep neural network, taking full advantage of task commonalities at multiple scales. The proposed method was validated with a large-scale image dataset of high-speed railway viaducts. Component recognition and depth estimation were incorporated to implement multi-task learning since they have higher pattern affinities at multiple scales. Results reported that mean Intersection over Unions of testing samples of component and damage tasks were 91.2% and 72.1%, RMSE of depth estimation was 1.54 m. Compared with single-task cases, training time, inference duration, and FLOPs of the multi-task model were reduced by 23%, 30%, 27% respectively. Results showed improvement in both inference accuracy and training efficiency, substantiating the superiority of the proposed strategy.

Channel Interaction and Transformer Depth Estimation Network: Robust Self-Supervised Depth Estimation Under Varied Weather Conditions

Monocular depth estimation provides low-cost environmental information for intelligent systems such as autonomous vehicles and robots, supporting sustainable development by reducing reliance on expensive, energy-intensive sensors and making technology more accessible and efficient. However, in practical applications, monocular vision is highly susceptible to adverse weather conditions, significantly reducing depth perception accuracy and limiting its ability to deliver reliable environmental information. To improve the robustness of monocular depth estimation in challenging weather, this paper first utilizes generative models to adjust image exposure and generate synthetic images of rainy, foggy, and nighttime scenes, enriching the diversity of the training data. Next, a channel interaction module and Multi-Scale Fusion Module are introduced. The former enhances information exchange between channels, while the latter effectively integrates multi-level feature information. Finally, an enhanced consistency loss is added to the loss function to prevent the depth estimation bias caused by data augmentation. Experiments on datasets such as DrivingStereo, Foggy CityScapes, and NuScenes-Night demonstrate that our method, CIT-Depth, exhibits superior generalization across various complex conditions.

Multi-level feature fusion network for neuronal morphology classification

Neuronal morphology can be represented using various feature representations, such as hand-crafted morphometrics and deep features. These features are complementary to each other, contributing to improving performance. However, existing classification methods only utilize a single feature representation or simply concatenate different features without fully considering their complementarity. Therefore, their performance is limited and can be further improved. In this paper, we propose a multi-level feature fusion network that fully utilizes diverse feature representations and their complementarity to effectively describe neuronal morphology and improve performance. Specifically, we devise a Multi-Level Fusion Module (MLFM) and incorporate it into each feature extraction block. It can facilitate the interaction between different features and achieve effective feature fusion at multiple levels. The MLFM comprises a channel attention-based Feature Enhancement Module (FEM) and a cross-attention-based Feature Interaction Module (FIM). The FEM is used to enhance robust morphological feature presentations, while the FIM mines and propagates complementary information across different feature presentations. In this way, our feature fusion network ultimately yields a more distinctive neuronal morphology descriptor that can effectively characterize neurons than any singular morphological representation. Experimental results show that our method effectively depicts neuronal morphology and correctly classifies 10-type neurons on the NeuronMorpho-10 dataset with an accuracy of 95.18%, outperforming other approaches. Moreover, our method performs well on the NeuronMorpho-12 and NeuronMorpho-17 datasets and possesses good generalization.

Effectiveness of Integrated Interactive Problem Based Learning E-Modules in Improving Critical Thinking Abilities

This study aims to analyze the improvement of students' critical thinking skills by using interactive modules integrated with problem-based learning on the excretory system material. The research method used pra experimental research design with a One-Shot Case Study. The data collection instrument was critical thinking ability test questions analyzed using SPSS version 27 software. The results showed a significant value for the T-test of 0.000 (<0.05), with an average N-gain score of 0.63, meaning there was a significant difference. The results of critical thinking abilities before and after using the PBL integrated interactive e-module with a significant increase of 0.63 (medium). So it is concluded that the PBL integrated interactive e-module is feasible, practical, and effective for improving students' critical thinking skills in studying biology on excretory system material.

Gene expression profile analysis of severe influenza-based modulation of idiopathic pulmonary fibrosis

BackgroundIt is known severe influenza infections and idiopathic pulmonary fibrosis (IPF) disease might stimulate each other. Till now, no associated mechanism has been reported.MethodWe collected the genetic pattern of expression of severe influenza (GSE111368) and IPF (GSE70866) from the Gene Expression Omnibus (GEO) database. Common differentially expressed genes (C-DEGs) were identified from the two datasets, and using this data, we conducted three forms of analyses, functional annotation, protein–protein interaction (PPI) network and module construction, and hub gene identification and co-expression analysis.ResultsIn all, 174 C-DEGs were selected for additional analyses. Based on our functional analysis, these C-DEGs mediated inflammatory response and cell differentiation. Furthermore, using cytoHubba, we identified 15 genes, namely, MELK, HJURP, BIRC5, TPX2, TK1, CDT1, UBE2C, UHRF1, CCNA2, TYMS, CDCA5, CDCA8, RAD54L, CCNB2, and ITGAM, which served as hub genes to possibly contribute to severe influenza patients with IPF disease as comorbidity. The hub gene expressions were further confirmed using two stand-alone datasets (GSE101702 for severe influenza and GSE10667 for IPF).ConclusionHerein, we demonstrated the significance of common pathways and critical genes in severe influenza and IPF etiologies. The identified pathways and genes may be employed as possible therapeutic targets for future therapy against severe influenza patients with IPF.

SISGAN: A Generative Adversarial Network Pedestrian Trajectory Prediction Model Combining Interaction Information and Scene Information

Accurate pedestrian trajectory prediction is crucial in many fields. This requires the full use and learning of pedestrians’ social interactions, movements, and environmental information. In view of the current research on pedestrian trajectory prediction, wherein most of the pedestrian interaction information is explored from the level of overall interaction, this paper proposes the SISGAN model, which designs a social interaction module from the perspective of the target pedestrian, and takes four kinds of interaction information as the influencing factors of pedestrian interaction, so as to describe the influence mechanism of pedestrian–pedestrian interaction. In addition, in terms of environmental information, the index density of pedestrian historical trajectory in space is taken into account in the extraction of environmental information, which increases the potential correlation between environmental information and pedestrians. Finally, we integrate social interaction information and environmental information and make the final trajectory prediction based on GAN. Experiments on ETH and UCY datasets demonstrate the effectiveness of the SISGAN model proposed in this paper.

Remote Sensing Image Denoising Based on Feature Interaction Complementary Learning

Optical remote sensing images are of considerable significance in a plethora of applications, including feature recognition and scene semantic segmentation. However, the quality of remote sensing images is compromised by the influence of various types of noise, which has a detrimental impact on their practical applications in the aforementioned fields. Furthermore, the intricate texture characteristics inherent to remote sensing images present a significant hurdle in the removal of noise and the restoration of image texture details. In order to address these challenges, we propose a feature interaction complementary learning (FICL) strategy for remote sensing image denoising. In practical terms, the network is comprised of four main components: noise predictor (NP), reconstructed image predictor (RIP), feature interaction module (FIM), and fusion module. The combination of these modules serves to not only complete the fusion of the prediction results of NP and RIP, but also to achieve a deep coupling of the characteristics of the two predictors. Consequently, the advantages of noise prediction and reconstructed image prediction can be combined, thereby enhancing the denoising capability of the model. Furthermore, comprehensive experimentation on both synthetic Gaussian noise datasets and real-world denoising datasets has demonstrated that FICL has achieved favorable outcomes, emphasizing the efficacy and robustness of the proposed framework.

From Boring Tests to Engaging Adventures: A Game-Based Learning Approach in LMS

The paper explores a game-based approach to language placement tests within Learning Management Systems (LMS), addressing issues of incorrect course placement and student disengagement. By gamifying assessments, the initiative aims to create a motivational and playful environment that accurately estimates students' language skills. The game design is guided by player type models and motivational frameworks, ensuring an engaging experience that caters to diverse player motivations. The game, "Journey to Mars," is set in a science fiction environment and uses multimedia elements and interactive modules to integrate educational content seamlessly. Methods for game analysis were adopted to create a gamified placement test in three steps. First, we adopted the basic game structure from the goals of the placement test. Second, we created plot points and settings and derived certain style and interface elements to create a coherent gaming environment. Third, we enriched the gaming experience with additional elements like badges and secret elements. The development process involved utilizing the ILIAS LMS tools, generative AI for content creation, and implementing progressive difficulty and feedback systems to enhance the educational value. Initial feedback indicates positive engagement and motivation among students.

EENet: An effective and efficient network for single image dehazing

While numerous solutions leveraging convolutional neural networks and Transformers have been proposed for image dehazing, there remains significant potential to improve the balance between efficiency and reconstruction performance. In this paper, we introduce an efficient and effective network named EENet, designed for image dehazing through enhanced spatial–spectral learning. EENet comprises three primary modules: the frequency processing module, the spatial processing module, and the dual-domain interaction module. Specifically, the frequency processing module handles Fourier components individually based on their distinct properties for image dehazing while also modeling global dependencies according to the convolution theorem. Additionally, the spatial processing module is designed to enable multi-scale learning. Finally, the dual-domain interaction module promotes information exchange between the frequency and spatial domains. Extensive experiments demonstrate that EENet achieves state-of-the-art performance on seven synthetic and real-world datasets for image dehazing. Moreover, the network’s generalization ability is validated by extending it to image desnowing, image defocus deblurring, and low-light image enhancement.