Decision Module Research Articles

Edge Caching Placement Strategy based on Evolutionary Game for Conversational Information Seeking in Edge Cloud Computing

In Internet applications, network conversation is the primary communication between the user and server. The server needs to efficiently and quickly return the corresponding service according to the conversation sent by the user to improve the users’ Quality of Service. Thus, Conversation Information Seeking (CIS) research has become a hot topic today. In Cloud Computing (CC), a central service mode, the conversation is transmitted between the user and the remote cloud over a long distance. With the explosive growth of Internet applications, network congestion, long-distance communication, and single point of failure have brought new challenges to the centralized service mode. People put forward Edge Cloud Computing (ECC) to meet the new challenges of the centralized service mode of CC. As a distributed service mode, ECC is an extension of CC. By migrating services from the remote cloud to the network edge closer to users, ECC can solve the above challenges in CC well. In ECC, people solve the problem of CIS through edge caching. The current research focuses on designing the edge cache strategy to achieve more predictable caching. In this article, we propose an edge cache placement method Evolutionary Game based Caching Placement Strategy (EG-CPS). This method consists of three modules: the user preference prediction module, the content popularity calculation module, and the cache placement decision module. To maximize the predictability of the cache strategy, we are committed to optimizing the cache hit rate and service latency. The simulation experiment compares the proposed strategy with several other cache strategies. The experimental results illustrate that EG-CPS can reduce up to 2.4% of the original average content request latency, increase the average direct cache hit rate by 1.7%, and increase the average edge cache hit rate by 3.3%.

An auxiliary correction model implemented by the Correction Property of intermediate layer against adversarial examples

In powerful adversarial attacks against deep neural networks (DNN), the generated adversarial example will mislead the DNN-implemented classifier by destroying the features of the last layer. To enhance the robustness of the classifier, in our paper, a Feature Analysis and Conditional Matching prediction distribution (FACM) model is proposed to utilize the features of intermediate layers to correct the misclassification. Specifically, we first prove that the intermediate layers of the classifier still retain effective features for the original category when the classifier is subjected to adversarial attacks, which is defined as the Correction Property in our paper. According to this, we propose the FACM model consisting of Feature Analysis (FA) correction module, Conditional Matching Prediction Distribution (CMPD) correction module and decision module. Specifically, the FA correction module is comprised of fully connected layers, which takes the features of the intermediate layers as the input to correct the misclassification of the classifier. The CMPD correction module is based on a conditional autoencoder, which not only uses the features of intermediate layers as the condition to accelerate convergence but also mitigates the negative effect of adversarial examples, trained with the Kullback–Leibler loss to match prediction distribution. Through the empirically verified Diversity Property among the individual correction modules, the decision module is proposed to integrate the proposed correction modules to enhance the DNN-implemented classifier’s robustness by reducing the dimensionality of adversarial subspace. That is, the input perturbed in certain directions (i.e., dimensions) that lead to misclassifications for the classifier can be correctly classified by the proposed correction modules. The extended experiments demonstrate our FACM model outperforms the existing methods against adversarial attacks, especially optimization-based white-box attacks and query-based black-box attacks.

Operant Conditioning Neuromorphic Circuit With Addictiveness and Time Memory for Automatic Learning.

Most operant conditioning circuits predominantly focus on simple feedback process, few studies consider the intricacies of feedback outcomes and the uncertainty of feedback time. This paper proposes a neuromorphic circuit based on operant conditioning with addictiveness and time memory for automatic learning. The circuit is mainly composed of hunger output module, neuron module, excitement output module, memristor-based decision module, and memory and feedback generation module. In the circuit, the process of output excitement and addiction in stochastic feedback is achieved. The memory of interval between the two rewards is formed. The circuit can adapt to complex scenarios with these functions. In addition, hunger and satiety are introduced to realize the interaction between biological behavior and exploration desire, which enables the circuit to continuously reshape its memories and actions. The process of operant conditioning theory for automatic learning is accomplished. The study of operant conditioning can serve as a reference for more intelligent brain-inspired neural systems.

The subthalamic nucleus contributes causally to perceptual decision-making in monkeys.

The subthalamic nucleus (STN) plays critical roles in the motor and cognitive function of the basal ganglia (BG), but the exact nature of these roles is not fully understood, especially in the context of decision-making based on uncertain evidence. Guided by theoretical predictions of specific STN contributions, we used single-unit recording and electrical microstimulation in the STN of healthy monkeys to assess its causal, computational roles in visual-saccadic decisions based on noisy evidence. The recordings identified subpopulations of STN neurons with distinct task-related activity patterns that related to different theoretically predicted functions. Microstimulation caused changes in behavioral choices and response times that reflected multiple contributions to an 'accumulate-to-bound'-like decision process, including modulation of decision bounds and evidence accumulation, and to non-perceptual processes. These results provide new insights into the multiple ways that the STN can support higher brain function.

The subthalamic nucleus contributes causally to perceptual decision-making in monkeys

The subthalamic nucleus (STN) plays critical roles in the motor and cognitive function of the basal ganglia (BG), but the exact nature of these roles is not fully understood, especially in the context of decision-making based on uncertain evidence. Guided by theoretical predictions of specific STN contributions, we used single-unit recording and electrical microstimulation in the STN of healthy monkeys to assess its causal, computational roles in visual-saccadic decisions based on noisy evidence. The recordings identified subpopulations of STN neurons with distinct task-related activity patterns that related to different theoretically predicted functions. Microstimulation caused changes in behavioral choices and response times that reflected multiple contributions to an ‘accumulate-to-bound’-like decision process, including modulation of decision bounds and evidence accumulation, and to non-perceptual processes. These results provide new insights into the multiple ways that the STN can support higher brain function.

Research on Obstacle Avoidance Strategy of Automated Heavy Vehicle Platoon in High-Speed Scenarios

Amidst the rapid progression of the road transport industry, the safety and efficiency of heavy-vehicle platoons have garnered significant attention. The study tackles the challenge of obstacle avoidance presented by vehicles owing to their considerable mass, delayed response times, and line-of-sight impediments, by introducing a cooperative obstacle avoidance system for heavy-vehicle platoons based on deep reinforcement learning. The system comprises three primary modules: perception, decision-making, and control. Initially, the perception module acquires real-time environmental data. Subsequently, the decision-making module formulates obstacle avoidance decisions based on the acquired data. Specifically, it implements a two-stage braking obstacle avoidance strategy under low collision risk scenarios, while employing a fifth-degree polynomial for planning and tracking obstacle avoidance paths under high collision risk conditions suitable for steering maneuvers. The control module utilizes the local multi-agent deep deterministic policy gradient (LADDPG) algorithm to train the heavy-vehicle platoon agents, ensuring the formation’s maintenance while mitigating collisions with other vehicles and obstacles. The effectiveness of the proposed system is substantiated through simulation experiments, demonstrating its adaptability to various traffic conditions, selection of suitable obstacle avoidance strategies, and significant enhancement of obstacle avoidance performance and heavy-vehicle platoon stability.

Physics-informed probabilistic deep network with interpretable mechanism for trustworthy mechanical fault diagnosis

The application of data-driven models based on the neural network is pivotal to developing an intelligent fault diagnostic flowchart. However, the reliability and interpretability of these models for fault prediction have presented challenges in neural network-based diagnostic approach. Another challenge is data availability, which has also been a limiting factor in using artificial Intelligence for condition monitoring and fault assessment in industrial mechanical systems. Consequently, this study proposes a Physics Informed Probabilistic Deep Network (PIPDN) framework to overcome these challenges. The PIPDN comprises two main components: the physical labelling module, designed to enhance physical labels with mechanical failure information, and the main body of PIPDN, responsible for learning fault representative features and generating smart data guided by conditional and physical labels. Furthermore, a multi-scale PIPDN model is developed to integrate the proposed uncertainty quantification (UQ) with decision-fusion module for accurate interpretation and enhanced fault diagnosis. The applicability, effectiveness, and superiority of the proposed framework and approach are validated using an experimental bearing dataset. The results indicate that integrating physical labels significantly assists the PIPDN model in capturing more accurate fault characteristics. This increases the importance of latent space features for subsequent fault diagnosis and also enhances the diagnostic interpretability. Furthermore, the addition of UQ-based decision-making module improves the reliability of the MS-PIPDN model by reducing epistemic uncertainty in the predictions.

A cognitive communication jamming strategy based on Transformer and Deep Reinforcement Learning

The advent of sophisticated communication technologies, such as cognitive radio and anti-jamming techniques, has significantly elevated the challenge of disrupting enemy communications. Nevertheless, the inherent openness of wireless communications remains a vulnerability that can be exploited to interfere with them. Some contemporary Reinforcement Learning (RL)-based jamming strategies examine methods for rapidly identifying the optimal jamming strategy for a specific modulated signal. However, such algorithms lack the flexibility and responsiveness required to effectively counter the enemy’s evolving communication strategies. To address this issue, we propose a Transformer and Deep Reinforcement Learning (DRL)-based jamming strategy that can be trained to identify jamming methods for multiple digital and analog signals. In particular, the Transformer Encoder is employed as a network for DRL to process the state information pertaining to the enemy communication. Subsequently, the decision module of the Double Deep Q Network (DDQN) is utilized to select the jamming action based on the processed information. Furthermore, we have devised a reward function and constructed an invalid jamming list, with the objective of selecting an action that requires low power consumption and enhances the convergence speed of the algorithm. The experimental results demonstrate that the algorithm proposed in this paper exhibits notable performance advantages in comparison to other networks and DRL algorithms.

Model predictive control based integrated fault tolerant controller for autonomous vehicles with four-wheel independent steering, driving and braking systems

This paper presents a fault-tolerant control algorithm for path and velocity tracking of an autonomous vehicle based on four-wheel independent steering, driving, and braking systems. The proposed algorithm is designed to distribute the control effort to normal actuators in the occurrence of faults. The proposed algorithm consists of three modules. The reference velocity and yaw rate to track the reference path are determined by the reference state decision module. The model predictive control (MPC)-based fault-tolerant controller determines the optimal inputs to compensate for the effect of the faulty actuator and maintain the tracking performance. A faulty-factor estimator is proposed based on a recursive covariance estimator to evaluate the performance degradation due to the failure of each actuator. The estimated faulty factors are applied to the objective function of the MPC such that the control input is distributed based on the level of the fault. The performance of the proposed algorithm was verified via performing simulations using MATLAB/Simulink and CarSim. The simulations proved that the proposed controller maintained the control performance of the normal case even in multiple actuator failures.

An intelligent decision support framework for nursing home resource planning with enhanced heterogeneous service demand modeling

Demand-based nursing home resource planning is of great importance to ensure adequate resources (e.g., beds and staffs) available to provide care services with desired quality, yet challenging. The challenge mainly lies in modeling heterogeneous demand of nursing home residents, reflected by various individual characteristics, diverse dwelling duration with multiple competing discharge dispositions, and diverse daily service need. Existing studies often assumed a homogeneous population of patients and neglected the complexity of demand heterogeneity and uncertainty, leading to biased demand estimation and misguided decisions. The objective of this work is to improve nursing home resource planning decisions in response to the complex demand heterogeneity and uncertainty. To address the challenges, we propose a novel knowledge-guided and data-driven decision support framework. This is the first work of integrating domain knowledge with predictive and decision analytics to enhance modeling fidelity and decision performance for nursing home resource planning. Specifically, to effectively capture different aspects of heterogeneous demand, we develop a novel knowledge-guided demand modeling module with predictive models, including a length-of-stay model with competing risk for duration analysis, a tree-based system for learning daily service need variations, and a demand simulator for capturing uncertainty of fluctuating demand. Moreover, to determine optimal capacity and staffing decisions under demand heterogeneity and uncertainty, we develop a demand-based decision-making module with effective optimization models and solution algorithms, ensuring satisfactory quality of care at reduced costs. Furthermore, to demonstrate the improved prediction and decision performances of the proposed framework, we provide a proof-of-the-concept case study using real data from our industrial collaborator and investigate how demand heterogeneity and uncertainty will impact resource planning decisions. The proposed framework also demonstrates its appealing adaptability under changing resident census compositions.

Convolutional Neural Network-Based Lane-Change Strategy via Motion Image Representation for Automated and Connected Vehicles.

The lane-change decision-making module of automated and connected vehicles (ACVs) is one of the most crucial and challenging issues to be addressed. Motivated by human beings' underlying driving paradigm and the convolutional neural network's (CNN) dramatic capability of extracting features and learning strategies, this article proposes a CNN-based lane-change decision-making method via the dynamic motion image representation. Human drivers take proper driving maneuvers after they subconsciously construct the dynamic traffic scene representation in their brains, so this study first proposes the dynamic motion image representation method to reveal informative traffic situations in the motion-sensitive area (MSA), which provides a full view of surrounding cars. Then, this article develops a CNN model to extract the underlying features and learn driving policies from labeled datasets of MSA motion images. Besides, a safety-constrained layer is added to avoid vehicle collisions. We build a simulation platform based on the simulation of urban mobility (SUMO) to collect traffic datasets and test our proposed method. In addition, real-world traffic datasets are also involved to further investigate the proposed method's performance. The rule-based strategy and reinforcement learning (RL)-based method are used to compare with our approach. All results demonstrate that the proposed method performs lane-change decision-making much better than prevailing methods, which suggests our scheme has huge potential to accelerate the deployment of ACVs and is worth further study.

Study of Multimodal Identification Algorithms using Modern Methods and Tools of Multivariate Analysis

This article aims to comprehensively investigate the theoretical and practical foundations, as well as the distinctive characteristics, underpinning the study of multimodal identification algorithms. This investigation will be conducted using state-of-the-art methods and tools of multidimensional analysis. The development of a multimodal algorithm using the method of modality fusion at the feature level encompasses the integration of various algorithms rooted in multivariate analysis. These include a combined voice activity detector, a face detector utilizing the MTCNN (multi-task cascade convolutional networks) architecture, fine-frequency cepstral coefficients, facial image features, and a decision-making module. To construct a multimodal identification algorithm, a framework for combining these algorithms based on multivariate analysis is proposed. Analysis of the acquired data indicates that “Test 1”, utilizing facial image data, exhibits the highest performance indicators, approaching nearly 100%. Tests 2 and 3 involving voice signals exhibit a minor error in the pre-processing stage, attributed to the inherent delay experienced by participants during the video conference. The proposed multimodal algorithm, integrated within a biometric identification system, enables successful user verification research through the utilization of a combined multidimensional analysis algorithm. Furthermore, the algorithm showcases superior research outcomes in comparison to other analogous multimodal identification algorithms, as it yields precise results.

A homogeneous multi-vehicle cooperative group decision-making method in complicated mixed traffic scenarios

Connected and Automated Vehicles (CAVs) are expected to reshape the transportation system, and cooperative group intelligence of CAVs has great potential for improving transportation efficiency and safety. One challenge for CAV group driving is the decision-making under scenarios mixed with CAV and human-driven vehicles (HDV). Current studies mainly use methods based on single physical rules such as platoon driving or formation switch control, failing to reach a balanced and homogeneous state of optimal efficiency and risk in mixed traffic environments. In addition, most studies focus only on one specific type of scene, lacking the scene adaptability to various surrounding conditions. This paper proposes a homogeneous multi-vehicle cooperative group decision-making method targeting mixed traffic scenarios. A bi-level framework composed of behavior-level and trajectory-level decision-making is established to achieve balanced optimal cooperation. A region-driven behavioral decision mechanism is designed to decompose vehicle actions into a unified form of sequential target regions. Solutions are derived based on Cooperative Driving Safety Field, a risk assessment module inspired by field energy theory. The trajectory-level decision module takes the target regions as input and generates the control quantities of the CAVs through target point selection, conflict reconciliation, and dynamic constraint consideration. Experimental results on 19 various scenarios and continuous traffic flow scenes indicate that the proposed method significantly increases passing efficiency, reduces driving risk, and improves scene adaptability. In addition, experiments on multiple kinds of scenarios including intersections, ramps, bottlenecks, etc. prove that our method can adapt to various road topology structures. Feasibility is also verified through scaled physical platform validations and real-vehicle road tests.

A dual-channel multimodal sentiment analysis framework based on three-way decision

In the exploration of human–computer interaction, accurately identifying and understanding the user’s sentimental state helps enhance the user experience. Multimodal sentiment analysis aims to identify sentiments through various signals. However, inconsistencies in sentiments between text and visual–audio signals pose a challenge, as models often struggle to capture these differences adequately. To alleviate this issue, we propose a dual-channel sentiment analysis framework based on three-way decision. This framework includes a multimodal model, a visual–audio model, and a three-way decision module. Specifically, the multimodal model and visual–audio model generate predictions, and the three-way decision module selects an appropriate prediction. We improve the binary cross-entropy loss function for the visual–audio model to integrate the three-way decision module better and improve sentiment prediction accuracy. Additionally, we introduce an adversarial training task to ensure differences in predictions between the two models, thereby enhancing the influence of the visual–audio model. Experimental results on four public datasets demonstrate that our framework significantly improves the accuracy of sentiment recognition and reduces the average decision time.

A novel type-2 decision mechanism for dynamic parameter adaptation: theory and application in mathematical and structural problems

Metaheuristic algorithms are stochastic-based search techniques widely used for solving different types of optimization problems. These methods mostly adjust their search behavior using pre-defined search pattern(s) regardless of the current problem specifications. Therefore, integrating them with logical auxiliary modules can significantly enhance their search efficiency by enabling them to dynamically adapt their search behavior. The present study introduces a novel decision-making approach that employs interval type-2 fuzzy logic to balance the search behavior during optimization process. The proposed approach, designed as a stand-alone module with the flexibility to be integrated into various algorithms, is incorporated into the Interactive Search Algorithm. The developed reinforced technique is named Type-2 Fuzzy Interactive Search Algorithm. Performance of the proposed method is tested on different unconstrained mathematical functions and constrained structural and mechanical optimization problems. The attained results are compared with standard ISA method and seven other metaheuristic techniques through a suite of numerical and statistical evaluations. Drawing from the obtained results, the integration of the type-2 fuzzy decision module significantly enhances the algorithm's search capability. This improvement is evident in terms of stability, accuracy, and computational cost. It is worth noting that the employed comparative performance index for the proposed method indicates improvements of 3.38, 13.09, 16.61, and 27.23 percent compared to the best solution found by the selected methods for engineering problems.

The subthalamic nucleus contributes causally to perceptual decision-making in monkeys.

The subthalamic nucleus (STN) plays critical roles in the motor and cognitive function of the basal ganglia (BG), but the exact nature of these roles is not fully understood, especially in the context of decision-making based on uncertain evidence. Guided by theoretical predictions of specific STN contributions, we used single-unit recording and electrical microstimulation in the STN of healthy monkeys to assess its causal, computational roles in visual-saccadic decisions based on noisy evidence. The recordings identified subpopulations of STN neurons with distinct task-related activity patterns that related to different theoretically predicted functions. Microstimulation caused changes in behavioral choices and response times that reflected multiple contributions to an "accumulate-to-bound"-like decision process, including modulation of decision bounds and evidence accumulation, and to non-perceptual processes. These results provide new insights into the multiple ways that the STN can support higher brain function.

Using Enquiry Action Learning to help students understand their decision-making

ABSTRACT An Enquiry Action Learning sequence was undertaken by MSc social work students at a Scottish University as part of a decision-making module, to assist them to work together in gathering information to present to a case conference. Drawing on the taught sessions on ethics, legislation, policy and human rights, the students plan their research, explore community resources and prepare a case report. Through this research, the students gained understanding of multi-agency roles and perspectives and built their knowledge throughout the activity. This paper analyses what the students learnt from Enquiry Action Learning, with particular emphasis on how it will impact on their decision-making practice in the future, and evaluates the EAL activity using the Revised Bloom’s Taxonomy (RBT). The benefits of Enquiry Action Learning are multiple, and the findings show that the students developed group work skills and acquired knowledge of multi-agency decision-making processes in practice. They learned how to evidence their decision-making, applying theoretical knowledge to practice situations. They were able to relate and contextualize their classroom-based learning in practice situations, developing a deeper understanding of the social work role.

Expert Twin: A Digital Twin with an Integrated Fuzzy-Based Decision-Making Module

Digitalization and the application of modern Industry 4.0 solutions are becoming increasingly important to remain competitive as product ranges expand and global supply chains grow. This paper presents a new Digital Twin framework to achieve robustness in manufacturing process optimization and enhance the efficiency of decision support. Most digital twins in the literature synchronously represent the real system without any control elements despite the bidirectional data link. The proposed approach combines the advantages of traditional process simulations with a real-time communication and data acquisition method using programmable logic controllers designed to control automated systems. In addition, it complements this by utilizing human experience and expertise in modeling using Fuzzy Logic to create a control-enabled digital twin system. The resulting "Expert Twin" system reduces the reaction time of the production to unexpected events and increases the efficiency of decision support; it generates and selects alternatives, therefore creating smart manufacturing. The Expert Twin framework was integrated, tested, and validated on an automated production sample system in a laboratory environment. In the experimental scenarios carried out, the method production increased production line utility by up to 28% and the number of re-schedules can be halved.

A Reinforcement Learning Approach to Dynamic Trajectory Optimization with Consideration of Imbalanced Sub-Goals in Self-Driving Vehicles

Goal-conditioned Reinforcement Learning (RL) holds promise for addressing intricate control challenges by enabling agents to learn and execute desired skills through separate decision modules. However, the irregular occurrence of required skills poses a significant challenge to effective learning. In this paper, we demonstrate the detrimental effects of this imbalanced skill (sub-goal) distribution and propose a novel training approach, Classified Experience Replay (CER), designed to mitigate this challenge. We demonstrate that adapting our method to conventional RL methods significantly enhances the performance of the RL agent. Considering the challenges inherent in tasks such as driving, characterized by biased occurrences of required sub-goals, our study demonstrates the improvement in trained outcomes facilitated by the proposed method. In addition, we introduce a specialized framework tailored for self-driving tasks on highways, integrating model predictive control into our RL trajectory optimization training paradigm. Our approach, utilizing CER with the suggested framework, yields remarkable advancements in trajectory optimization for RL agents operating in highway environments.

Multimodal LLM Driven Computer Interface

Abstract: This paper introduces the Multimodal-driven Computer Interface, a framework that enables multimodal models to interact with and control a computer. The framework receives user input through various modalities (e.g., speech, text, gestures), processes it through a multimodal fusion algorithm, and generates appropriate actions using a decision-making module. These actions are then executed on the computer through platform-specific APIs. Currently, it is integrated with the multimodal LLM and operates on Windows, Mac, and Linux systems. While the framework demonstrates promising results, challenges remain in improving the accuracy of mouse click location prediction and adapting to diverse user needs and preferences. The Multimodaldriven Computer Interface has the potential to revolutionize human-computer interaction, opening up new possibilities for accessibility, productivity, and entertainment.