Application Domains Research Articles

15 years of Big Data: a systematic literature review

Big Data is still gaining attention as a fundamental building block of the Artificial Intelligence and Machine Learning world. Therefore, a lot of effort has been pushed into Big Data research in the last 15 years. The objective of this Systematic Literature Review is to summarize the current state of the art of the previous 15 years of research about Big Data by providing answers to a set of research questions related to the main application domains for Big Data analytics; the significant challenges and limitations researchers have encountered in Big Data analysis, and emerging research trends and future directions in Big Data. The review follows a predefined procedure that automatically searches five well-known digital libraries. After applying the selection criteria to the results, 189 primary studies were identified as relevant, of which 32 were Systematic Literature Reviews. Required information was extracted from the 32 studies and summarized. Our Systematic Literature Review sketched the picture of 15 years of research in Big Data, identifying application domains, challenges, and future directions in this research field. We believe that a substantial amount of work remains to be done to align and seamlessly integrate Big Data into data-driven advanced software solutions of the future.

A Review of Real-Time Implementable Cooperative Aerial Manipulation Systems

This review paper focuses on quadrotor- and multirotor-based cooperative aerial manipulation. Emphasis is first given to comparing and evaluating prototype systems that have been implemented and tested in real-time in diverse application environments. The underlying modeling and control approaches are also discussed and compared. The outcome of this review allows for understanding the motivation and rationale to develop such systems, their applicability and implementability in diverse applications and also challenges that need to be addressed and overcome. Moreover, this paper provides a guide to develop the next generation of prototype systems based on preferred characteristics, functionality, operability, and application domain.

Efficient and Flexible Long-Tail Recommendation Using Cosine Patterns

With the increasing use of recommender systems in various application domains, many algorithms have been proposed for improving the accuracy of recommendations. Among various dimensions of recommender systems performance, long-tail (niche) recommendation performance remains an important challenge in large part because of the popularity bias of many existing recommendation techniques. In this study, we propose CORE, a cosine pattern–based technique, for effective long-tail recommendation. Comprehensive experimental results compare the proposed approach with a wide variety of classic, widely used recommendation algorithms and demonstrate its practical benefits in accuracy, flexibility, and scalability in addition to the superior long-tail recommendation performance. 1 History: Accepted by Ramaswamy Ramesh, Area Editor for Data Science & Machine Learning. Funding: This work was supported by the National Natural Science Foundation of China [Grants 72031001, 72072091, 72242101]. Supplemental Material: The software that supports the findings of this study is available within the paper and its Supplemental Information ( https://pubsonline.informs.org/doi/suppl/10.1287/ijoc.2022.0194 ) as well as from the IJOC GitHub software repository ( https://github.com/INFORMSJoC/2022.0194 ). The complete IJOC Software and Data Repository is available at https://informsjoc.github.io/ .

Selective intrafascicular stimulation of myelinated and unmyelinated nerve fibers through a longitudinal electrode: A computational study

Carbon nanotube (CNT) fiber electrodes have demonstrated exceptional spatial selectivity and sustained reliability in the context of intrafascicular electrical stimulation, as evidenced through rigorous animal experimentation. A significant presence of unmyelinated C fibers, known to induce uncomfortable somatosensory experiences, exists within peripheral nerves. This presence poses a considerable challenge to the excitation of myelinated Aβ fibers, which are crucial for tactile sensation. To achieve nuanced tactile sensory feedback utilizing CNT fiber electrodes, the selective stimulation of Aβ sensory afferents emerges as a critical factor.In confronting this challenge, the present investigation sought to refine and apply a rat sciatic-nerve model leveraging the capabilities of the COMSOL-NEURON framework. This approach enables a systematic evaluation of the influence exerted by stimulation parameters and electrode geometry on the activation dynamics of both myelinated Aβ and unmyelinated C fibers. The findings advocate for the utilization of current pulses featuring a pulse width of 600 μs, alongside the deployment of CNT fibers characterized by a diminutive diameter of 10 μm, with an exclusively exposed cross-sectional area, to facilitate reduced activation current thresholds. Comparative analysis under monopolar and bipolar electrical stimulation conditions revealed proximate activation thresholds, albeit with bipolar stimulation exhibiting superior fiber selectivity relative to its monopolar counterpart. Concerning pulse waveform characteristics, the adoption of an anodic-first biphasic stimulation modality is favored, taking into account the dual criteria of activation threshold and fiber selectivity optimization. Consequently, this investigation furnishes an efficacious stimulation paradigm for the selective activation of touch-related nerve fibers, alongside provisioning a comprehensive theoretical foundation for the realization of natural tactile feedback within the domain of prosthetic hand applications.

Combining statistical dialog management and intent recognition for enhanced response selection

Abstract Conversational interfaces are becoming ubiquitous in an increasing number of application domains as Artificial Intelligence, Natural Language Processing and Machine Learning methods associated with the recognition, understanding and generation of natural language advance by leaps and bounds. However, designing the dialog model of these systems is still a very demanding task requiring a great deal of effort given the number of information sources to be considered related to the analysis of user utterances, interaction context, information repositories, etc. In this paper, we present a general framework for increasing the quality of the system responses by combining a statistical dialog management technique and a deep learning-based intention recognizer that allow replacing the system responses initially selected by the statistical dialog model with other presumably better candidates. This approach is portable to different task-oriented domains, a diversity of methodologies for dialog management and intention estimation techniques. We have evaluated our two-step proposal using two conversational systems, assessed several intention recognition methodologies and used the developed modules to dynamically select the system responses. The results of the evaluation show that the proposed framework achieves satisfactory results by making it possible to reduce the number of non-coherent dialog responses by replacing them by more coherent alternatives.

Semi-supervised few-shot class-incremental learning based on dynamic topology evolution

Incremental learning of new classes is crucial to developing real-world artificial intelligence systems. However, in some cases, we can only use a limited number of images to train the incremental model due to the difficulty of obtaining them. Few-shot class-incremental learning (FSCIL) is a new paradigm of incremental learning, which continually learns new concepts from a few examples. This setup can quickly lead to catastrophic forgetting and overfitting problems, severely affecting model performance. To address these problems, we propose a dynamic topological evolution (DTE) model that unifies knowledge of old and new categories. In this work, we focus on a novel semi-supervised few-shot class-incremental learning (SSFSCIL) to incrementally learn new categories with a limited number of labeled samples and a large number of unlabeled samples. In detail, we use the Voronoi polygon criterion to divide the feature space and construct a Hebbian graph to represent topological relationships between classes. Then, the corresponding k-nearest neighbor subgraph is constructed for the new incremental task, and label propagation of graph nodes is carried out on the unlabeled set to generate the corresponding pseudo labels. Finally, the new category knowledge is evolved into the actual category knowledge by integrating the Hebbian graph and the k-nearest neighbor subgraph obtained in the new incremental task. Extensive experiments on the mini-ImageNet and CIFAR100 datasets show that the accuracy of the DTE outperforms the baseline and improves by 1.41% and 1.13% on the last incremental task. Furthermore, our methodology achieved a 35.6% time improvement compared to full-supervised methods on the CIFAR100 dataset. In addition to the experiments on the two datasets mentioned above, the validation of our proposed DTE model extends to the engineering application domain of the RESICS-45 aircraft image scene classification dataset.

An algorithm for multi-armed bandit based on variance change sensitivity

The Multi-Arm Bandit problem is becoming increasingly popular as it enables real-world sequential decision making across application domains, including clinical trials, recommender systems, and online decision making. The Multi-Arm Bandit problem is a classical problem of exploration and exploitation dilemma in reinforcement learning and it needs to decide on the optimal strategy based on the reward situation of each rocker arm. However, the existing Multi-Arm Bandit algorithms have many shortcomings, such as blind exploration, weak generalization ability and endless exploration. Aiming at the shortcomings of the existing Multi-Armed Bandit algorithms, this paper proposes a Multi-Armed Bandit algorithm based on variance change sensitivity. The algorithm takes the variance change of reward as a clue, and adjusts the exploration probability by the average variance change of all actions, and selects the action with the largest variance change when exploring. At the same time, in order to reduce the waste of action selection times and maximize the cumulative reward, A parameter Ncon was introduced to record the number of consecutive selections of the same action. The exploration stops when Ncon reaches a certain value. Experiments show that the exploration algorithm can obtain higher reward value and lower regret value in the end.

Machine learning for predicting halogen radical reactivity toward aqueous organic chemicalsl

Rapid advances in machine learning (ML) provide fast, accurate, and widely applicable methods for predicting free radical-mediated organic pollutant reactivity. In this study, the rate constants (logk) of four halogen radicals were predicted using Morgan fingerprint (MF) and Mordred descriptor (MD) in combination with a series of ML models. The findings highlighted that making accurate predictions for various datasets depended on an effective combination of descriptors and algorithms. To further alleviate the challenge of limited sample size, we introduced a data combination strategy that improved prediction accuracy and mitigated overfitting by combining different datasets. The Light Gradient Boosting Machine (LightGBM) with MF and Random Forest (RF) with MD models based on the unified dataset were finally selected as the optimal models. The SHapley Additive exPlanations revealed insights: the MF-LightGBM model successfully captured the influence of electron-withdrawing/donating groups, while autocorrelation, walk count and information content descriptors in the MD-RF model were identified as key features. Furthermore, the important contribution of pH was emphasized. The results of the applicability domain analysis further supported that the developed model can make reliable predictions for query compounds across a broader range. Finally, a practical web application for logk calculations was built.

Tracking and co-location of global point clouds for large-area indoor environments

Extended reality (XR) experiences are on the verge of becoming widely adopted in diverse application domains. An essential part of the technology is accurate tracking and localization of the headset to create an immersive experience. A subset of the applications require perfect co-location between the real and the virtual world, where virtual objects are aligned with real-world counterparts. Current headsets support co-location for small areas, but suffer from drift when scaling up to larger ones such as buildings or factories. This paper proposes tools and solutions for this challenge by splitting up the simultaneous localization and mapping (SLAM) into separate mapping and localization stages. In the pre-processing stage, a feature map is built for the entire tracking area. A global optimizer is applied to correct the deformations caused by drift, guided by a sparse set of ground truth markers in the point cloud of a laser scan. Optionally, further refinement is applied by matching features between the ground truth keyframe images and their rendered-out SLAM estimates of the point cloud. In the second, real-time stage, the rectified feature map is used to perform localization and sensor fusion between the global tracking and the headset. The results show that the approach achieves robust co-location between the virtual and the real 3D environment for large and complex tracking environments.

Explainable Artificial Intelligence to Support Work Safety in Forestry: Insights from Two Large Datasets, Open Challenges, and Future Work

Forestry work, which is considered one of the most demanding and dangerous professions in the world, is claiming more and more lives. In a country as small as Austria, more than 50 forestry workers are killed in accidents every year, and the number is increasing rapidly. This serves as a catalyst for us to implement more stringent measures for workplace safety in order to achieve the sustainability objective of SDG 3, which focuses on health and well-being. This study contributes to the analysis of occupational accidents and focuses on two large real-world datasets from both the Austrian Federal Forests (ÖBf) and the Austrian Workers’ Compensation Board (AUVA). Decision trees, random forests, and fully connected neural networks are used for the analysis. By exploring different interpretation methods, this study sheds light on the decision-making processes ranging from basic association to causal inference and emphasizes the importance of causal inference in providing actionable insights for accident prevention. This paper contributes to the topic of explainable AI, specifically in its application to occupational safety in forestry. As a result, it introduces novel aspects to decision support systems in this application domain.

HLS-IRT: Hardware Trojan Insertion through Modification of Intermediate Representation During High-Level Synthesis

Modern integrated circuit (IC) design incorporates the usage of proprietary computer-aided design (CAD) software and integration of third-party hardware intellectual property (IP) cores. Subsequently, the fabrication process for the design takes place in untrustworthy offshore foundries that raises concerns regarding security and reliability. Hardware Trojans (HTs) are difficult to detect malicious modifications to IC that constitute a major threat, which if undetected prior to deployment, can lead to catastrophic functional failures or the unauthorized leakage of confidential information. Apart from the risks posed by rogue human agents, recent studies have shown that high-level synthesis (HLS) CAD software can serve as a potent attack vector for inserting Hardware Trojans (HTs). In this paper, we introduce a novel automated attack vector, which we term “HLS-IRT”, by inserting HT in the register transfer logic (RTL) description of circuits generated during a HLS based IC design flow, by directly modifying the compiler-generated intermediate representation (IR) corresponding to the design. We demonstrate the attack using a design and implementation flow based on the open-source Bambu HLS software and Xilinx FPGA, on several hardware accelerators spanning different application domains. Our results show that the resulting HTs are surreptitious and effective, while incurring minimal design overhead. We also propose a novel detection scheme for HLS-IRT, since existing techniques are found to be inadequate to detect the proposed HTs.

A method for the ethical analysis of brain-inspired AI

Despite its successes, to date Artificial Intelligence (AI) is still characterized by a number of shortcomings with regards to different application domains and goals. These limitations are arguably both conceptual (e.g., related to the underlying theoretical models, such as symbolic vs.connectionist), and operational (e.g., related to robustness and ability to generalize). Biologically inspired AI, and more specifically brain-inspired AI, promises to provide further biological aspects beyond those that are already traditionally included in AI, making it possible to assess and possibly overcome some of its present shortcomings. This article examines some conceptual, technical, and ethical issues raised by the development and use of brain-inspired AI. Against this background, the paper asks whether there is anything ethically unique about brain-inspired AI. The aim of the paper is to introduce a method that has a heuristic nature and that can be applied to identify and address the ethical issues arising from brain-inspired AI (and from AI more generally). The conclusion resulting from the application of this method is that, compared to traditional AI, brain-inspired AI raises new foundational ethical issues and some new practical ethical issues, and exacerbates some of the issues raised by traditional AI.

TXAI-ADV: Trustworthy XAI for Defending AI Models against Adversarial Attacks in Realistic CIoT

Adversarial attacks are more prevalent in Consumer Internet of Things (CIoT) devices (i.e., smart home devices, cameras, actuators, sensors, and micro-controllers) because of their growing integration into daily activities, which brings attention to their possible shortcomings and usefulness. Keeping protection in the CIoT and countering emerging risks require constant updates and monitoring of these devices. Machine learning (ML), in combination with Explainable Artificial Intelligence (XAI), has become an essential component of the CIoT ecosystem due to its rapid advancement and impressive results across several application domains for attack detection, prevention, mitigation, and providing explanations of such decisions. These attacks exploit and steal sensitive data, disrupt the devices’ functionality, or gain unauthorized access to connected networks. This research generates a novel dataset by injecting adversarial attacks into the CICIoT2023 dataset. It presents an adversarial attack detection approach named TXAI-ADV that utilizes deep learning (Mutli-Layer Perceptron (MLP) and Deep Neural Network (DNN)) and machine learning classifiers (K-Nearest Neighbor (KNN), Support Vector Classifier (SVC), Gaussian Naive Bayes (GNB), ensemble voting, and Meta Classifier) to detect attacks and avert such situations rapidly in a CIoT. This study utilized Shapley Additive Explanations (SHAP) techniques, an XAI technique, to analyze the average impact of each class feature on the proposed models and select optimal features for the adversarial attacks dataset. The results revealed that, with a 96% accuracy rate, the proposed approach effectively detects adversarial attacks in a CIoT.

High-performance computing in healthcare:an automatic literature analysis perspective

The adoption of high-performance computing (HPC) in healthcare has gained significant attention in recent years, driving advancements in medical research and clinical practice. Exploring the literature on HPC implementation in healthcare is valuable for decision-makers as it provides insights into potential areas for further investigation and investment. However, manually analyzing the vast number of scholarly articles is a challenging and time-consuming task. Fortunately, topic modeling techniques offer the capacity to process extensive volumes of scientific literature, identifying key trends within the field. This paper presents an automatic literature analysis framework based on a state-of-art vector-based topic modeling algorithm with multiple embedding techniques, unveiling the research trends surrounding HPC utilization in healthcare. The proposed pipeline consists of four phases: paper extraction, data preprocessing, topic modeling and outlier detection, followed by visualization. It enables the automatic extraction of meaningful topics, exploration of their interrelationships, and identification of emerging research directions in an intuitive manner. The findings highlight the transition of HPC adoption in healthcare from traditional numerical simulation and surgical visualization to emerging topics such as drug discovery, AI-driven medical image analysis, and genomic analysis, as well as correlations and interdisciplinary connections among application domains.

Research on building extraction from remote sensing imagery using efficient lightweight residual network

Automatic building extraction from very high-resolution remote sensing images is of great significance in several application domains, such as emergency information analysis and intelligent city construction. In recent years, with the development of deep learning technology, convolutional neural networks (CNNs) have made considerable progress in improving the accuracy of building extraction from remote sensing imagery. However, most existing methods require numerous parameters and large amounts of computing and storage resources. This affects their efficiency and limits their practical application. In this study, to balance the accuracy and amount of computation required for building extraction, a novel efficient lightweight residual network (ELRNet) with an encoder-decoder structure is proposed for building extraction. ELRNet consists of a series of downsampling blocks and lightweight feature extraction modules (LFEMs) for the encoder and an appropriate combination of LFEMs and upsampling blocks for the decoder. The key to the proposed ELRNet is the LFEM which has depthwise-factorised convolution incorporated in its design. In addition, the effective channel attention (ECA) added to LFEM, performs local cross-channel interactions, thereby fully extracting the relevant information between channels. The performance of ELRNet was evaluated on the public WHU Building dataset, achieving 88.24% IoU with 2.92 GFLOPs and 0.23 million parameters. The proposed ELRNet was compared with six state-of-the-art baseline networks (SegNet, U-Net, ENet, EDANet, ESFNet, and ERFNet). The results show that ELRNet offers a better tradeoff between accuracy and efficiency in the automatic extraction of buildings in very highresolution remote sensing images. This code is publicly available on GitHub (https://github.com/GaoAi/ELRNet).

Deep reinforcement learning in chemistry: A review.

Reinforcement learning (RL) has been applied to various domains in computational chemistry and has found wide-spread success. In this review, we first motivate the application of RL to chemistry and list some broad application domains, for example, molecule generation, geometry optimization, and retrosynthetic pathway search. We set up some of the formalism associated with reinforcement learning that should help the reader translate their chemistry problems into a form where RL can be used to solve them. We then discuss the solution formulations and algorithms proposed in recent literature for these problems, the advantages of one over the other, together with the necessary details of the RL algorithms they employ. This article should help the reader understand the state of RL applications in chemistry, learn about some relevant actively-researched open problems, gain insight into how RL can be used to approach them and hopefully inspire innovative RL applications in Chemistry.

Refining a Design Thinking-Based Requirements Elicitation Process: Insights from a Focus Group

Requirements elicitation processes have a series of challenges and limitations in terms of business process focus, system transparency, and dealing with the complexity resulting from interdependence. The Design Thinking approach, which focuses on people and on understanding the context of problems, can contribute to solving them. For this reason, a requirements elicitation process based on Design Thinking has been defined, consisting of three activities: Empathise, Synthesise, and Ideate. For refining this process, a focus group discussion with experts was conducted. The experts provided feedback, specifically on the role of empathy in the process, its domain of application and activities. The results analysed from the focus group confirm the usefulness of the process and generate a series of lessons learned that allowed us to continue refining it. This paper presents the cited process, the main characteristics and results of the focus group and the refined process.

Taxonomy of theories for blockchain applications in business and management

The rising prominence of blockchain technology has spurred researchers to delve deeper into its applications through the lens of organizational and management theories. Our thematic analysis of blockchain literature reveals examination across five key domains: economic, strategic, operational, behavioral, and implementation considerations, each viewed through various theoretical perspectives. The multifaceted nature of blockchain phenomena necessitates diverse types of theory and research questions. Thus, the unique characteristics within each domain stimulate the formulation of inquiries that address a system of research questions about what, how, why, when, where, what will be, and how to do. Existing literature predominantly emphasizes explanatory and predictive theories, notably expanding research topics such as blockchain adoption behavior. However, this singular focus limits the exploration of diverse reasoning approaches suited to blockchain's complexity. Our study illustrates how different types of theory contribute to understanding each of the identified blockchain application areas. Based on our findings, we propose pertinent questions that highlight the need for varied theoretical frameworks and address specific issues within each application domain. Furthermore, we recommend appropriate theories to address these questions, fostering a more multi-perspective investigation across the breadth of blockchain-related research topics and areas. By embracing diverse theoretical perspectives, we aim to create a more balanced research landscape, facilitating deeper insights into blockchain phenomena.

A universal method for determining the detergent effect of surfactants

Surfactants are indispensable in industrial applications today due to their wetting, emulsifying, dispersing, cleansing, and detergent properties. The use of surfactants extends from the cosmetic industry to the petroleum industry and beyond.Their characteristics and effectiveness can be assessed through various standardized tests, and based on these methods, their applications can be determined. However, there is a lack of a universally applicable testing method for one crucial and complex property: the detergent effect.The detergent effect refers to the removal of unwanted contaminants from a solid surface. However, cleaning is not solely attributed to the surfactant but to the appropriate combination of various factors, whose synergistic effect reduces surface contamination. The most significant factors influencing detergent effect include the characteristics and nature of the contaminants, properties of the cleaning solution (surfactant concentration and composition, water hardness, enzymes, etc.), temperature, washing time, and hydrodynamic conditions. Additionally, the presence of electrolytes, pH of the cleaning solution, and detergent foaming properties may also play important roles.Our goal was to develop a detergent effect testing methodology that is not specific to any particular application domain but offers a straightforward and easy-to-implement solution for comparing the detergent effect of various types of surfactants.•The study presents a method for determining detergent effect of surfactants.•The method is universal and suitable for the evaluation of any type of surfactant.•The method is low-cost and easy to perform.

Distributed Heterogeneous Transfer Learning

Transfer learning has proved to be effective for building predictive models even in complex conditions with a low amount of available labeled data, by constructing a predictive model for a target domain also using the knowledge coming from a separate domain, called source domain. However, several existing transfer learning methods assume identical feature spaces between the source and the target domains. This assumption limits the possible real-world applications of such methods, since two separate, although related, domains could be described by totally different feature spaces. Heterogeneous transfer learning methods aim to overcome this limitation, but they usually i) make other assumptions on the features, such as requiring the same number of features, ii) are not generally able to distribute the workload over multiple computational nodes, iii) cannot work in the Positive-Unlabeled (PU) learning setting, which we also considered in this study, or iv) their applicability is limited to specific application domains, i.e., they are not general-purpose methods.In this manuscript, we present a novel distributed heterogeneous transfer learning method, implemented in Apache Spark, that overcomes all the above-mentioned limitations. Specifically, it is able to work also in the PU learning setting by resorting to a clustering-based approach, and can align totally heterogeneous feature spaces, without exploiting peculiarities of specific application domains. Moreover, our distributed approach allows us to process large source and target datasets.Our experimental evaluation was performed in three different application domains that can benefit from transfer learning approaches, namely the reconstruction of the human gene regulatory network, the prediction of cerebral stroke in hospital patients, and the prediction of customer energy consumption in power grids. The results show that the proposed approach is able to outperform 4 state-of-the-art heterogeneous transfer learning approaches and 3 baselines, and exhibits ideal performances in terms of scalability.