High-dimensional Space Research Articles

Pose detection and docking control for autonomous dynamic docking mechanism with non-cooperative targets

Purpose This study aims to address the issue of random movement and non coordination between docking mechanisms and locking mechanisms, and proposes a comprehensive dynamic docking control architecture that integrates perception, planning, and motion control. Design/methodology/approach Firstly, the proposed dynamic docking control architecture uses laser sensors and a charge-coupled device camera to perceive the pose of the target. The sensor data are mapped to a high-dimensional potential field space and fused to reduce interference caused by detection noise. Next, a new potential function based on multi-dimensional space is developed for docking path planning, which enables the docking mechanism based on Stewart platform to rapidly converge to the target axis of the locking mechanism, which improves the adaptability and terminal docking accuracy of the docking state. Finally, to achieve precise tracking and flexible docking in the final stage, the system combines a self-impedance controller and an impedance control algorithm based on the planned trajectory. Findings Extensive simulations and experiments have been conducted to validate the effectiveness of the dynamic docking system and its control architecture. The results indicate that even if the target moves randomly, the system can successfully achieve accurate, stable and flexible dynamic docking. Originality/value This research can provide technical guidance and reference for docking task of unmanned vehicles under the ground conditions. It can also provide ideas for space docking missions, such as space simulator docking.

Unraveling the dynamic slowdown in supercooled water: The role of dynamic disorder in jump motions.

When a liquid is rapidly cooled below its melting point without inducing crystallization, its dynamics slow down significantly without noticeable structural changes. Elucidating the origin of this slowdown has been a long-standing challenge. Here, we report a theoretical investigation into the mechanism of the dynamic slowdown in supercooled water, a ubiquitous yet extraordinary substance characterized by various anomalous properties arising from local density fluctuations. Using molecular dynamics simulations, we found that the jump dynamics, which are elementary structural change processes, deviate from Poisson statistics with decreasing temperature. This deviation is attributed to slow variables competing with the jump motions, i.e., dynamic disorder. The present analysis of the dynamic disorder showed that the primary slow variable is the displacement of the fourth nearest oxygen atom of a jumping molecule, which occurs in an environment created by the fluctuations of molecules outside the first hydration shell. As the temperature decreases, the jump dynamics become slow and intermittent. These intermittent dynamics are attributed to the prolonged trapping of jumping molecules within extended and stable low-density domains. As the temperature continues to decrease, the number of slow variables increases due to the increased cooperative motions. Consequently, the jump dynamics proceed in a higher-dimensional space consisting of multiple slow variables, becoming slower and more intermittent. It is then conceivable that with further decreasing temperature, the slowing and intermittency of the jump dynamics intensify, eventually culminating in a glass transition.

A novel hybrid model for lung and colon cancer detection using pre-trained deep learning and KELM

Cancer poses a significant threat to life due to its aggressive nature, high potential for metastasis, and heterogeneity. Globally, both the men and women are mostly affected by lung and colon (LC) cancer. Early and accurate detection is essential to enhance the well-being of patients facing LC cancer. The traditional techniques face challenges such as low accuracy and high execution time. This work combines the pre-trained deep learning (DL) models like ResNet-50, InceptionV3, and DenseNet with Kernel Extreme Learning Machine (KELM) for the accurate and fast diagnosis of LC cancer using histopathology images. The pre-trained DL models provide a strong foundation for feature extraction, capturing intricate patterns indicative of cancerous tissues. Feature fusion combines the complementary strengths of multiple pre-trained models, enhancing the method's ability to capture diverse features and improve classification accuracy. KELM efficiently handles the high-dimensional feature space generated by the DL models, ensuring fast and accurate classification. Mutation Boosted Dwarf Mongoose Optimization Algorithm (MB-DMOA) further optimizes the model parameters, mitigating the risk of getting stuck in local optima and facilitating better convergence towards the global optimum. By leveraging the advantages of each technique and integrating them into a cohesive framework, the proposed approach achieves superior performance in diagnosing LC cancer, ultimately improving patient outcomes. The proposed study attains accuracy (98.9%), F1-score (97.6%), specificity (96.5%), precision (96.7%) and sensitivity (95.8%). The results illuminate the efficacy of this approach within therapeutic environments.

Adaptive multi-spectral mimicking with 2D-material nanoresonator networks

Active nanophotonic materials that can emulate and adapt between many different spectral profiles—with high fidelity and over a broad bandwidth—could have a far-reaching impact, but are challenging to design due to a high-dimensional and complex design space. Here, we show that a metamaterial network of coupled 2D-material nanoresonators in graphene can adaptively match multiple complex absorption spectra via a set of input voltages. To design such networks, we develop a semi-analytical auto-differentiable dipole-coupled model that allows scalable optimization of high-dimensional networks with many elements and voltage signals. As a demonstration of multi-spectral capability, we design a single network capable of mimicking four spectral targets resembling select gases (nitric oxide, nitrogen dioxide, methane, nitrous oxide) with very high fidelity ( >90% ). Our results could impact the design of highly reconfigurable optical materials and platforms for applications in sensing, communication and display technology, and signature and thermal management.

Enhancing Fault Identification, Classification and Location Accuracy in Transmission Lines

This research paper presents a proposed system for fault identification, classification and location in transmission lines using a Support Vector Machine (SVM)-based technique in conjunction with a Positive Sequence Analyzer. The objective is to develop an accurate and reliable method for identifying, classifying and locating different fault types in transmission lines. The proposed system leverages the capabilities of SVMs in handling high-dimensional feature spaces and the fault signature extraction capabilities of the Positive Sequence Analyzer. Experimental evaluations are conducted to assess the performance and effectiveness of the proposed system, comparing it with existing fault identification and classification methods. The results demonstrate the superior performance and robustness of the SVM-based technique utilizing the Positive Sequence Analyzer, providing a valuable contribution to fault management and system reliability in transmission line networks.

Computation-Driven Rational Design of Self-Assembled Short Peptides for Catalytic Hydrogen Production.

Self-assembling peptides represent a captivating area of study in nanotechnology and biomaterials. This interest is largely driven by their unique properties and the vast application potential across various fields such as catalytic functions. However, design complexities, including high-dimensional sequence space and structural diversity, pose significant challenges in the study of such systems. In this work, we explored the possibility of self-assembled peptides to catalyze the hydrolysis of hydrosilane for hydrogen production using ab initio calculations and carried out wet-lab experiments to confirm the feasibility of these catalytic reactions under ambient conditions. Further, we delved into the nuanced interplay between sequence, structural conformation, and catalytic activity by combining modeling with experimental techniques such as transmission electron microscopy and nuclear magnetic resonance and proposed a dual mode of the microstructure of the catalytic center. Our results reveal that although research in this area is still at an early stage, the development of self-assembled peptide catalysts for hydrogen production has the potential to provide a more sustainable and efficient alternative to conventional hydrogen production methods. In addition, this work also demonstrates that a computation-driven rational design supplemented by experimental validation is an effective protocol for conducting research on functional self-assembled peptides.

Finite-dimensional perturbation of the Dirichlet boundary value problem for the biharmonic equation

Abstract The biharmonic equation is one of the important equations of mathematical physics, describing the behaviour of harmonic functions in higher-dimensional spaces. The main purpose of this study was to construct a finite-dimensional perturbation for the Dirichlet boundary value problem associated with the biharmonic equation. The methodological basis for this study was an integrated approach that includes mathematical analysis, algebraic methods, operator theory, and the theorem on the existence and uniqueness of a solution for a boundary value. The main tool is a finite-dimensional perturbation, which allows for examining the properties and behaviour of boundary value problems in as much detail as possible. In the study, descriptions of correctly solvable internal boundary value problems for a biharmonic equation in non-simply connected domains were considered in detail. The study is also devoted to the search for solutions and the analytical representation of resolvents of boundary value problems for a biharmonic equation in multi-connected domains. Within the framework of the study, theorems and their consequences were proved, and a finite-dimensional perturbation was constructed for the Dirichlet boundary value problem. Analytical representations of resolvents of boundary value problems for a biharmonic equation in multi-connected domains were also obtained. The examination of a finite-dimensional perturbation of the Dirichlet boundary value problem for a biharmonic equation has expanded the understanding of the properties of this equation in various contexts.

Attack on optical cryptosystems by skip connection networks

Optical encryption methods, due to their efficient operation speed and parallel processing capabilities, hold significant importance in securing multidimensional and large-volume data. Enhancing the security of optical cryptosystems from the perspective of cryptanalysis holds significant importance currently. Presently, attack methods against optical encryption are complex, and the effectiveness of these attacks is insufficient. Security analysis solutions face limitations in both breadth and depth. Therefore, this paper proposes an attack on optical cryptosystems based on a skip connection network, demonstrating the susceptibility of optical cryptosystems to attacks based on neural network algorithms. The network model is trained on plaintext-ciphertext pairs, fitting equivalent keys without various additional conditions. It approximates plaintext information in high-dimensional space, directly obtaining corresponding plaintext through ciphertext information, expanding the applicability and enhancing the effectiveness of the attack scheme. Finally, the feasibility and effectiveness of the attack scheme were verified through computer simulations. The experiments indicate that the method proposed in this paper has low computational complexity, wide applicability, produces high-quality decrypted images, and high decipherment accuracy. This provides a universal approach for analyzing the security of various optical cryptosystems from the perspective of chosen plaintext attacks.

Evolution-guided Bayesian optimization for constrained multi-objective optimization in self-driving labs

The development of automated high-throughput experimental platforms has enabled fast sampling of high-dimensional decision spaces. To reach target properties efficiently, these platforms are increasingly paired with intelligent experimental design. However, current optimizers show limitations in maintaining sufficient exploration/exploitation balance for problems dealing with multiple conflicting objectives and complex constraints. Here, we devise an Evolution-Guided Bayesian Optimization (EGBO) algorithm that integrates selection pressure in parallel with a q-Noisy Expected Hypervolume Improvement (qNEHVI) optimizer; this not only solves for the Pareto Front (PF) efficiently but also achieves better coverage of the PF while limiting sampling in the infeasible space. The algorithm is developed together with a custom self-driving lab for seed-mediated silver nanoparticle synthesis, targeting 3 objectives (1) optical properties, (2) fast reaction, and (3) minimal seed usage alongside complex constraints. We demonstrate that, with appropriate constraint handling, EGBO performance improves upon state-of-the-art qNEHVI. Furthermore, across various synthetic multi-objective problems, EGBO shows significative hypervolume improvement, revealing the synergy between selection pressure and the qNEHVI optimizer. We also demonstrate EGBO’s good coverage of the PF as well as comparatively better ability to propose feasible solutions. We thus propose EGBO as a general framework for efficiently solving constrained multi-objective problems in high-throughput experimentation platforms.

On polling directions for randomized direct-search approaches: application to beam angle optimization in intensity-modulated proton therapy

AbstractDeterministic direct-search methods have been successfully used to address real-world challenging optimization problems, including the beam angle optimization (BAO) problem in radiation therapy treatment planning. BAO is a highly non-convex optimization problem typically treated as the optimization of an expensive multi-modal black-box function which results in a computationally time consuming procedure. For the recently available modalities of radiation therapy with protons (instead of photons) further efficiency in terms of computational time is required despite the success of the different strategies developed to accelerate BAO approaches. Introducing randomization into otherwise deterministic direct-search approaches has been shown to lead to excellent computational performance, particularly when considering a reduced number (as low as two) of random poll directions at each iteration. In this study several randomized direct-search strategies are tested considering different sets of polling directions. Results obtained using a prostate and a head-and-neck cancer cases confirmed the high-quality results obtained by deterministic direct-search methods. Randomized strategies using a reduced number of polling directions showed difficulties for the higher dimensional search space (head-and-neck) and, despite the excellent mean results for the prostate cancer case, outliers were observed, a result that is often ignored in the literature. While, for general global optimization problems, mean results (or obtaining the global optimum once) might be enough for assessing the performance of the randomized method, in real-world problems one should not disregard the worst-case scenario and beware of the possibility of poor results since, many times, it is only possible to run the optimization problem once. This is even more important in healthcare applications where the mean patient does not exist and the best treatment possible must be assured for every patient.

Machine learning decoding of single neurons in the thalamus for speech brain-machine interfaces

Objective. Our goal is to decode firing patterns of single neurons in the left ventralis intermediate nucleus (Vim) of the thalamus, related to speech production, perception, and imagery. For realistic speech brain-machine interfaces (BMIs), we aim to characterize the amount of thalamic neurons necessary for high accuracy decoding. Approach. We intraoperatively recorded single neuron activity in the left Vim of eight neurosurgical patients undergoing implantation of deep brain stimulator or RF lesioning during production, perception and imagery of the five monophthongal vowel sounds. We utilized the Spade decoder, a machine learning algorithm that dynamically learns specific features of firing patterns and is based on sparse decomposition of the high dimensional feature space. Main results. Spade outperformed all algorithms compared with, for all three aspects of speech: production, perception and imagery, and obtained accuracies of 100%, 96%, and 92%, respectively (chance level: 20%) based on pooling together neurons across all patients. The accuracy was logarithmic in the amount of neurons for all three aspects of speech. Regardless of the amount of units employed, production gained highest accuracies, whereas perception and imagery equated with each other. Significance. Our research renders single neuron activity in the left Vim a promising source of inputs to BMIs for restoration of speech faculties for locked-in patients or patients with anarthria or dysarthria to allow them to communicate again. Our characterization of how many neurons are necessary to achieve a certain decoding accuracy is of utmost importance for planning BMI implantation.

Unveiling Code Pre-Trained Models: Investigating Syntax and Semantics Capacities

Code models have made significant advancements in code intelligence by encoding knowledge about programming languages. While previous studies have explored the capabilities of these models in learning code syntax, there has been limited investigation on their ability to understand code semantics. Additionally, existing analyses assume the number of edges between nodes at the abstract syntax tree (AST) is related to syntax distance, and also often require transforming the high-dimensional space of deep learning models to a low-dimensional one, which may introduce inaccuracies. To study how code models represent code syntax and semantics, we conduct a comprehensive analysis of 7 code models, including four representative code pre-trained models (CodeBERT, GraphCodeBERT, CodeT5, and UnixCoder) and three large language models (StarCoder, CodeLlama and CodeT5+). We design four probing tasks to assess the models’ capacities in learning both code syntax and semantics. These probing tasks reconstruct code syntax and semantics structures (AST, CDG, DDG and CFG) in the representation space. These structures are core concepts for code understanding. We also investigate the syntax token role in each token representation and the long dependency between the code tokens. Additionally, we analyze the distribution of attention weights related to code semantic structures. Through extensive analysis, our findings highlight the strengths and limitations of different code models in learning code syntax and semantics. The results demonstrate that these models excel in learning code syntax, successfully capturing the syntax relationships between tokens and the syntax roles of individual tokens. However, their performance in encoding code semantics varies. CodeT5 and CodeBERT demonstrate proficiency in capturing control and data dependencies, while UnixCoder shows weaker performance in this aspect. We do not observe LLMs generally performing much better than pre-trained models. The shallow layers of LLMs perform better than their deep layers. The investigation of attention weights reveals that different attention heads play distinct roles in encoding code semantics. Our research findings emphasize the need for further enhancements in code models to better learn code semantics. This study contributes to the understanding of code models’ abilities in syntax and semantics analysis. Our findings provide guidance for future improvements in code models, facilitating their effective application in various code-related tasks.

Hypergraph-Based Numerical Spiking Neural Membrane Systems with Novel Repartition Protocols.

The classic spiking neural P (SN P) systems abstract the real biological neural network into a simple structure based on graphs, where neurons can only communicate on the plane. This study proposes the hypergraph-based numerical spiking neural membrane (HNSNM) systems with novel repartition protocols. Through the introduction of hypergraphs, the HNSNM systems can characterize the high-order relationships among neurons and extend the traditional neuron structure to high-dimensional nonlinear spaces. The HNSNM systems also abstract two biological mechanisms of synapse creation and pruning, and use plasticity rules with repartition protocols to achieve planar, hierarchical and spatial communications among neurons in hypergraph neuron structures. Through imitating register machines, the Turing universality of the HNSNM systems is proved by using them as number generating and accepting devices. A universal HNSNM system consisting of 41 neurons is constructed to compute arbitrary functions. By solving NP-complete problems using the subset sum problem as an example, the computational efficiency and effectiveness of HNSNM systems are verified.

Age-Invariant Face Recognition Using FaceNet and Multi-task Cascaded Convolutional Networks (MTCNN)

In an era where face recognition technology serves as a cornerstone for security, surveillance, and human-computer interaction, the persistence of age-related variations in facial appearance presents a significant challenge. This research introduces an innovative solution that amalgamates the capabilities of the FaceNet deep learning model with Multi-task Cascaded Convolutional Networks (MTCNN) to achieve precise and robust face recognition across diverse age groups. Leveraging FaceNet's prowess in extracting distinctive features from facial images and mapping them to a high-dimensional feature space for efficient face matching, our system incorporates MTCNN as a pre-processing step to accurately detect and align faces, effectively mitigating age-related changes in facial geometry. Crucially, this novel approach obviates the need for age-specific databases and age group categorization, rendering it a versatile and practical solution for age-invariant face recognition. Rigorous experimentation on benchmark datasets underscores the system's resilience and accuracy across a broad spectrum of age groups, culminating in state-of-the-art results in age-invariant face recognition. The implications of this proposed approach are profound, promising to fortify security measures and enhance user experiences in applications such as access control, personal identification, and customer service, while ensuring dependable and accurate face recognition, irrespective of an individual's age. Key Words: Face recognition, face aging, generative adversarial networks

Real-time prediction of fuel consumption and emissions based on deep autoencoding support vector regression for cylinder pressure-based feedback control of marine diesel engines

Predictive models serving as virtual sensors for online optimization and feedback control of diesel engines is gaining increasing attention. However, existing prediction models fall short in simultaneously achieving high prediction accuracy and fast computational speed. In this paper, a novel machine learning algorithm called deep autoencoding support vector regression (DASVR) was proposed, which combines the powerful non-linear feature extraction capability of artificial neural network (ANN) with the good adaptability of support vector regression (SVR) to low-dimensional input spaces. ANN-based autoencoder is firstly employed to extract features from the original high-dimensional input space, forming a low-dimensional latent variable space. SVR is then employed to perform non-linear mapping between latent variables and target output variables. Experiments were conducted on a 16-cylinder marine diesel engine under different load, rail pressure, and injection timing conditions. Prediction models for fuel consumption, NOx, PM, HC, and PM emissions were established based on experimental data and DASVR algorithm. The maximum error of DASVR-based models for the five desired output variables is less than 3.8 % under different operating conditions. DAVSR-based predictive models outperform conventional ANN-based and SVR-based models in terms of both prediction accuracy and real-time capability, and can theoretically meet the real-time requirement below 3000 r/min.

A clustering-based partially stratified sampling for high-dimensional structural reliability assessment

Assessing structural reliability problem with high-dimensional random inputs is still challenging due to the “curse of dimensionality”. In this paper, this challenge is addressed by extending the Generalized Distribution Reconstruction Method via Characteristic Function Inversion (GDRM-CFI). Specifically, a clustering-based partially stratified sampling method is proposed for selecting high-dimensional points to numerically evaluate the characteristic function (CF) curve of complex high-dimensional problems. An improved number-theoretical method (i-NTM) is used to establish a uniform, efficient point set, ensuring determinism and reducing variability. Subsequently, a partial stratification approach partitions the high-dimensional space into orthogonal two-dimensional subspaces. The fundamental point set is projected into each subspace, and the k-means clustering algorithm identifies centroids within each, acting as representative points. The complete set of representative points from all subspaces formulates the high-dimensional point set. Numerical examples are investigated, which demonstrate the proposed method is effective for high-dimensional structural reliability assessment.

CompleteDT: Point cloud completion with information-perception transformers

In this work, we propose a novel point cloud completion network, called CompleteDT. To fully capture the 3D geometric structure of point clouds, we introduce an Information-Perception Transformer (IPT) that can simultaneously capture local features and global geometric relations. CompleteDT comprises a Feature Encoder, Query Generator, and Query Decoder. Feature Encoder extracts local features from multi-resolution point clouds to capture intricate geometrical structures. Query Generator uses the proposed IPT, utilizing the Point Local Attention (PLA) and Point Global Attention (PGA) modules, to learn local features and global correlations, and generate query features that represent predicted point clouds. The PLA captures local information within local points by adaptively measuring weights of neighboring points, while PGA adapts multi-head self-attention by transforming it into a layer-by-layer form where each head learns global features in a high-dimensional space of different dimensions. By dense connections, the module allows for direct information exchange between each head and facilitates the capture of long global correlations. By combining the strengths of both PLA and PGA, the IPT can fully leverage local and global features to facilitate CompleteDT to complete point clouds. Lastly, the query features undergo refining to generate a complete point cloud through the Query Decoder. Our experimental results demonstrate that CompleteDT outperforms current state-of-the-art methods, effectively learning from incomplete inputs and predicting complete outputs.

Inverse analysis of granular flows using differentiable graph neural network simulator

Inverse problems in granular flows, such as landslides and debris flows, involve estimating material parameters or boundary conditions based on a target runout profile. Traditional high-fidelity simulators for these inverse problems are computationally expensive, restricting the number of possible simulations. These simulators are also non-differentiable, making efficient gradient-based optimization methods for high-dimensional spaces inapplicable. Machine learning-based surrogate models offer computational efficiency and differentiability. However, they often struggle to generalize beyond their training data due to relying on low-dimensional input–output mappings that fail to capture the complete physics of granular flows. We propose a novel differentiable graph neural network simulator (GNS) that combines reverse mode automatic differentiation of graph neural networks with gradient-based optimization for solving inverse problems. GNS learns the dynamics of granular flow by representing the system as a graph and predicts the evolution of the graph at the next timestep, given the current state. The differentiable GNS demonstrates optimization capabilities beyond the training data. We demonstrate the effectiveness of our method for inverse estimation across single and multi-parameter optimization problems, including evaluating material properties and boundary conditions for a target runout distance and designing baffle locations to limit a landslide runout. Our proposed differentiable GNS framework solves inverse problems with orders of magnitude faster convergence than the conventional gradient-based optimization approach using finite difference.

Learnable faster kernel-PCA for nonlinear fault detection: Deep autoencoder-based realization

Kernel principal component analysis (KPCA) is a well-recognized nonlinear dimensionality reduction method that has been widely used in nonlinear fault detection tasks. As a kernel trick-based method, KPCA inherits two major problems. First, the form and the parameters of the kernel function are usually selected blindly, depending seriously on trial-and-error. As a result, there may be serious performance degradation in case of inappropriate selections. Second, at the online monitoring stage, KPCA has much computational burden and poor real-time performance, because the kernel method requires to leverage all the offline training data. In this work, to deal with the two drawbacks, a learnable faster realization of the conventional KPCA is proposed. The core idea is to parameterize all feasible kernel functions using the novel nonlinear DAE-FE (deep autoencoder based feature extraction) framework and propose DAE-PCA (deep autoencoder based principal component analysis) approach in detail. The proposed DAE-PCA method is proved to be equivalent to KPCA but has more advantage in terms of automatic searching of the most suitable nonlinear high-dimensional space according to the inputs, which helps to improve the accuracy of fault detection. Furthermore, the online computational efficiency improves by many times compared with the conventional KPCA. Finally, the Tennessee Eastman (TE) process benchmark and wastewater treatment plant (WWTP) benchmark are employed to illustrate the effectiveness of the proposed method, where the average fault detection rates of DAE-PCA are at least 0.27% and 4.69% higher than those of other methods, and its online computational efficiency is faster 90.48% and 24.57% times than that of KPCA respectively.

A Dichotomy for the Dimension of Solenoidal Attractors on High Dimensional Space

A Dichotomy for the Dimension of Solenoidal Attractors on High Dimensional Space