Proposed Features Research Articles

Context-Aware Proposal-Boundary Network With Structural Consistency for Audiovisual Event Localization.

Audiovisual event localization aims to localize the event that is both visible and audible in a video. Previous works focus on segment-level audio and visual feature sequence encoding and neglect the event proposals and boundaries, which are crucial for this task. The event proposal features provide event internal consistency between several consecutive segments constructing one proposal, while the event boundary features offer event boundary consistency to make segments located at boundaries be aware of the event occurrence. In this article, we explore the proposal-level feature encoding and propose a novel context-aware proposal-boundary (CAPB) network to address audiovisual event localization. In particular, we design a local-global context encoder (LGCE) to aggregate local-global temporal context information for visual sequence, audio sequence, event proposals, and event boundaries, respectively. The local context from temporally adjacent segments or proposals contributes to event discrimination, while the global context from the entire video provides semantic guidance of temporal relationship. Furthermore, we enhance the structural consistency between segments by exploiting the above-encoded proposal and boundary representations. CAPB leverages the context information and structural consistency to obtain context-aware event-consistent cross-modal representation for accurate event localization. Extensive experiments conducted on the audiovisual event (AVE) dataset show that our approach outperforms the state-of-the-art methods by clear margins in both supervised event localization and cross-modality localization.

Proposal Semantic Relationship Graph Network for Temporal Action Detection

Temporal action detection, a critical task in video activity understanding, is typically divided into two stages: proposal generation and classification. However, most existing methods overlook the importance of information transfer among proposals during classification, often treating each proposal in isolation, which hampers accurate label prediction. In this paper, we propose a novel method for inferring semantic relationships both within and between action proposals, guiding the fusion of action proposal features accordingly. Building on this approach, we introduce the Proposal Semantic Relationship Graph Network (PSRGN), an end-to-end model that leverages intra-proposal semantic relationship graphs to extract cross-scale temporal context and an inter-proposal semantic relationship graph to incorporate complementary neighboring information, significantly improving proposal feature quality and overall detection performance. This is the first method to apply graph structure learning in temporal action detection, adaptively constructing the inter-proposal semantic graph. Extensive experiments on two datasets demonstrate the effectiveness of our approach, achieving state-of-the-art results. Code and results are available at http://github.com/Riiick2011/PSRGN .

Complexity equals anything can grow forever in de Sitter space

Recent developments in anti–de Sitter holography point towards the association of an infinite class of covariant objects, the simplest one being codimension-one extremal volumes, with quantum computational complexity in the microscopic description. One of the defining features of these gravitational complexity proposals is describing the persistent growth of black hole interior in classical gravity. It is tempting to assume that the gravitational complexity proposals apply also to gravity outside their native anti–de Sitter setting in which case they may reveal new truths about these cases with much less understood microscopics. Recent first steps in this direction in de Sitter static patch demonstrated a very different behavior from anti–de Sitter holography deemed hyperfast growth; diverging complexification rate after a finite time. We show that this feature is not a necessity and among gravitational complexity proposals there are ones, that predict linear or exponential late-time growth behaviors for complexity in de Sitter static patches persisting classically forever. Published by the American Physical Society 2024

The cosmological switchback effect. Part II

Recent developments in static patch holography proposed that quantum gravity in de Sitter space admits a dual description in terms of a quantum mechanical theory living on a timelike surface near the cosmological horizon. In parallel, geometric observables associated with the Einstein-Rosen bridge of a black hole background were suggested to compute the computational complexity of the state dual to a gravitational theory. In this work, we pursue the study of the complexity=volume and complexity=action conjectures in a Schwarzschild-de Sitter geometry perturbed by the insertion of a shockwave at finite boundary times. This analysis extends previous studies that focused either on the complexity=volume 2.0 conjecture, or on the case of a shockwave inserted along the cosmological horizon. We show that the switchback effect, describing the delay in the evolution of complexity in reaction to a perturbation, is a universal feature of the complexity proposals in asymptotically de Sitter space. The geometric origin of this phenomenon is related to the causal connection between the static patches of de Sitter space when a positive pulse of null energy is inserted in the geometry.

The programs of additional legal education as necessary element of system of training of students of medical university

The actual trends in training of health care professionals set before medical university task of actualization and diversification of training programs targeted to formation both professional and universal competencies to contribute to variable combination of different skills and habits in implementation of medical activities. The increasing needs of labor market in specialists capable to meet actual realities and associated with transformational transition from narrow specialization to different specific skills, inevitably results into increasing of importance for additional education programs as an element of continuing The following key features of various proposals for additional professional education programs were singled out. The major task of forming proposal of additional programs is seen by university through prism of possible increasing of income. And main contingent of students is formed by specialists improve their qualifications. The specificity of medical university is specialists training to implement medical practice. In this regard, additional law training programs are targeted to exclusively at persons mastering basic educational program for the first time. The competencies implemented are focused at extending and specifying training considering legal maintenance or new trends. Besides, applying value-based approach to formation of educational trajectory of student, university translates primary importance of autonomy of will of student choosing additional educational programs. Thus, learning program of additional education is carried out using basic training in law and considering necessary and sufficient factual component that meets the needs of modern labor market, permitting strengthen and expand available competencies for future professional activity of medical worker. The article analyzed results of studies of pedagogues and psychologists, specialists of philosophical direction, professional lecturers, and sociological studies. The methods applied were analysis and synthesis, formalization, generalization, document analysis. The main methods of data analysis were substantive (hermeneutical) analysis and discourse analysis.

End-to-End Multitask Learning With Vision Transformer.

Multitask learning (MTL) is a challenging puzzle, particularly in the realm of computer vision (CV). Setting up vanilla deep MTL requires either hard or soft parameter sharing schemes that employ greedy search to find the optimal network designs. Despite its widespread application, the performance of MTL models is vulnerable to under-constrained parameters. In this article, we draw on the recent success of vision transformer (ViT) to propose a multitask representation learning method called multitask ViT (MTViT), which proposes a multiple branch transformer to sequentially process the image patches (i.e., tokens in transformer) that are associated with various tasks. Through the proposed cross-task attention (CA) module, a task token from each task branch is regarded as a query for exchanging information with other task branches. In contrast to prior models, our proposed method extracts intrinsic features using the built-in self-attention mechanism of the ViT and requires just linear time on memory and computation complexity, rather than quadratic time. Comprehensive experiments are carried out on two benchmark datasets, including NYU-Depth V2 (NYUDv2) and CityScapes, after which it is found that our proposed MTViT outperforms or is on par with existing convolutional neural network (CNN)-based MTL methods. In addition, we apply our method to a synthetic dataset in which task relatedness is controlled. Surprisingly, experimental results reveal that the MTViT exhibits excellent performance when tasks are less related.

¿Podrían las nuevas propuestas regulatorias de la UE en materia de fitomejoramiento comprometer la innovación? Entre las expectativas generadas por la propuesta sobre Nuevas Técnicas Genómicas y el sinsentido de la propuesta sobre Material de Reproducción

The European Commission new regulatory proposals on new genome-edited plants and on plant reproductive material are set to revolutionize plant breeding and agriculture in the EU. This short communication analyzes the main features of such proposals with respect to the current regulatory frameworks in the EU, and discusses their foreseeable impact on European plant breeding innovation and agriculture. While there is no denying the potential advantages that the proposal on new genome-edited plants might bring, the proposed regulation is also complex and ambiguous, a matter already acknowledged by the specialized literature, and about which even some of the strongest advocates of the proposed regulation appear to show a certain degree of concern. If this is not corrected, the successful implementation of the proposal could be compromised. The proposal on plant reproductive material threatens to create new and probably unnecessary burdens for European plant breeders, farmers, and end consumers. Addressing the identified issues in the proposal on genome-edited plants, and drafting a new proposal on plant reproductive material aiming at reducing inefficiencies is suggested. Received: 21.12.2023Accepted: 10.05.2024

Automatic extraction of non-bifurcated lunar lineaments from Lunar Reconnaissance Orbiter (LRO) monochromatic images based on a Markov chain method

ABSTRACT Lineaments play a critical role in the study of lunar geological evolution. However, lineaments still need to be extracted manually which constrains lunar research. To fill this gap, a Markov chain-based methodology is introduced for automatically extracting vector-based non-bifurcated lineaments from images. The extracted lineaments are formed by successive nodes and line segments, where nodes denote pixel positions and line segments represented connecting lines between nodes. A modified U-net with residual shortcut connections and dilated convolutions is proposed based on the elongated shapes of lineaments to evaluate the probability of nodes belonging to lineaments. Four connection shape features are proposed to describe the connection shapes of nodes and a Gaussian Mixture Model is used to evaluate the probability of line segments belonging to the lineaments based on the proposed features. In the final stage, the lineament probabilities of both nodes and line segments to extract lineaments are considered in the Markov chain. Our method has experimented on a dataset containing 220 samples and 10-fold cross-validation was used to evaluate the performance. Both qualitative and quantitative results indicated that our method can effectively extract non-bifurcated lunar lineaments with arbitrary bending. The method sheds useful light on automatic lineament extraction.

Bayesian Optimization via Exact Penalty

Constrained optimization problems pose challenges when the objective function and constraints are nonconvex and their evaluation requires expensive black-box simulations. Recently, hybrid optimization methods that integrate statistical surrogate modeling with numerical optimization algorithms have shown great promise, as they inherit the properties of global convergence from statistical surrogate modeling and fast local convergence from numerical optimization algorithms. However, the computational efficiency is not satisfied by practical needs under limited budgets and in the presence of equality constraints. In this article, we propose a novel hybrid optimization method, called exact penalty Bayesian optimization (EPBO), which employs Bayesian optimization within the exact penalty framework. We model the composite penalty function by a weighted sum of Gaussian processes, where the qualitative components of the constraint violations are smoothed by their predictive means. The proposed method features (i) closed-form acquisition functions, (ii) robustness to initial designs, (iii) the capability to start from infeasible points, and (iv) effective handling of equality constraints. We demonstrate the superiority of EPBO to state-of-the-art competitors using a suite of benchmark synthetic test problems and two real-world engineering design problems.

Comment on "Three New Dimers and Two Monomers of Phenolic Amides from the Fruits of Lycium barbarum and Their Antioxidant Activities".

This Comment critically addresses the article by Gao et al. (Gao, K., et al. J. Agric. Food Chem. 2015, 63, 1067-1075), providing the structural elucidation of three phenolamide dimers (neolignanamides) from the fruits of Lycium barbarum. A more recent article published by Chen et al. (Chen, H., et al. J. Agric. Food Chem. 2023, 71, 11080-11093) incorporates these structures into further research on the bioactivity of these compounds. Although the analytical techniques used by Gao et al. are adequate, in our opinion, the nuclear magnetic resonance (NMR) spectroscopic data have not been interpreted correctly, resulting in incorrect structures for three neolignanamides from the fruits of L. barbarum. In this Comment, an alternative interpretation of the NMR spectroscopic data and the corresponding structures are proposed. The proposed structures feature linkage types that are much more common for neolignanamides than the linkage types in the originally reported structures of these compounds.

Automatic classification of seizure and seizure-free EEG signals based on phase space reconstruction features.

Epilepsy is a type of brain disorder triggered by an abrupt electrical imbalance of neuronal networks. An electroencephalogram (EEG) is a diagnostic tool to capture the underlying brain mechanisms and detect seizure onset in epileptic patients. To detect seizures, neurologists need to manually monitor EEG recordings for long periods, which is challenging and susceptible to errors depending on expertise and experience. Therefore, automatic identification of seizure and seizure-free EEG signals becomes essential. This study introduces a method based on the features extracted from the phase space reconstruction for classifying seizure and seizure-free EEG signals. The computed features are derived from the elliptical area and interquartile range of the Euclidean distance by varying percentage values of data points ranging from 50 to 100%. We consider two public datasets and evaluate these features in each EEG epoch that includes the healthy, interictal, preictal, and ictal stages of epileptic subjects, utilizing the K-nearest neighbor classifier for classification. Results show that the features have higher values during the seizure than the seizure-free EEG signals and healthy subjects. Furthermore, the proposed features can effectively discriminate seizure EEG signals from the seizure-free and normal subjects with 100% accuracy, sensitivity, and specificity in both datasets. Likewise, the classification between the preictal stage and seizure EEG signals attains 98% accuracy. Overall, the reconstructed phase space features significantly enhance the accuracy of detecting epileptic EEG signals compared with existing methods. This advancement holds great potential in assisting neurologists in swiftly and accurately diagnosing epileptic seizures from EEG signals.

Effective Facial Expression Recognition System Using Machine Learning

The co Facial expression recognition (FER) is a topic that has seen a lot of study in computer vision and machine learning. In recent years, deep learning techniques have shown remarkable progress on FER tasks. With this abstract, A Novel Is Advised By Us FER method that combines combined use of k-nearest neighbours and long short-term memory algorithms better efficiency and accurate facial expression recognition. The proposed system features two primary steps—feature extraction and classification—to get results. When extracting features, we extract features from the facial images using the Local Binary Patterns (LBP) algorithm. LBP is a simple yet powerful feature extraction technique that captures texture information from the image. In the classification stage, we use the KNN and LSTM algorithms for facial expression recognition. KNN is a simple and effective classification algorithm that finds the k closest to the given value neighbours to the test training-set-sample and assigning it to the class that is most frequent among its neighbours. However, KNN has limitations in handling temporal information. To address this limitation, we propose to use LSTM, which is a subclass of RNNs capable of capturing temporal relationships in time series data. The LSTM network takes as input the LBP features of a sequence of facial images and processes them through a series of LSTM cells to estimate the ultimate coding of the phrase. We examine the planned and system on two publicly available records: the CK+ and the Oulu-CASIA datasets. According on the experimental findings, the proposed system achieves performance at the cutting edge on both datasets. The proposed system performs better than other state-of-the-art methods, including those that use deep learning systems, quantitatively, in terms of F1-score and precision.In conclusion, the proposed FER system that combines KNN and LSTM algorithms achieves high accuracy and an F1 score in recognising facial expressions from sequences of images. This system can be used in many contexts, including human-computer interaction, emotion detection, and behaviour analysis.

Pattern recognition for EMG based forearm orientation and contraction in myoelectric prosthetic hand

Communication is an essential component of human nature. It connects humans, allowing them to learn, grow, col-laborate, and resolve conflicts. Several aspects of human society, relationships, and growth would be significantly hampered in the absence of efficient communication. Hand gesture recognition is a way to interact with technology that can be particularly useful for individuals with disabilities. This hand gesture recognition is mainly employed in sign language translation, healthcare, rehabilitation, prosthesis, and Human-Computer Interaction (HCI). The high degree of dexterity is a main challenge for prosthetic limbs. In order to meet this challenge, hand gesture recognition is employed for the prosthetic limb, which can be used for rehabilitation. The objective of this article is to show the methodology for the recognition of hand gestures using Electromyography (EMG) signals. This article uses the pro-posed time domain feature extraction method called Absolute Fluctuation Analysis (AFA) along with the Root Mean Square (RMS) for the feature extraction method. Along with these feature extraction methods, repeated stratified K-fold cross validation is used for the validation of the classifiers such as the XGB classifier, the K-Nearest Neighbour (KNN) classifier, the Decision Tree classifier, the Random Forest classifier, and the SVM classifier, whose mean recognition accuracy is given by 93.26%, 87.42%, 85.26%, 92.23%, and 91.78%, respectively. The recognition accuracy of machine learning classifiers is being compared with state-of-the-art networks such as artificial neural net-works (ANN), long short-term memory (LSTM), bidirectional LSTM, gated recurrent units (GRU), and convolution-al neural networks (CNN), which provide recognition accuracy of 96.65%, 99.16%, 99.94%, and 99.99%, respectively.

Two-Level Spatio-Temporal Feature Fused Two-Stream Network for Micro-Expression Recognition.

Micro-expressions, which are spontaneous and difficult to suppress, reveal a person's true emotions. They are characterized by short duration and low intensity, making the task of micro-expression recognition challenging in the field of emotion computing. In recent years, deep learning-based feature extraction and fusion techniques have been widely used for micro-expression recognition, particularly methods based on Vision Transformer that have gained popularity. However, the Vision Transformer-based architecture used in micro-expression recognition involves a significant amount of invalid computation. Additionally, in the traditional two-stream architecture, although separate streams are combined through late fusion, only the output features from the deepest level of the network are utilized for classification, thus limiting the network's ability to capture subtle details due to the lack of fine-grained information. To address these issues, we propose a new two-level spatio-temporal feature fused with a two-stream architecture. This architecture includes a spatial encoder (modified ResNet) for learning texture features of the face, a temporal encoder (Swin Transformer) for learning facial muscle motor features, a feature fusion algorithm for integrating multi-level spatio-temporal features, a classification head, and a weighted average operator for temporal aggregation. The two-stream architecture has the advantage of extracting richer features compared to the single-stream architecture, leading to improved performance. The shifted window scheme of Swin Transformer restricts self-attention computation to non-overlapping local windows and allows cross-window connections, significantly improving the performance and reducing the computation compared to Vision Transformer. Moreover, the modified ResNet is computationally less intensive. Our proposed feature fusion algorithm leverages the similarity in output feature shapes at each stage of the two streams, enabling the effective fusion of multi-level spatio-temporal features. This algorithm results in an improvement of approximately 4% in both the F1 score and the UAR. Comprehensive evaluations conducted on three widely used spontaneous micro-expression datasets (SMIC-HS, CASME II, and SAMM) consistently demonstrate the superiority of our approach over comparative methods. Notably, our approach achieves a UAR exceeding 0.905 on CASME II, making it one of the few frameworks in the published micro-expression recognition literature to achieve such high performance.

Developing an AI-empowered head-only ultra-high-performance gradient MRI system for high spatiotemporal neuroimaging

Recent advances in neuroscience requires high-resolution MRI to decipher the structural and functional details of the brain. Developing a high-performance gradient system is an ongoing effort in the field to facilitate high spatial and temporal encoding. Here, we proposed a head-only gradient system NeuroFrontier, dedicated for neuroimaging with an ultra-high gradient strength of 650 mT/m and 600 T/m/s. The proposed system features in 1) ultra-high power of 7MW achieved by running two gradient power amplifiers using a novel paralleling method; 2) a force/torque balanced gradient coil design with a two-step mechanical structure that allows high-efficiency and flexible optimization of the peripheral nerve stimulation; 3) a high-density integrated RF system that is miniaturized and customized for the head-only system; 4) an AI-empowered compressed sensing technique that enables ultra-fast acquisition of high-resolution images and AI-based acceleration in q-t space for diffusion MRI (dMRI); and 5) a prospective head motion correction technique that effectively corrects motion artifacts in real-time with 3D optical tracking. We demonstrated the potential advantages of the proposed system in imaging resolution, speed, and signal-to-noise ratio for 3D structural MRI (sMRI), functional MRI (fMRI) and dMRI in neuroscience applications of submillimeter layer-specific fMRI and dMRI. We also illustrated the unique strength of this system for dMRI-based microstructural mapping, e.g., enhanced lesion contrast at short diffusion-times or high b-values, and improved estimation accuracy for cellular microstructures using diffusion-time-dependent dMRI or for neurite microstructures using q-space approaches.

Identifying temporal correlations between natural single-shot videos and EEG signals

Objective. Electroencephalography (EEG) is a widely used technology for recording brain activity in brain-computer interface (BCI) research, where understanding the encoding-decoding relationship between stimuli and neural responses is a fundamental challenge. Recently, there is a growing interest in encoding-decoding natural stimuli in a single-trial setting, as opposed to traditional BCI literature where multi-trial presentations of synthetic stimuli are commonplace. While EEG responses to natural speech have been extensively studied, such stimulus-following EEG responses to natural video footage remain underexplored. Approach. We collect a new EEG dataset with subjects passively viewing a film clip and extract a few video features that have been found to be temporally correlated with EEG signals. However, our analysis reveals that these correlations are mainly driven by shot cuts in the video. To avoid the confounds related to shot cuts, we construct another EEG dataset with natural single-shot videos as stimuli and propose a new set of object-based features. Main results. We demonstrate that previous video features lack robustness in capturing the coupling with EEG signals in the absence of shot cuts, and that the proposed object-based features exhibit significantly higher correlations. Furthermore, we show that the correlations obtained with these proposed features are not dominantly driven by eye movements. Additionally, we quantitatively verify the superiority of the proposed features in a match-mismatch task. Finally, we evaluate to what extent these proposed features explain the variance in coherent stimulus responses across subjects. Significance. This work provides valuable insights into feature design for video-EEG analysis and paves the way for applications such as visual attention decoding.

From User Behavior to Subscription Sales: An Insight Into E-Book Platform Leveraging Customer Segmentation and A/B Testing

E-book platforms have gained popularity due to their affordability, portability, and extensive title selection. This study analyzes customer behavior based on their platform activities before the launch of a subscription service and investigates strategies to boost subscription plan adoption. To achieve this, we employ customer segmentation through a clustering algorithm to examine customer behavior. Subsequently, we track customer behavior in two distinct groups: RFM and proposed features, regarding their engagement with purchased plans via A/B testing. The results indicate that the conversion rates for the proposed features outperform the RFM model in experiments by 0.42% (2072 customers) and 0.54% (27 customers).

Cepstral Analysis-Based Artifact Detection, Recognition, and Removal for Prefrontal EEG

This paper proposes to use cepstrum for artifact detection, recognition and removal in prefrontal EEG. This work focuses on the artifact caused by eye movement. A database containing artifact-free EEG and eye movement contaminated EEG from different subjects is established. A cepstral analysis-based feature extraction with support vector machine (SVM) based classifier is designed to identify the artifacts from the target EEG signals. The proposed method achieves an accuracy of 99.62% on the artifact detection task and a 82.79% accuracy on the 6-category eye movement classification task. A statistical value-based artifact removal method is proposed and evaluated on a public EEG database, where an accuracy improvement of 3.46% is obtained on the 3-category emotion classification task. In order to make a confident decision of each 5s EEG segment, the algorithm requires only 0.66M multiplication operations. Compared to the state-of-the-art approaches in artifact detection and removal, the proposed method features higher detection accuracy and lower computational cost, which makes it a more suitable solution to be integrated into a real-time and artifact robust Brain-Machine Interface (BMI).

A System for Monitoring Animals Based on Behavioral Information and Internal State Information.

Managing the risk of injury or illness is an important consideration when keeping pets. This risk can be minimized if pets are monitored on a regular basis, but this can be difficult and time-consuming. However, because only the external behavior of the animal can be observed and the internal condition cannot be assessed, the animal's state can easily be misjudged. Additionally, although some systems use heartbeat measurement to determine a state of tension, or use rest to assess the internal state, because an increase in heart rate can also occur as a result of exercise, it is desirable to use this measurement in combination with behavioral information. In the current study, we proposed a monitoring system for animals using video image analysis. The proposed system first extracts features related to behavioral information and the animal's internal state via mask R-CNN using video images taken from the top of the cage. These features are used to detect typical daily activities and anomalous activities. This method produces an alert when the hamster behaves in an unusual way. In our experiment, the daily behavior of a hamster was measured and analyzed using the proposed system. The results showed that the features of the hamster's behavior were successfully detected. When loud sounds were presented from outside the cage, the system was able to discriminate between the behavioral and internal changes of the hamster. In future research, we plan to improve the accuracy of the measurement of small movements and develop a more accurate system.

Community-Aware Evolution Similarity for Link Prediction in Dynamic Social Networks

The link prediction problem is a time-evolving model in network science that has simultaneously abetted myriad applications and experienced extensive methodological improvement. Inferring the possibility of emerging links in dynamic social networks, also known as the dynamic link prediction task, is complex and challenging. In contrast to the link prediction in cross-sectional networks, dynamic link prediction methods need to cater to the actor-level temporal changes and associated evolutionary information regarding their micro- (i.e., link formation/deletion) and mesoscale (i.e., community formation) network structure. With the advent of abundant community detection algorithms, the research community has examined community-aware link prediction strategies in static networks. However, the same task in dynamic networks where, apart from the actors and links among them, their community pattern is also dynamic, is yet to be explored. Evolutionary community-aware information, including the associated link structure and temporal neighborhood changes, can effectively be mined to build dynamic similarity metrics for dynamic link prediction. This study aims to develop and integrate such dynamic features with machine learning algorithms for link prediction tasks in dynamic social networks. It also compares the performances of these features against well-known similarity metrics (i.e., ResourceAllocation) for static networks and a time series-based link prediction strategy in dynamic networks. These proposed features achieved high-performance scores, representing them as prospective candidates for both dynamic link prediction tasks and modeling the network growth.