Frame Prediction Research Articles

Bidirectional dynamic frame prediction network for total-body [68Ga]Ga-PSMA-11 and [68Ga]Ga-FAPI-04 PET images

PurposeTotal-body dynamic positron emission tomography (PET) imaging with total-body coverage and ultrahigh sensitivity has played an important role in accurate tracer kinetic analyses in physiology, biochemistry, and pharmacology. However, dynamic PET scans typically entail prolonged durations (\\documentclass[12pt]{minimal} \\usepackage{amsmath} \\usepackage{wasysym} \\usepackage{amsfonts} \\usepackage{amssymb} \\usepackage{amsbsy} \\usepackage{mathrsfs} \\usepackage{upgreek} \\setlength{\\oddsidemargin}{-69pt} \\begin{document}$$\\:\\ge\\:$$\\end{document}60 minutes), potentially causing patient discomfort and resulting in artifacts in the final images. Therefore, we propose a dynamic frame prediction method for total-body PET imaging via deep learning technology to reduce the required scanning time.MethodsOn the basis of total-body dynamic PET data acquired from 13 subjects who received [68Ga]Ga-FAPI-04 (68Ga-FAPI) and 24 subjects who received [68Ga]Ga-PSMA-11 (68Ga-PSMA), we propose a bidirectional dynamic frame prediction network that uses the initial and final 10 min of PET imaging data (frames 1–6 and frames 25–30, respectively) as inputs. The peak signal-to-noise ratio (PSNR) and structural similarity index measure (SSIM) were employed as evaluation metrics for an image quality assessment. Moreover, we calculated parametric images (68Ga-FAPI: \\documentclass[12pt]{minimal} \\usepackage{amsmath} \\usepackage{wasysym} \\usepackage{amsfonts} \\usepackage{amssymb} \\usepackage{amsbsy} \\usepackage{mathrsfs} \\usepackage{upgreek} \\setlength{\\oddsidemargin}{-69pt} \\begin{document}$$\\:{K}_{1}$$\\end{document}, 68Ga-PSMA: \\documentclass[12pt]{minimal} \\usepackage{amsmath} \\usepackage{wasysym} \\usepackage{amsfonts} \\usepackage{amssymb} \\usepackage{amsbsy} \\usepackage{mathrsfs} \\usepackage{upgreek} \\setlength{\\oddsidemargin}{-69pt} \\begin{document}$$\\:{K}_{i}$$\\end{document}) based on the supplemented sequence data to observe the quantitative accuracy of our approach. Regions of interest (ROIs) and statistical analyses were utilized to evaluate the performance of the model.ResultsBoth the visual and quantitative results illustrate the effectiveness of our approach. The generated dynamic PET images yielded PSNRs of 36.056 ± 0.709 dB for the 68Ga-PSMA group and 33.779 ± 0.760 dB for the 68Ga-FAPI group. Additionally, the SSIM reached 0.935 ± 0.006 for the 68Ga-FAPI group and 0.922 ± 0.009 for the 68Ga-PSMA group. By conducting a quantitative analysis on the parametric images, we obtained PSNRs of 36.155 ± 4.813 dB (68Ga-PSMA, \\documentclass[12pt]{minimal} \\usepackage{amsmath} \\usepackage{wasysym} \\usepackage{amsfonts} \\usepackage{amssymb} \\usepackage{amsbsy} \\usepackage{mathrsfs} \\usepackage{upgreek} \\setlength{\\oddsidemargin}{-69pt} \\begin{document}$$\\:{K}_{1}$$\\end{document}) and 43.150 ± 4.102 dB (68Ga-FAPI, \\documentclass[12pt]{minimal} \\usepackage{amsmath} \\usepackage{wasysym} \\usepackage{amsfonts} \\usepackage{amssymb} \\usepackage{amsbsy} \\usepackage{mathrsfs} \\usepackage{upgreek} \\setlength{\\oddsidemargin}{-69pt} \\begin{document}$$\\:{K}_{i}$$\\end{document}). The obtained SSIM values were 0.932 ± 0.041 (68Ga-PSMA) and 0.980 ± 0.011 (68Ga-FAPI). The ROI analysis conducted on our generated dynamic PET sequences also revealed that our method can accurately predict temporal voxel intensity changes, maintaining overall visual consistency with the ground truth.ConclusionIn this work, we propose a bidirectional dynamic frame prediction network for total-body 68Ga-PSMA and 68Ga-FAPI PET imaging with a reduced scan duration. Visual and quantitative analyses demonstrated that our approach performed well when it was used to predict one-hour dynamic PET images. https://github.com/OPMZZZ/BDF-NET.

Fast inter-frame motion correction in contrast-free ultrasound quantitative microvasculature imaging using deep learning

Contrast-free ultrasound quantitative microvasculature imaging shows promise in several applications, including the assessment of benign and malignant lesions. However, motion represents one of the major challenges in imaging tumor microvessels in organs that are prone to physiological motions. This study aims at addressing potential microvessel image degradation in in vivo human thyroid due to its proximity to carotid artery. The pulsation of the carotid artery induces inter-frame motion that significantly degrades microvasculature images, resulting in diagnostic errors. The main objective of this study is to reduce inter-frame motion artifacts in high-frame-rate ultrasound imaging to achieve a more accurate visualization of tumor microvessel features. We propose a low-complex deep learning network comprising depth-wise separable convolutional layers and hybrid adaptive and squeeze-and-excite attention mechanisms to correct inter-frame motion in high-frame-rate images. Rigorous validation using phantom and in-vivo data with simulated inter-frame motion indicates average improvements of 35% in Pearson correlation coefficients (PCCs) between motion corrected and reference data with respect to that of motion corrupted data. Further, reconstruction of microvasculature images using motion-corrected frames demonstrates PCC improvement from 31 to 35%. Another thorough validation using in-vivo thyroid data with physiological inter-frame motion demonstrates average improvement of 20% in PCC and 40% in mean inter-frame correlation. Finally, comparison with the conventional image registration method indicates the suitability of proposed network for real-time inter-frame motion correction with 5000 times reduction in motion corrected frame prediction latency.

Sound Quality Prediction Method of Dual-Phase Hy-Vo Chain Transmission System Based on MFCC-CNN and Fuzzy Generation

redict the sound quality of dual-phase Hy-Vo chain transmission system noise using a small sample size. Noise acquisition tests are conducted under various working conditions, followed by subjective evaluations using the equal interval direct one-dimensional method. Objective evaluations are performed using the Mel-frequency cepstral coefficient (MFCC). To understand the impact of the MFCC order and the frame number on prediction accuracy, MFCC feature maps of different specifications are analyzed. The dataset is expanded threefold using fuzzy generation with an appropriate membership degree. The convolutional neural network (CNN) is developed, utilizing MFCC feature maps as inputs and evaluation scores as outputs. Results indicate a positive correlation between the frame number and prediction accuracy, whereas higher MFCC orders introduce redundancy, reducing accuracy. The proposed CNN method outperforms three traditional machine learning approaches, demonstrating superior accuracy and resistance to overfitting.

Rethinking prediction-based video anomaly detection from local–global normality perspective

Video anomaly detection (VAD) has been intensively studied for years because of its potential applications in intelligent video systems. Prediction-based VAD methods have gained a lot of attention in recent years due to their simplicity and effectiveness, which learn normality through a frame prediction tasks. However, we find that they often consider only local or global normality in the temporal dimension thus are difficult to generalize for various scenarios. Specifically, some of them focus on learning local spatiotemporal representations from consecutive frames to enhance the representation for normal events while the other methods are devoted to memorizing prototypical normal patterns of whole training videos to weaken the generalization for anomalies. In this paper, we rethink these two types of methods and find that the former methods are difficult to adapt to simple scenarios due to powerful representation allows these methods to represent some anomalies and causes miss detection while the latter struggle with complex scenarios due to the limitations for diverse normal patterns and causes false alarm. To verify our discoveries, we design a two-branch model, Local–Global Normality Network (LGN-Net), to simultaneously learn local and global normality. We verified the effect of local and global normality on the VAD model by ablation study and find that the model can be more adaptive to different scenarios when accounting for both normality. The code is available online: https://github.com/Myzhao1999/LGN-Net.

AONet: Attention network with optional activation for unsupervised video anomaly detection

AbstractAnomaly detection in video surveillance is crucial but challenging due to the rarity of irregular events and ambiguity of defining anomalies. We propose a method called AONet that utilizes a spatiotemporal module to extract spatiotemporal features efficiently, as well as a residual autoencoder equipped with an attention network for effective future frame prediction in video anomaly detection. AONet utilizes a novel activation function called OptAF that combines the strengths of the ReLU, leaky ReLU, and sigmoid functions. Furthermore, the proposed method employs a combination of robust loss functions to address various aspects of prediction errors and enhance training effectiveness. The performance of the proposed method is evaluated on three widely used benchmark datasets. The results indicate that the proposed method outperforms existing state‐of‐the‐art methods and demonstrates comparable performance, achieving area under the curve values of 97.0%, 86.9%, and 73.8% on the UCSD Ped2, CUHK Avenue, and ShanghaiTech Campus datasets, respectively. Additionally, the high speed of the proposed method enables its application to real‐time tasks.

FM‐YOLOv8:Lightweight gesture recognition algorithm

AbstractIn practical production applications, the efficiency and success rate of gesture recognition directly affect the user experience and work efficiency. However, the existing gesture recognition models have the problem of a large number of model parameters and high computational complexity, which makes them unable to meet the needs of end‐to‐end industrial deployment. To solve these problems, this article proposes a gesture recognition model based on YOLOv8. First, FasterNet is adopted as the backbone of YOLOv8, which significantlydecrease the number of parameters and made the model more lightweight. By reducing the number of parameters, the computational complexity of the model can be reduced while maintaining the performance of the model, and the operation efficiency of the model can be improved. Second, recombination convolution ScConv is introduced to replace common convolution operations to further improve the model's efficiency. Recombination convolution can reduce the computation and make up for the loss of precision to some extent. Finally, the MDPIoU loss function is used to optimize target location and prediction, to improve the accuracy of the model. The MDPIoU loss function can better deal with the problem of target boundary frame positioning and prediction so that the model can locate and predict gestures more accurately in gesture recognition tasks. Experiments on a data set containing 10 types of gestures show that the number of parameters and floating point calculations of the improved network model are reduced by 45% and 42.7%, respectively, while the accuracy is unchanged. The improved model can be deployed on edge terminals, providing efficient and accurate gesture recognition.

An unsupervised video anomaly detection method via Optical Flow decomposition and Spatio-Temporal feature learning

The purpose of this paper is to present an unsupervised video anomaly detection method using Optical Flow decomposition and Spatio-Temporal feature learning (OFST). This method employs a combination of optical flow reconstruction and video frame prediction to achieve satisfactory results. The proposed OFST framework is composed of two modules: the Multi-Granularity Memory-augmented Autoencoder with Optical Flow Decomposition (MG-MemAE-OFD) and a Two-Stream Network based on Spatio-Temporal feature learning (TSN-ST). The MG-MemAE-OFD module is composed of three functional blocks: optical flow decomposition, autoencoder, and multi-granularity memory networks. The optical flow decomposition block is used to extract the main motion information of objects in optical flow, and the granularity memory network is utilized to memorize normal patterns and improve the quality of the reconstructions. To predict video frames, we introduce a two-stream network based on spatiotemporal feature learning (TSN-ST), which adopts parallel standard Transformer blocks and a temporal block to learn spatiotemporal features from video frames and optical flows. The OFST combines these two modules so that the prediction error of abnormal samples is further increased due to the larger reconstruction error. In contrast, the normal samples obtain a lower reconstruction error and prediction error. Therefore, the anomaly detection capability of the method is greatly enhanced. Our proposed model was evaluated on public datasets. Specifically, in terms of the area under the curve (AUC), our model achieved an accuracy of 85.74% on the Ped1 dataset, 99.62% on the Ped2 dataset, 93.89% on the Avenue dataset, and 76.0% on the ShanghaiTech Dataset. Our experimental results show an average improvement of 1.2% compared to the current state-of-the-art.

Comparative genomic analysis of a Colombian strain of Leptospira santarosai serogroup Autumnalis serovar Alice and inference of its virulence factors.

The study aimed to characterize the genome of a Colombian strain of Leptospira santarosai to infer bacterial virulence factors. Under the approach of a quantitative research, an isolate of Colombian origin of L. santarosai was sequenced using new generation 454 GS FLX Titanium sequencers. Subsequently, bioinformatics programs were used for the physical description of the genome (number of genes, size), open reading frame prediction, prediction of proteins and their orthologs in other pathogenic species, of intermediate pathogenicity and non-pathogenic, cellular localization of proteins. The assembly of the spirochete genome was achieved Leptospira santarosai serogroup Autumnalis serovar Aliceand the description of the genetic, structural and functional characteristics of its genes. It is concluded that the core- genome of the isolate is composed of 1747 proteins, which are common to all L. santarosai strains available in GenBank. It was determined that it has a total of 4,138 proteins, 141 of which are unique to its genome. The possible role of the virulence factors found in the Colombian isolate was identified and described. The study contributes to the understanding of the pathophysiological mechanisms induced by Leptospira .

Intelligent Detection of Muskmelon Ripeness in Greenhouse Environment Based on YOLO-RFEW

Accurate detection of muskmelon fruit ripeness is crucial to ensure fruit quality, optimize picking time, and enhance economic benefits. This study proposes an improved lightweight YOLO-RFEW model based on YOLOv8n, aiming to address the challenges of low efficiency in muskmelon fruit ripeness detection and the complexity of deploying a target detection model to a muskmelon picking robot. Firstly, the RFAConv replaces the Conv in the backbone part of YOLOv8n, allowing the network to focus more on regions with significant contributions in feature extraction. Secondly, the feature extraction and fusion capability are enhanced by improving the C2f module into a C2f-FE module based on FasterNet and an Efficient Multi-Scale attention (EMA) mechanism within the lightweight model. Finally, Weighted Intersection over Union (WIoU) is optimized as the loss function to improve target frame prediction capability and enhance target detection accuracy. The experimental results demonstrate that the YOLO-RFEW model achieves high accuracy, with precision, recall, F1 score, and mean Average Precision (mAP) values of 93.16%, 83.22%, 87.91%, and 90.82%, respectively. Moreover, it maintains a lightweight design and high efficiency with a model size of 4.75 MB and an inference time of 1.5 ms. Additionally, in the two types of maturity tests (M-u and M-r), APs of 87.70% and 93.94% are obtained, respectively, by the YOLO-RFEW model. Compared to YOLOv8n, significant improvements in detection accuracy have been achieved while reducing both model size and computational complexity using the proposed approach for muskmelon picking robots’ real-time detection requirements. Furthermore, when compared to lightweight models such as YOLOv3-Tiny, YOLOv4-Tiny, YOLOv5s, YOLOv7-Tiny, YOLOv8s, and YOLOv8n, the YOLO-RFEW model demonstrates superior performance with only 28.55%, 22.42%, 24.50%, 40.56%, 22.12%, and 79.83% of their respective model sizes, respectively, while achieving the highest F1 score and mAP values among these seven models. The feasibility and effectiveness of our improved scheme are verified through comparisons between thermograms generated by YOLOv8n and YOLO-RFEW as well as detection images. In summary, the YOLO-RFEW model not only improves the accuracy rate of muskmelon ripeness detection but also successfully realizes the lightweight and efficient performance, which has important theoretical support and application value in the field of muskmelon picking robot development.

Self-supervised dynamic and static feature representation learning method for flotation monitoring

Froth flotation is a widely used beneficiation method in mineral processing. Accurate grade monitoring is crucial for efficient minerals separation. However, despite recent developments highlighting the potential of deep learning in flotation monitoring, these methods face limitations in application due to the lack of reliable feature extraction and the scarcity of large datasets related to target task. To address these issues, we propose a self-supervised dynamic and static feature collaborative representation learning method. It extracts the spatiotemporal information from froth videos based on a two-stream convolutional architecture and is trained on a video frame prediction task without labeled data until both appearance and motion constraints are satisfied. Experiments on industrial zinc flotation data demonstrate that the learned representations transfer well to downstream grade monitoring tasks. This approach not only solves the label shortage problem when training large-scale deep learning models but also outperforms the state-of-the-art methods in flotation monitoring.

Video Frame Prediction from a Single Image and Events

Recently, the task of Video Frame Prediction (VFP), which predicts future video frames from previous ones through extrapolation, has made remarkable progress. However, the performance of existing VFP methods is still far from satisfactory due to the fixed framerate video used: 1) they have difficulties in handling complex dynamic scenes; 2) they cannot predict future frames with flexible prediction time intervals. The event cameras can record the intensity changes asynchronously with a very high temporal resolution, which provides rich dynamic information about the observed scenes. In this paper, we propose to predict video frames from a single image and the following events, which can not only handle complex dynamic scenes but also predict future frames with flexible prediction time intervals. First, we introduce a symmetrical cross-modal attention augmentation module to enhance the complementary information between images and events. Second, we propose to jointly achieve optical flow estimation and frame generation by combining the motion information of events and the semantic information of the image, then inpainting the holes produced by forward warping to obtain an ideal prediction frame. Based on these, we propose a lightweight pyramidal coarse-to-fine model that can predict a 720P frame within 25 ms. Extensive experiments show that our proposed model significantly outperforms the state-of-the-art frame-based and event-based VFP methods and has the fastest runtime. Code is available at https://npucvr.github.io/VFPSIE/.

A lightweight multi-granularity asymmetric motion mode video frame prediction algorithm

A lightweight multi-granularity asymmetric motion mode video frame prediction algorithm

Prediction of 4D stress field evolution around additive manufacturing-induced porosity through progressive deep-learning frameworks

This study investigates the application of machine learning models to predict time-evolving stress fields in complex three-dimensional structures trained with full-scale finite element simulation data. Two novel architectures, the multi-decoder CNN (MUDE-CNN) and the multiple encoder–decoder model with transfer learning (MTED-TL), were introduced to address the challenge of predicting the progressive and spatial evolutional of stress distributions around defects. The MUDE-CNN leveraged a shared encoder for simultaneous feature extraction and employed multiple decoders for distinct time frame predictions, while MTED-TL progressively transferred knowledge from one encoder–decoder block to another, thereby enhancing prediction accuracy through transfer learning. These models were evaluated to assess their accuracy, with a particular focus on predicting temporal stress fields around an additive manufacturing (AM)-induced isolated pore, as understanding such defects is crucial for assessing mechanical properties and structural integrity in materials and components fabricated via AM. The temporal model evaluation demonstrated MTED-TL’s consistent superiority over MUDE-CNN, owing to transfer learning’s advantageous initialization of weights and smooth loss curves. Furthermore, an autoregressive training framework was introduced to improve temporal predictions, consistently outperforming both MUDE-CNN and MTED-TL. By accurately predicting temporal stress fields around AM-induced defects, these models can enable real-time monitoring and proactive defect mitigation during the fabrication process. This capability ensures enhanced component quality and enhances the overall reliability of additively manufactured parts.

GSSTU: Generative Spatial Self-Attention Transformer Unit for Enhanced Video Prediction.

Future frame prediction is a challenging task in computer vision with practical applications in areas such as video generation, autonomous driving, and robotics. Traditional recurrent neural networks have limited effectiveness in capturing long-range dependencies between frames, and combining convolutional neural networks (CNNs) with recurrent networks has limitations in modeling complex dependencies. Generative adversarial networks have shown promising results, but they are computationally expensive and suffer from instability during training. In this article, we propose a novel approach for future frame prediction that combines the encoding capabilities of 3-D CNNs with the sequence modeling capabilities of Transformers. We also propose a spatial self-attention mechanism and a novel neighborhood pixel intensity loss to preserve structural information and local intensity, respectively. Our approach outperforms existing methods in terms of structural similarity (SSIM), peak signal-to-noise ratio (PSNR), and learned perceptual image patch similarity (LPIPS) scores on five public datasets. More precisely, our model exhibited an average improvement of 4.64%, 18.5%, and 42% concerning SSIM, PSNR, and LPIPS for the second most proficient method correspondingly, across all datasets. The results demonstrate the effectiveness of our proposed method in generating high-quality predictions of future frames.

BGaitR-Net: An effective neural model for occlusion reconstruction in gait sequences by exploiting the key pose information

Gait recognition in the presence of occlusion is a challenging problem and the solutions proposed to date either lack robustness or depend on several unrealistic constraints. In this work, we propose a Deep Learning framework to detect and reconstruct the occluded frames in a gait sequence. Initially, occlusion detection is done using a VGG-16 network and for each frame the corresponding pose information is represented as a one-hot encoded vector. This vector is next fused with the corresponding spatial information using a Conditional Variational Autoencoder (CVAE) to obtain an effective embedding. Following this, a Bi-directional Long Short Term Memory (Bi-LSTM) is used to predict the occluded frames using the encoded vector sequence. A decoder next transforms these predicted frames back to the image space. Our proposed reconstruction model termed the Bidirectional Gait Reconstruction Network (BGaitR-Net) is formed by stacking the CVAE, Bi-LSTM, and the decoder. The CASIA-B and OU-ISIR LP datasets are used to prepare extensive gallery sets to train each of the above sub-networks and testing is done using synthetically occluded sequences from the CASIA-B data and real-occluded sequences from the TUM-IITKGP data. A thorough evaluation of our work through Dice Score and GEINet-based recognition accuracy for varying degrees of occlusion highlight the effectiveness of our model in generating frames consistent with the temporal gait pattern. Comparative study with other existing gait recognition techniques (with or without occlusion handling mechanism) and with recent Deep Learning-based video frame prediction methods emphasizes the superiority of BGaitR-Net over the others.

VRT: A Video Restoration Transformer.

Video restoration aims to restore high-quality frames from low-quality frames. Different from single image restoration, video restoration generally requires to utilize temporal information from multiple adjacent but usually misaligned video frames. Existing deep methods generally tackle with this by exploiting a sliding window strategy or a recurrent architecture, which are restricted by frame-by-frame restoration. In this paper, we propose a Video Restoration Transformer (VRT) with parallel frame prediction ability. More specifically, VRT is composed of multiple scales, each of which consists of two kinds of modules: temporal reciprocal self attention (TRSA) and parallel warping. TRSA divides the video into small clips, on which reciprocal attention is applied for joint motion estimation, feature alignment and feature fusion, while self attention is used for feature extraction. To enable cross-clip interactions, the video sequence is shifted for every other layer. Besides, parallel warping is used to further fuse information from neighboring frames by parallel feature warping. Experimental results on five tasks, including video super-resolution, video deblurring, video denoising, video frame interpolation and space-time video super-resolution, demonstrate that VRT outperforms the state-of-the-art methods by large margins (up to 2.16dB) on fourteen benchmark datasets. The codes are available at https://github.com/JingyunLiang/VRT.

Context Recovery and Knowledge Retrieval: A Novel Two-Stream Framework for Video Anomaly Detection.

Video anomaly detection aims to find the events in a video that do not conform to the expected behavior. The prevalent methods mainly detect anomalies by snippet reconstruction or future frame prediction error. However, the error is highly dependent on the local context of the current snippet and lacks the understanding of normality. To address this issue, we propose to detect anomalous events not only by the local context, but also according to the consistency between the testing event and the knowledge about normality from the training data. Concretely, we propose a novel two-stream framework based on context recovery and knowledge retrieval, where the two streams can complement each other. For the context recovery stream, we propose a spatiotemporal U-Net which can fully utilize the motion information to predict the future frame. Furthermore, we propose a maximum local error mechanism to alleviate the problem of large recovery errors caused by complex foreground objects. For the knowledge retrieval stream, we propose an improved learnable locality-sensitive hashing, which optimizes hash functions via a Siamese network and a mutual difference loss. The knowledge about normality is encoded and stored in hash tables, and the distance between the testing event and the knowledge representation is used to reveal the probability of anomaly. Finally, we fuse the anomaly scores from the two streams to detect anomalies. Extensive experiments demonstrate the effectiveness and complementarity of the two streams, whereby the proposed two-stream framework achieves state-of-the-art performance on ShanghaiTech, Avenue and Corridor datasets among the methods without object detection. Even if compared with the methods using object detection, our method reaches competitive or better performance on the ShanghaiTech, Avenue, and Ped2 datasets.

Prediction of alternative pre-mRNA splicing outcomes

To understand the biological impact of alternative pre-mRNA splicing, it is vital to know which exons are involved, what protein domains they encode, and how the translated isoforms differ. Therefore, we developed a computational pipeline (RiboSplitter) focused on functional effect prediction. It builds on event-based alternative splicing detection with additional filtering steps leading to more efficient statistical testing, and with detection of isoform-specific protein changes. A key methodological advance is reading frame prediction by translating exonic DNA in all possible frames, then finding a single open reading frame, or a single frame with matches to known proteins of the gene. This allowed unambiguous translation in 93.9% of alternative splicing events when tested on RNA-sequencing data of B cells from Sjögren’s syndrome patients. RiboSplitter does not depend on reference annotations and translates events even when one or both isoform(s) are novel (unannotated). RiboSplitter’s visualizations illustrate each event with translation outcomes, show event location within the gene, and align exons to protein domains.

Pyramidal temporal frame prediction for efficient anomalous event detection in smart surveillance systems

Video anomaly detection plays a pivotal role within contemporary intelligent surveillance systems, holding significant utility in the identification and mitigation of anomalies within smart environments. The task of anomaly detection is made difficult by the presence of complex environments and varying perspectives, even in diverse situations. Furthermore, the lack of labeled data in this field presents additional challenges. In this article, we present a robust pyramidal frame prediction architecture coupled with an efficient anomaly detection mechanism. The foundation of the frame prediction module rests upon a combination of localized predictors, incorporating bidirectional sampling techniques and a proficient discriminator-sharing mechanism. For the purpose of anomaly detection, an innovative loss function is employed, tailored to accommodate multi-instance learning scenarios. Departing from the conventional treatment of anomalies as a binary classification problem, we adopt a regression-oriented approach, thereby enabling a nuanced understanding of disruptive occurrences at a granular level, whilst facilitating an assessment of the severity associated with anomalous events. The amalgamation of these dual modules culminates in a distinctive and robust framework adept at comprehending anomalies within intricate scenarios. Empirical assessments conducted across benchmark datasets within this domain serve to underscore the efficacy of the proposed architectural paradigm across a spectrum of environments.

Convolutional neural network-based classification and monitoring models for lung cancer detection: 3D perspective approach

Recent developments in technology and research have offered a wide variety of new techniques for image and data analysis within the medical field. Medical research helps doctors and researchers acquire not only knowledge about health and new diseases, but also techniques of prevention and treatment. In particular, radiomic analysis is mainly used to extract quantitative data from medical images and to build a model strong enough to diagnose focal diseases. However, finding a model capable to fit all patient situations is not an easy task. In this paper frame prediction models and classification models are reported in order to predict the evolution of a given data series and determine whether an anomaly exists or not. This article also shows how to build and make use of a convolutional neural network-based architecture aiming to accomplish prediction task for medical images, not only using common computer tomography scans, but also 3D volumes.