Objects In Images Research Articles

GPU-Based Parallel Processing Techniques for Enhanced Brain Magnetic Resonance Imaging Analysis: A Review of Recent Advances.

The approach of using more than one processor to compute in order to overcome the complexity of different medical imaging methods that make up an overall job is known as GPU (graphic processing unit)-based parallel processing. It is extremely important for several medical imaging techniques such as image classification, object detection, image segmentation, registration, and content-based image retrieval, since the GPU-based parallel processing approach allows for time-efficient computation by a software, allowing multiple computations to be completed at once. On the other hand, a non-invasive imaging technology that may depict the shape of an anatomy and the biological advancements of the human body is known as magnetic resonance imaging (MRI). Implementing GPU-based parallel processing approaches in brain MRI analysis with medical imaging techniques might be helpful in achieving immediate and timely image capture. Therefore, this extended review (the extension of the IWBBIO2023 conference paper) offers a thorough overview of the literature with an emphasis on the expanding use of GPU-based parallel processing methods for the medical analysis of brain MRIs with the imaging techniques mentioned above, given the need for quicker computation to acquire early and real-time feedback in medicine. Between 2019 and 2023, we examined the articles in the literature matrix that include the tasks, techniques, MRI sequences, and processing results. As a result, the methods discussed in this review demonstrate the advancements achieved until now in minimizing computing runtime as well as the obstacles and problems still to be solved in the future.

An Inquiry-Oriented Approach to Determinants

In introductory linear algebra classrooms, determinants are often taught in a formulaic way that obscures their rich connections to graphical interpretations of linear transformations. As an alternative, in this paper, we introduce an innovative task sequence exploring the determinant conceptualized as a measure of the distortion of space. The task sequence is part of the Inquiry-Oriented Linear Algebra (IOLA) curricular materials, which build from experientially real tasks that allow for active student engagement in the guided reinvention of key mathematical ideas through student and instructor inquiry. The task sequence begins with students developing a conceptualization of the 2 × 2 matrix determinant as a ratio between the (signed) area of an image object and the area of its pre-image object transformed by the associated linear transformation. They then use this conceptualization to construct for themselves the 2 × 2 determinant formula and the determinant of a matrix inverse. Finally, students explore 2D and 3D GeoGebra applets to reinvent and explain core theorems related to the determinant involving linear dependence and switching/scaling rows and columns. Student work examples are provided throughout the paper.

Study of methods for searching and localizing objects in images from aircraft using convolutional neural networks

The use of unmanned and manned aerial vehicles for remote object localization and classification is very common. These methods are used in various systems, ranging from territory surveys to law enforcement. Methods of object localization and classification using neural networks require a detailed study and research of the quality of their work on data that has certain specifics, such as vehicle detection. The use of neural networks to detect certain types of objects using images obtained from aircraft can also help in the study of hard-to-reach locations. Therefore, the main subject of this paper is the localization and classification of objects in images obtained using digital cameras mounted on aircraft. The main focus is on determining the accuracy of object localization and detection using selected types of neural networks, which are the most important indicators of neural network efficiency. The speed of a neural network is also an equally important characteristic as it directly affects its ability to be used in tasks that require fast object localization, such as video surveillance or automated car control systems. The main goal of this study is to study the accuracy of object localization and classification in images obtained with the help of cameras mounted on aircraft, as well as to study the speed of neural networks and determine the effectiveness of their application in real-world conditions. The objectives of this study are to train YOLO v5, SSD, and Faster RCNNs on the VisDrone dataset and to further study them on the vehicle localization dataset. The main goal of this work is to obtain statistics on the performance of neural networks trained on the VisDrone dataset. On the basis of the obtained statistics, conclusions are drawn about the effectiveness of the considered neural networks. The conclusions are drawn by considering the speed of the model, localization (IoU), and classification (Precision, Recall) metrics. Possible directions for further development of the topic under study are presented as conclusions.

CoBjeason: Reasoning Covered Object in Image by Multi-Agent Collaboration Based on Informed Knowledge Graph

Object detection is a widely studied problem in existing works. However, in this paper, we turn to a more challenging problem of “ Covered Object Reasoning ”, aimed at reasoning the category label of target object in the given image particularly when it has been totally covered (or invisible ). To resolve this problem, we propose CoBjeason to seize the opportunity when visual reasoning meets the knowledge graph, where “ empirical cognition ” on common visual contexts have been incorporated as knowledge graph to conduct reinforced multi-hop reasoning via two collaborative agents. Such two agents, for one thing, stand at the covered object (or unknown entity ) to observe the surrounding visual cues in the given image and gradually select entities and relations from the global gallery-level knowledge graph which contains entity-pairs frequently occurring across the entire image-collection, so as to infer the main structure of image-level knowledge graph forward expanded from the unknown entity . In turn, for another, based on the reasoned image-level knowledge graph, the semantic context among entities will be aggregated backward into unknown entity to select an appropriate entity from the global gallery-level knowledge graph as the reasoning result. Moreover, such two agents will collaborate with each other, securing that the above Forward & Backward Reasoning will step towards the same destination of the higher performance on covered object reasoning. To our best knowledge, this is the first work on Covered Object Reasoning with Knowledge Graphs and reinforced Multi-Agent collaboration. Particularly, our study on Covered Object Reasoning and the proposed model CoBjeason could offer novel insights into more basic Computer Vision (CV) tasks, such as Semantic Segmentation with better understanding on the current scene when some objects are blurred or covered, Visual Question Answering with enhancement on the inference in more complicated visual context when some objects are covered or invisible, and Image Caption Generation with the augmentation on the richness of visual context for images containing partially visible objects. The improvement on the above basic CV tasks can further refine more complicated ones involved with nuanced visual interpretation like Autonomous Driving, where the recognition and reasoning on partially visible or covered object are critical. According to the experimental results, our proposed CoBjeason can achieve the best overall ranking performance on covered object reasoning compared with other models, meanwhile enjoying the advantage of lower “ exploration cost ”, with the insensitivity against the long-tail covered objects and the acceptable time complexity.

Toward Improving the Generation Quality of Autoregressive Slot VAEs.

Unconditional scene inference and generation are challenging to learn jointly with a single compositional model. Despite encouraging progress on models that extract object-centric representations ("slots") from images, unconditional generation of scenes from slots has received less attention. This is primarily because learning the multiobject relations necessary to imagine coherent scenes is difficult. We hypothesize that most existing slot-based models have a limited ability to learn object correlations. We propose two improvements that strengthen object correlation learning. The first is to condition the slots on a global, scene-level variable that captures higher-order correlations between slots. Second, we address the fundamental lack of a canonical order for objects in images by proposing to learn a consistent order to use for the autoregressive generation of scene objects. Specifically, we train an autoregressive slot prior to sequentially generate scene objects following a learned order. Ordered slot inference entails first estimating a randomly ordered set of slots using existing approaches for extracting slots from images, then aligning those slots to ordered slots generated autoregressively with the slot prior. Our experiments across three multiobject environments demonstrate clear gains in unconditional scene generation quality. Detailed ablation studies are also provided that validate the two proposed improvements.

OrientedDiffDet: Diffusion Model for Oriented Object Detection in Aerial Images

Object detection is a fundamental task of remote-sensing image processing. Most existing object detection detectors handle regression and classification tasks through learning from a fixed set of learnable anchors or queries. To simplify object candidates, we propose a denoising diffusion process for remote-sensing image object detection, which directly detects objects from a set of random boxes. During the training phase, the horizontal detection boxes are transformed into oriented detection boxes firstly. Then, the model learns to reverse this transformation process by diffusing from the ground truth-oriented box to a random distribution. During the inference phase, the model incrementally refines a set of randomly generated boxes to produce the final output result. Remarkable results have been achieved using our proposed method. For instance, on commonly used object detection datasets such as DOTA, our approach achieves a mean average precision (mAP) of 76.59%. Similarly, on the HRSC2016 dataset, our method achieves a 72.4% mAP.

Graph-based social relation inference with multi-level conditional attention

Social relation inference intrinsically requires high-level semantic understanding. In order to accurately infer relations of persons in images, one needs not only to understand scenes and objects in images, but also to adaptively attend to important clues. Unlike prior works of classifying social relations using attention on detected objects, we propose a MUlti-level Conditional Attention (MUCA) mechanism for social relation inference, which attends to scenes, objects and human interactions based on each person pair. Then, we develop a transformer-style network to achieve the MUCA mechanism. The novel network named as Graph-based Relation Inference Transformer (i.e., GRIT) consists of two modules, i.e., a Conditional Query Module (CQM) and a Relation Attention Module (RAM). Specifically, we design a graph-based CQM to generate informative relation queries for all person pairs, which fuses local features and global context for each person pair. Moreover, we fully take advantage of transformer-style networks in RAM for multi-level attentions in classifying social relations. To our best knowledge, GRIT is the first for inferring social relations with multi-level conditional attention. GRIT is end-to-end trainable and significantly outperforms existing methods on two benchmark datasets, e.g., with performance improvement of 7.8% on PIPA and 9.6% on PISC.

Complex master-slave enhanced optical coherence microscopy

We present an instrument designed to facilitate localization and high-resolution, optical coherence microscopy (OCM) imaging of small biological samples immersed in a medium several orders of magnitude greater in volume. A modified turret-equipped microscope stand was inserted into the sample arm of a spectral domain optical coherence microscopy (SD-OCM) system. The instrument enabled swift change of imaging objectives through the incorporation of complex master-slave interferometry (CMSI), providing tolerance to dispersion for any objective through the acquisition of a few (≥2) calibration spectra. We demonstrate the instrument’s ability to localize and image samples by providing examples of its application to optical phantoms and to a porcine oocyte immersed in a biological culture medium.

Wavelet-based Auto-Encoder for simultaneous haze and rain removal from images

Noise introduced due to weather can reduce the efficiency of computer vision applications as the visibility of the objects in images is greatly affected. Haze and rain are the most common weather conditions seen in nature. However, most of the algorithms found in the literature apply rain and haze removal approaches separately. To this end, in this paper, we propose a novel Wavelet-based deep Auto-encoder, called WAE, for simultaneously removing the haze and rain effects from images. The proposed network uses wavelet transformation and inverse wavelet transformation as an alternative to down-sampling and up-sampling operations, respectively, in order to add sparsity to the network. By training the model on both spatial and frequency domains, it learns non-stationary features that are found to be useful to remove haze and rain effects from images. The proposed model is tested on several rain and haze-affected image datasets, and it performs well in terms of standard evaluation metrics like structural similarity index measure and peak signal-to-noise ratio. The code can be found at : https://github.com/asfakali/WAE.git.

HFENet: Hybrid feature encoder network for detecting salient objects in RGB-thermal images

Deep convolutional neural networks (CNNs) have gained prominence in computer vision applications, including RGB salient object detection (SOD), owing to the advancements in deep learning. Nevertheless, the majority of deep CNNs employ either VGGNet or ResNet as their backbone architecture for extracting image information. This approach may lead to the following problems. 1) Variations between imaging modalities during feature extraction across layers. Cross-modal features across layers are often fused in a single step, resulting in inadequate cross-modal feature extraction. 2) Feature long-range dependence problem in multilayer feature decoding. 3) Image boundary blurring. To address these issues, we initially leverage the advantages offered by the VGGNet and ResNet architectures. Additionally, we present a novel hybrid VGG–ResNet feature encoder for RGB-T SOD. Specifically, we introduce a geometry information aggregation module that effectively combines and enhances the VGGNet spatial features of the RGB-T modalities from the bottom to the top. Moreover, we propose a innovative global saliency perception module that progressively refines the ResNet semantic features from the top to the bottom by integrating both local and global information. Furthermore, we introduce a Pearson-gated module to tackle the challenge of long-range dependence between features. This module utilizes gating to merge features by calculating the Pearson correlation coefficients of the fused features at multiple levels. Lastly, we devise an edge-aware module to precisely learn the contours of salient objects, thereby enhancing the clarity of the object boundaries. Extensive experiments conducted on three RGB-T SOD benchmarks demonstrate that our proposed network surpasses the performance of state-of-the-art methods for SOD.

Influence of film thickness on structural, optical, and electrical properties of sputtered nickel oxide thin films.

Utilizing radio frequency magnetron sputtering, we successfully fabricated nickel oxide thin films with different thickness (from 80 to 270 nm), and conducted an in-depth examination of their structural, morphological, optical, and electrical properties. The crystal structure and surface roughness were determined using x-ray diffraction (XRD) and atomic force microscopy (AFM), respectively. The XRD analyses showed that the films were composed of cubic nickel oxide, exhibiting a notable orientation along the (200) direction. This crystal texture partially increased when the film thickness reached 270 nm. In addition, a direct correlation between film thickness and crystallite size was observed, with the latter increasing as the former did. AFM analysis provided insights into the surface morphology, revealing metrics like the bearing area, 3D surfaces intersections, and statistical properties of surface height. These insights underscore the relationship between film thickness and surface properties, which in turn influence the overall electrical, and prominently, optical properties of the films. Employing transmittance UV-visible spectroscopy, we characterized the optical behavior of these films, noting a proportional increase in refractive index with film thickness. Additionally, resistivity was observed to increase concomitantly with film thickness. In conclusion, the deposition process's film thickness acts as a pivotal parameter for fine-tuning the structural, morphological, and optical properties of nickel oxide thin films. This knowledge paves the way for optimizing nickel oxide-based devices across various applications. RESEARCH HIGHLIGHTS: We synthesized and characterized of p-type semiconducting NiO thin films sputtered on substrates by using RF magnetron sputtering with different thickness. Advanced crystalline structures and fractal features extracted from XRD and AFM analysis. The 2D and 3Dsurface analysis of the samples indicates a complex structure with an imperfect self-similarity that suggests a multifractal structure. We represented graphically the relative representation of higher geometric objects in the AFM image. We attributed the optical and electrical properties of the samples to the crystallite size, and the concurrent reduction in oxygen vacancies and crystalline defects within the films.

An algorithm for detecting dense small objects in aerial photography based on coordinate position attention module

AbstractTo address the challenges of detecting a large number of objects and a high proportion of small objects in aerial drone imagery, an aerial dense small object detection algorithm called coordinate position attention module you only look once (CPAM‐YOLO) is proposed based on the coordinate position attention module (CPAM). In the backbone network of CPAM‐YOLO, a CPAM is proposed and embedded that decomposes channel attention into two 1D feature encoding processes, and selectively combines the features of each position through the weighted sum of all position features. Finally, features are aggregated along two spatial directions, increasing the effective information utilization of input feature positions and channels. The backbone network, feature enhancement network, and detection heads have been optimized to improve detection accuracy while ensuring a lightweight detection network. Using lightweight backbone networks to significantly reduce the number of parameters while using high‐resolution feature enhancement networks to retain more semantic and detailed features. The algorithm's performance was evaluated using the publicly available VisDrone2019 dataset. Compared to the baseline network YOLOv5l, CPAM‐YOLO achieved a 4.5% improvement in mAP0.5 and a 3.2% improvement in mAP0.95. These experimental results demonstrate the strong practicality of the CPAM‐YOLO object detection network for detecting dense small objects in aerial image.

Vision-Based Multiscale Construction Object Detection under Limited Supervision

Contemporary multiscale construction object detection algorithms rely predominantly on fully-supervised deep learning, requiring arduous and time-consuming labeling process. This paper presents a novel semisupervised multiscale construction objects detection (SS-MCOD) by harnessing nearly infinite unlabeled images along with limited labels, achieving more accurate and robust detection results. SS-MCOD uses a deformable convolutional network (DCN)-based teacher-student joint learning framework. DCN uses deformable advantages to extract and fuse multiscale construction object features. The teacher module generates pseudolabels for construction objects in unlabeled images, while the student module learns the location and classification of construction objects in both labeled images and unlabeled images with pseudolabels. Experimental validation using commonly used construction datasets demonstrates the accuracy and generalization performance of SS-MCOD. This research can provide insights for other detection tasks with limited labels in the construction domain.

CLASSIFICATION AND OBJECT DETECTION FOR ARCHITECTURAL PATHOLOGY: PRACTICAL TESTS WITH TRAINING SET

Abstract. Image classification and object detection techniques have been widely discussed and developed in recent years; they are the basis of various prosperous applications, for example, real-time mapping. Promising as it is, the practical test in the cultural heritage field encountered multiple problems. In this paper, the authors attempt to share the research experimentations and the empirical knowledge focusing on the classification and detection of architectural pathology. The tests are built on elaborated training sets annotated with analysed and in-advance defined categories. The trained models were examined from the perspective of evaluation sets, model explanation and unseen datasets. The outcomes indicated the mistakes and confusions behind things and stuff in the object detection efforts, to which cultural heritage and architectural field are closely related. The model also reveals specific visual patterns for recognition from thousands of instances in the training set. By digging into different aspects of model performance, the potential and limitations of these techniques in practical applications can be better understood.

In defense of local descriptor-based few-shot object detection.

State-of-the-art image object detection computational models require an intensive parameter fine-tuning stage (using deep convolution network, etc). with tens or hundreds of training examples. In contrast, human intelligence can robustly learn a new concept from just a few instances (i.e., few-shot detection). The distinctive perception mechanisms between these two families of systems enlighten us to revisit classical handcraft local descriptors (e.g., SIFT, HOG, etc.) as well as non-parametric visual models, which innately require no learning/training phase. Herein, we claim that the inferior performance of these local descriptors mainly results from a lack of global structure sense. To address this issue, we refine local descriptors with spatial contextual attention of neighbor affinities and then embed the local descriptors into discriminative subspace guided by Kernel-InfoNCE loss. Differing from conventional quantization of local descriptors in high-dimensional feature space or isometric dimension reduction, we actually seek a brain-inspired few-shot feature representation for the object manifold, which combines data-independent primitive representation and semantic context learning and thus helps with generalization. The obtained embeddings as pattern vectors/tensors permit us an accelerated but non-parametric visual similarity computation as the decision rule for final detection. Our approach to few-shot object detection is nearly learning-free, and experiments on remote sensing imageries (approximate 2-D affine space) confirm the efficacy of our model.

Deep learning contour-based method for semi-automatic annotation of manufactured objects in electron microscopy images

Deep learning contour-based method for semi-automatic annotation of manufactured objects in electron microscopy images

Overfitting of CNN model in cifar-10: Problem and solutions

CNN, proposed by Yann LeCun in the 1980s, has gained high attention and extensive research from both the academia and the industry. It has proved to be useful in a wide variety of fields, including image recognition, which aims to enable the computer to identify different objects in digital images. Despite its usefulness, problems like overfitting occur during the training process of a CNN model, which seriously harm the effectiveness of the model. Firstly, an initial CNN model is built to accomplish image recognition based on data from cifar-10. Secondly, after the presence of overfitting during the training and validation of the initial model, 4 methods, including shallower model, L2 regularization, dropout, data augmentation, are proposed to see how they handle overfitting respectively, and comparisons are made between different methods. Thirdly, the last three methods are combined to see how they handle overfitting together. Finally, conclusion and possible future work are presented. As it turns out, L2 regularization, dropout and data augmentation all reduce overfitting with some slight differences, but shallower model and the combined method cause underfitting rather than overfitting.

Few-shot concealed object detection in sub-THz security images using improved pseudo-annotations

In this research, we explore the few-shot object detection application for identifying concealed objects in sub-terahertz security images, using fine-tuning based frameworks. To adapt these machine learning frameworks for the (sub-)terahertz domain, we propose an innovative pseudo-annotation method to augment the object detector by sourcing high-quality training samples from unlabeled images. This approach employs multiple one-class detectors coupled with a fine-grained classifier, trained on supporting thermal-infrared images, to prevent overfitting. Consequently, our approach enhances the model’s ability to detect challenging objects (e.g., 3D-printed guns and ceramic knives) when few-shot training examples are available, especially in the real-world scenario where images of concealed dangerous items are scarce.

A serverless computing architecture for Martian aurora detection with the Emirates Mars Mission

Remote sensing technologies are experiencing a surge in adoption for monitoring Earth’s environment, demanding more efficient and scalable methods for image analysis. This paper presents a new approach for the Emirates Mars Mission (Hope probe); A serverless computing architecture designed to analyze images of Martian auroras, a key aspect in understanding the Martian atmosphere. Harnessing the power of OpenCV and machine learning algorithms, our architecture offers image classification, object detection, and segmentation in a swift and cost-effective manner. Leveraging the scalability and elasticity of cloud computing, this innovative system is capable of managing high volumes of image data, adapting to fluctuating workloads. This technology, applied to the study of Martian auroras within the HOPE Mission, not only solves a complex problem but also paves the way for future applications in the broad field of remote sensing.

Detection Probability and Bias in Machine-Learning-Based Unoccupied Aerial System Non-Breeding Waterfowl Surveys

Unoccupied aerial systems (UASs) may provide cheaper, safer, and more accurate and precise alternatives to traditional waterfowl survey techniques while also reducing disturbance to waterfowl. We evaluated availability and perception bias based on machine-learning-based non-breeding waterfowl count estimates derived from aerial imagery collected using a DJI Mavic Pro 2 on Missouri Department of Conservation intensively managed wetland Conservation Areas. UASs imagery was collected using a proprietary software for automated flight path planning in a back-and-forth transect flight pattern at ground sampling distances (GSDs) of 0.38–2.29 cm/pixel (15–90 m in altitude). The waterfowl in the images were labeled by trained labelers and simultaneously analyzed using a modified YOLONAS image object detection algorithm developed to detect waterfowl in aerial images. We used three generalized linear mixed models with Bernoulli distributions to model availability and perception (correct detection and false-positive) detection probabilities. The variation in waterfowl availability was best explained by the interaction of vegetation cover type, sky condition, and GSD, with more complex and taller vegetation cover types reducing availability at lower GSDs. The probability of the algorithm correctly detecting available birds showed no pattern in terms of vegetation cover type, GSD, or sky condition; however, the probability of the algorithm generating incorrect false-positive detections was best explained by vegetation cover types with features similar in size and shape to the birds. We used a modified Horvitz–Thompson estimator to account for availability and perception biases (including false positives), resulting in a corrected count error of 5.59 percent. Our results indicate that vegetation cover type, sky condition, and GSD influence the availability and detection of waterfowl in UAS surveys; however, using well-trained algorithms may produce accurate counts per image under a variety of conditions.