Problem In Computer Vision Research Articles

AttMOT: Improving Multiple-Object Tracking by Introducing Auxiliary Pedestrian Attributes.

Multiobject tracking (MOT) is a fundamental problem in computer vision with numerous applications, such as intelligent surveillance and automated driving. Despite the significant progress made in MOT, pedestrian attributes, such as gender, hairstyle, body shape, and clothing features, which contain rich and high-level information, have been less explored. To address this gap, we propose a simple, effective, and generic method to predict pedestrian attributes to support general reidentification (Re-ID) embedding. We first introduce attribute multi-object tracking (AttMOT), a large, highly enriched synthetic dataset for pedestrian tracking, containing over 80k frames and six million pedestrian identity switches (IDs) with different times, weather conditions, and scenarios. To the best of authors' knowledge, AttMOT is the first MOT dataset with semantic attributes. Subsequently, we explore different approaches to fuse Re-ID embedding and pedestrian attributes, including attention mechanisms, which we hope will stimulate the development of attribute-assisted MOT. The proposed method attribute-assisted method (AAM) demonstrates its effectiveness and generality on several representative pedestrian MOT benchmarks, including MOT17 and MOT20, through experiments on the AttMOT dataset. When applied to the state-of-the-art trackers, AAM achieves consistent improvements in multi-object tracking accuracy (MOTA), higher order tracking accuracy (HOTA), association accuracy (AssA), IDs, and IDF1 scores. For instance, on MOT17, the proposed method yields a + 1.1 MOTA, + 1.7 HOTA, and + 1.8 IDF1 improvement when used with FairMOT. To further encourage related research, we release the data and code at https://github.com/HengLan/AttMOT.

Study on the explainability of deep learning models for time series analysis in sheet metal forming

In recent research, force signals have been utilized to estimate the wear of tool components in sheet metal processing using, e.g., artificial neural networks (ANNs). ANNs learn predictive models from raw time series signals without requiring prior knowledge and manual feature engineering. However, ANNs are black-box models. Existing research on explainable AI provides methods to increase the transparency of ANNs, but mainly focusses on computer vision problems. This publication proposes an approach to learn explainable ANNs for time series data. The presented approach is applied to a tool wear prediction task using force signals from a fine blanking machine.

Understanding Adversarial Atmospheric Features Interpretation, Analysis, and Standardization for Tackling the Computer Vision Problems in Videos

Understanding Adversarial Atmospheric Features Interpretation, Analysis, and Standardization for Tackling the Computer Vision Problems in Videos

Exploring the Application of Large-Scale Pre-Trained Models on Adverse Weather Removal.

Image restoration under adverse weather conditions (e.g., rain, snow, and haze) is a fundamental computer vision problem that has important implications for various downstream applications. Distinct from early methods that are specially designed for specific types of weather, recent works tend to simultaneously remove various adverse weather effects based on either spatial feature representation learning or semantic information embedding. Inspired by various successful applications incorporating large-scale pre-trained models (e.g., CLIP), in this paper, we explore their potential benefits for leveraging large-scale pre-trained models in this task based on both spatial feature representation learning and semantic information embedding aspects: 1) spatial feature representation learning, we design a Spatially Adaptive Residual (SAR) encoder to adaptively extract degraded areas. To facilitate training of this model, we propose a Soft Residual Distillation (CLIP-SRD) strategy to transfer spatial knowledge from CLIP between clean and adverse weather images; 2) semantic information embedding, we propose a CLIP Weather Prior (CWP) embedding module to enable the network to adaptively respond to different weather conditions. This module integrates the sample-specific weather priors extracted by the CLIP image encoder with the distribution-specific information (as learned by a set of parameters) and embeds these elements using a cross-attention mechanism. Extensive experiments demonstrate that our proposed method can achieve state-of-the-art performance under various and severe adverse weather conditions. The code will be made available.

SEF-UNet: advancing abdominal multi-organ segmentation with SEFormer and depthwise cascaded upsampling.

The abdomen houses multiple vital organs, which are associated with various diseases posing significant risks to human health. Early detection of abdominal organ conditions allows for timely intervention and treatment, preventing deterioration of patients' health. Segmenting abdominal organs aids physicians in more accurately diagnosing organ lesions. However, the anatomical structures of abdominal organs are relatively complex, with organs overlapping each other, sharing similar features, thereby presenting challenges for segmentation tasks. In real medical scenarios, models must demonstrate real-time and low-latency features, necessitating an improvement in segmentation accuracy while minimizing the number of parameters. Researchers have developed various methods for abdominal organ segmentation, ranging from convolutional neural networks (CNNs) to Transformers. However, these methods often encounter difficulties in accurately identifying organ segmentation boundaries. MetaFormer abstracts the framework of Transformers, excluding the multi-head Self-Attention, offering a new perspective for solving computer vision problems and overcoming the limitations of Vision Transformers and CNN backbone networks. To further enhance segmentation effectiveness, we propose a U-shaped network, integrating SEFormer and depthwise cascaded upsampling (dCUP) as the encoder and decoder, respectively, into the UNet structure, named SEF-UNet. SEFormer combines Squeeze-and-Excitation modules with depthwise separable convolutions, instantiating the MetaFormer framework, enhancing the capture of local details and texture information, thereby improving edge segmentation accuracy. dCUP further integrates shallow and deep information layers during the upsampling process. Our model significantly improves segmentation accuracy while reducing the parameter count and exhibits superior performance in segmenting organ edges that overlap each other, thereby offering potential deployment in real medical scenarios.

Suspicious Activity Detection

Abstract: Unpredictable activities is guessing a person's physical location or joint activity based on images or videos. The project will require the use of neural networks to detect human activities from CCTV images. Human behavior is one of the fundamental problems in computer vision and has been studied for over 15 years. This is important because the number of applications that can benefit from the search function is huge. For example, it is used in applications such as human prediction, video analysis, animal analysis and behavior understanding, language recognition, human relations-computer, and characters are less powerful. While low-cost depth sensors have limitations such as being limited to indoor use, their low-noise data and low depth make it difficult to estimate humans from depth images. Therefore, we plan to use neural networks to solve these problems. Analyzing human activity through image analysis is an active area of research in image processing and computer vision. Thanks to visual monitoring, human activities in public places such as bus stops, train stations, airports, banks, shopping malls, schools, parking lots and roads can be monitored in order to prevent attacks, theft, accidents, illegal parking, violence, fights and chain events. purse snatching etc. illegal and other activities. It is very difficult to monitor public places regularly, so there is a need for intelligent video surveillance that can monitor people's activities in real time and divide them into tasks, normal and abnormal activities; and can generate an alarm. Often research is done with images rather than video. Also, none of the published articles attempt to use CNNs to detect suspicious activity.

Shape classification using a new shape descriptor and multi-view learning

Shape classification is considered as a vital task in solving many computer vision problems. Different factors such as affine transformations, scaling, rotations, variation in perspective, noise and occlusion have made the shape classification problem to be a hard problem. This work investigates a new shape descriptor that extracts different features from each boundary pixel. This makes it to be more informative and discriminant in comparison with other descriptors. After feature extraction, the “bag-of-features (BoF)” model is employed to construct the final representation for each image. To enhance the functionality of the BoF model, a novel codebook generation approach is presented. The proposed approach tends to derive a more meaningful visual codebook. Consequently, the produced feature vectors can handle inter- and intra-class variations more effectively. Comprehensive experiments conducted on the various complicated shape datasets show the supremacy of our approach compared to other methods.

Multimodel fore-/background alignment for seam-based parallax-tolerant image stitching

Image stitching with large parallax is a challenging computer vision problem. Although existing seam-based approaches were proposed to achieve pleasing results, issues like object dislocation, disappearance, and duplication can still occur. In this paper, to alleviate these problems, we propose a novel seam-based parallax-tolerant image stitching method, which relies on accurately aligning background and foreground regions using multiple warping models. To estimate various spatially smooth models based on feature correspondences from depth-varying objects, we introduce an iterative algorithm that selects inliers and solves the mesh warping model by assigning weights to data. Additionally, we construct matching confidences of foreground pixels based on selecting and grouping unaligned feature pairs, thus penalizing the duplication of seam cuts. To further improve alignment, we refine the models by minimizing pixel-level errors. We then choose the best seam among multiple candidate alignment and seam finding solutions. Finally, we re-estimate the warping model by sampling and weighting points near the seam to achieve a natural-looking stitching result. Experimental results on real-world images demonstrate the effectiveness and superiority of our proposed method over other state-of-the-arts.

DetTrack: An Algorithm for Multiple Object Tracking by Improving Occlusion Object Detection

Multi-object tracking (MOT) is an important problem in computer vision that has a wide range of applications. Currently, object occlusion detecting is still a serious challenge in multi-object tracking tasks. In this paper, we propose a method to simultaneously improve occluded object detection and occluded object tracking, as well as propose a tracking method for when the object is completely occluded. First, motion track prediction is utilized to improve the upper limit of occluded object detection. Then, the spatio-temporal feature information between the object and the surrounding environment is used for multi-object tracking. Finally, we use the hypothesis frame to continuously track the completely occluded object. Our study shows that we achieve competitive performances compared to the current state-of-the-art methods on popular multi-object tracking benchmarks such as MOT16, MOT17, and MOT20.

Detection of Fake Currency Using Machine Learning Models

The goal of this research is to determine whether a given cash sample is genuine or counterfeit. Based on the colours, widths, and serial numbers described, several conventional procedures and methods exist for identifying counterfeit cash. Image processing proposes a number of machine learning techniques with a false-identity detection success rate of 99.9 percent for paper cash in today's era of modern computing. In algorithm-based techniques for detection and identification, various entities such as color, form, paper width, and image filtering on the note play a crucial role. This research proposes the application of K-Nearest Neighbors (KNN) followed by image processing as an effective method for spotting counterfeit money. KNN is favored for use in computer vision problems due to its outstanding accuracy, particularly when dealing with small datasets. This approach leverages the strengths of KNN in handling limited data to enhance the precision and reliability of counterfeit money detection. The accurate facts and information on entities and attributes associated to currency have been compiled in this banknote authentication dataset, which was developed using advanced computational and mathematical methodologies. AI calculations and picture handling are utilized for information handling and information extraction to accomplish an elevated degree of exactness and accuracy.

Управление строительством с иcпользованием компьютерного зрения на строительной площадке

The article presents algorithms for solving the problem of computer vision to control the implementation of rules and requirements for the performance of work on a construction site. A general approach to algorithm development is described, including the structure and method used to collect construction site image data, the structure of the training image data set, the method of enlarging the image data set and the basic artificial intelligence model used for training. The developed and tested object recognition models will be applied to real construction sites, which will reduce the number of accidents involving construction workers, and use resources efficiently.

Averaging data on the unit hypersphere

Averaging data on the unit sphere S d (also called a unit hypersphere) is a common problem in computer vision, robotics and other fields, with applications ranging from motion planning to DNA modelling. In this paper, we introduce a new method for averaging data represented as points on the unit sphere S d−1 using the d-dimensional generalized Kuramoto model. Our method is verified on a range of benchmark data sets and compared with common data averaging algorithms. Also, we showcase the applicability of this method for solving rotation averaging problem.

Coarse-to-Fine Task-Driven Inpainting for Geoscience Images

The processing and recognition of geoscience images have wide applications. Most of existing researches focus on understanding the high-quality geoscience images by assuming that all the images are clear. However, in many real-world cases, the geoscience images might contain occlusions during the image acquisition. This problem actually implies the image inpainting problem in computer vision and multimedia. As far as we know, all the existing image inpainting algorithms learn to repair the occluded regions for a better visualization quality, they are excellent for natural images but not good enough for geoscience images, and they never consider the following gescience task when developing inpainting methods. This paper aims to repair the occluded regions for a better geoscience task performance and advanced visualization quality simultaneously, without changing the current deployed deep learning based geoscience models. Because of the complex context of geoscience images, we propose a coarse-to-fine encoder-decoder network with the help of designed coarse-to-fine adversarial context discriminators to reconstruct the occluded image regions. Due to the limited data of geoscience images, we propose a MaskMix based data augmentation method, which augments inpainting masks instead of augmenting original images, to exploit the limited geoscience image data. The experimental results on three public geoscience datasets for remote sensing scene recognition, cross-view geolocation and semantic segmentation tasks respectively show the effectiveness and accuracy of the proposed method. The code is available at: https://github.com/HMS97/Task-driven-Inpainting.

Recovering 3D Human Mesh From Monocular Images: A Survey.

Estimating human pose and shape from monocular images is a long-standing problem in computer vision. Since the release of statistical body models, 3D human mesh recovery has been drawing broader attention. With the same goal of obtaining well-aligned and physically plausible mesh results, two paradigms have been developed to overcome challenges in the 2D-to-3D lifting process: i) an optimization-based paradigm, where different data terms and regularization terms are exploited as optimization objectives; and ii) a regression-based paradigm, where deep learning techniques are embraced to solve the problem in an end-to-end fashion. Meanwhile, continuous efforts are devoted to improving the quality of 3D mesh labels for a wide range of datasets. Though remarkable progress has been achieved in the past decade, the task is still challenging due to flexible body motions, diverse appearances, complex environments, and insufficient in-the-wild annotations. To the best of our knowledge, this is the first survey that focuses on the task of monocular 3D human mesh recovery. We start with the introduction of body models and then elaborate recovery frameworks and training objectives by providing in-depth analyses of their strengths and weaknesses. We also summarize datasets, evaluation metrics, and benchmark results. Open issues and future directions are discussed in the end, hoping to motivate researchers and facilitate their research in this area. A regularly updated project page can be found at https://github.com/tinatiansjz/hmr-survey.

Global Refinement Algorithm for 3D Scene Reconstruction from a Sequence of Point Clouds

Point cloud registration is a central problem in many computer vision problems. However, ensuring global consistency of the results of pairwise registration of point clouds is still a challenge when there are multiple clouds because different scans should be converted to a common coordinate system. This paper describes a global refinement algorithm that first estimates rotations and then estimates parallel translations. For global refinement of rotations, a closed-form algorithm based on matrices is used. For global refinement of parallel translations, a closed-form algorithm is also used. The proposed algorithm is compared with other global refinement algorithms.

Advances of the Scientific School of V.L. Arlazarov in Dataset Creation and Training Sample Synthesis for Solving Modern Computer Vision Problems

Advances of the Scientific School of V.L. Arlazarov in Dataset Creation and Training Sample Synthesis for Solving Modern Computer Vision Problems

Data augmentation based face anti-spoofing (FAS) scheme using deep learning techniques

Recent years have seen a rise in interest in face anti-spoofing (FAS) owing to the critical function it plays in protecting face recognition systems against presentation assaults (PAs). Early-stage FAS approaches relying on handmade characteristics become inaccurate when steadily realistic PAs of unique sorts emerge. Thus, face anti-spoofing algorithms are gaining increasing relevance in such setups. A very innovative method called deep learning has shown remarkable success in difficult computer vision problems. The proposed method uses deep acquisition and transfer of learning to extract characteristics from people’s faces. This is why the authors of this study recommend using the Faster RCNN classifier with a face-liveness detection approach. Two distinct components— the data augmentation module for assessing sparse information as well as the faster RCNN classifier module— make up the anti-spoofing approach. We may use any publicly accessible dataset to train our quicker RCNN classifier. We successively fused these two components and used the Android platform to create a basic face recognition app. The results of the tests demonstrate that the developed module can identify several types of face spoof assaults, such as those carried out with the use of posters, masks, or cell phones. Testing the proposed architecture both across and inside databases using three benchmarking (Idiap Replay Attack, CASIA- FASD, & 3DMAD) demonstrate its ability to deliver outcomes on par with cutting-edge techniques.

An Enhanced Deep Learning Model for Brain Tumor Prediction

Brain tumour diagnosis & prediction is an challenging issue and important area of research. perversely, convolutional neural networks can support this (CNNs). They have mastered computer vision problems as well as other issues like segmenting, detecting, and recognizing visual objects. By enhancing the brain images with help of segmentation methods that are extremely challenging related to noise and cluster size sensitivity issues, as well as automated region of Interest detection (ROI), it helps with the diagnosis of brain tumours. The reality that CNNs have achieved high level of accuracy and it does not require manual extraction of features. Finding a brain tumour and correctly classifying it are challenging tasks. CNN outperforms rivals due to its extensive use in image recognition. Brain tumour segmentation is the most significant and challenging problems in the field of medical image processing research because human assisted manual categorization may lead to inaccurate prediction and diagnosis. In addition, when there is a huge amount of data existing to support in the process, it is challenging. Extraction of tumour areas from images becomes challenging due to the wide variety of appearances of brain tumours and the similarity of tumour and normal tissues.

Rancang Bangun Kunci Pintu Perpustakaan Otomatis Menggunakan Algoritma Histogram of oriented gradients Berbasis Mini-PC

Facial recognition has been a long-standing problem in computer vision. Recently, Histograms of Oriented Gradients (HOGs) have been shown to be effective descriptors for object recognition in general and face recognition in particular. In this study, HOGs are used as an algorithm to achieve facial recognition, which aims to recognize the faces of registered students when visiting the library without the need to fill in the attendance list in the visitor book and open the door and lock the door automatically.

Local-to-Global Panorama Inpainting for Locale-Aware Indoor Lighting Prediction.

Predicting panoramic indoor lighting from a single perspective image is a fundamental but highly ill-posed problem in computer vision and graphics. To achieve locale-aware and robust prediction, this problem can be decomposed into three sub-tasks: depth-based image warping, panorama inpainting and high-dynamic-range (HDR) reconstruction, among which the success of panorama inpainting plays a key role. Recent methods mostly rely on convolutional neural networks (CNNs) to fill the missing contents in the warped panorama. However, they usually achieve suboptimal performance since the missing contents occupy a very large portion in the panoramic space while CNNs are plagued by limited receptive fields. The spatially-varying distortion in the spherical signals further increases the difficulty for conventional CNNs. To address these issues, we propose a local-to-global strategy for large-scale panorama inpainting. In our method, a depth-guided local inpainting is first applied on the warped panorama to fill small but dense holes. Then, a transformer-based network, dubbed PanoTransformer, is designed to hallucinate reasonable global structures in the large holes. To avoid distortion, we further employ cubemap projection in our design of PanoTransformer. The high-quality panorama recovered at any locale helps us to capture spatially-varying indoor illumination with physically-plausible global structures and fine details.