Image Classification System Research Articles

Design of automatic follicle detection and ovarian classification system for ultrasound ovarian images

Design of automatic follicle detection and ovarian classification system for ultrasound ovarian images

Internal and External Collaborative Shaping: The Role of Official Information and Online Communities in Shaping a City’s Image

City image is essential for city marketing, yet the impact of “outside–in” shaping by social media in the Web 2.0 era has been largely overlooked. The decentralized and diverse Web 2.0 environment now dominates online information dissemination, influencing not just cyberspace, but also the physical urban landscape. These externally driven city images increasingly reflect and interact with traditional “inside–out” images shaped by official sources. Understanding the influence of external actors via social media compared to traditional internal sources, like government websites, is crucial. This dual analysis offers insights into city image formation, helping cities refine their marketing strategies. This study analyzed a representative social media platform alongside official government websites, using programming and a naive Bayes classifier. We developed a method to categorize the city images of selected U.S. world cities based on these two different media sources. The results are as follows: (1) We establish a city image categorization system that divides the considered U.S. world cities into four and five categories based on social media and official government website content, respectively. (2) We compare the groups and logics shaping global city images in different cyber eras based on the example of the U.S. world cities, and based on this, we explore the relative roles of groups outside the city. (3) We identify the preferences of forming different city images between external groups based on social media and internal forces based on government websites. In summary, this article takes world cities as an example to demonstrate that, in the Web 2.0 era, the image of a city depends on both internal and external groups and has varying degrees of preference. The unique urban image of each city is formed through two media content streams and quantitative preference.

Two-Dimensional Electrically Conductive Metal-Organic Framework Boosts Synaptic Plasticity for Dynamic Image Refresh, Classification, and Efferent Neuromuscular Systems.

We present a two-dimensional (2D) electrically conductive metal-organic framework (EC-MOF)-based artificial synapse. The intrinsic electronic conductivity and subnanometer channels of the EC-MOF facilitate efficient ion diffusion, enable a high density of active redox centers, and significantly enhance capacitance within the artificial synapse. As a result, the synapse operates at an ultralow voltage of 10 mV and exhibits a remarkably low power consumption of approximately 1 fW, along with the longest retention time recorded for two-terminal electrolyte-type artificial synapses to date. The alignment of the quantum size of the subnanometer pores in the EC-MOF with various cations allows for versatile synaptic plasticity. This capability is applied to image refresh, classification, and efferent signal transmission for controlling artificial muscles, thereby offering a methodology for achieving tunable neuromorphic properties. These findings suggest the potential application of metal-organic frameworks in artificial nervous systems for future brain-inspired computation, peripheral interfaces, and neurorobotics.

Automated Lunar Surface Image Classification Using Deep Convolutional Neural Networks for Geological Feature Detection

Robotic rovers have vastly expanded our understanding of the lunar surface, providing detailed imagery crucial for scientific research and future exploration. However, manually classifying this imagery is time-consuming and prone to errors, necessitating automated solutions. Automated classification of lunar surface imagery is vital for efficient data analysis, site selection for future missions, and advancing lunar exploration. Developing accurate and efficient image classification systems tailored for lunar terrain is thus imperative. The objective of this study is to develop and assess an image classification system utilizing Deep Convolutional Neural Networks (DCNNs) specifically for lunar surface images. The aim is to achieve high accuracy and efficiency in identifying geological features such as craters and dunes, as observed by robotic rovers. A curated dataset of lunar surface images was partitioned into training, testing, and validation subsets. DCNNs models were trained on the training dataset and evaluated using testing and validation datasets. Hyperparameter tuning and optimization techniques were employed to enhance model performance. The classification system based on DCNNs showed promising outcomes. Model B and F achieved an accuracy of 91.1%, while Model A and D achieved 87.5%. Model C attained an accuracy of 89.3%, and Model E reached 83.9%. Visualizations of training and validation metrics revealed distinct performance patterns across models, highlighting the potential for further advancements in lunar exploration research.

Computer-aided Detection and Diagnosis of Cancer Regions in Mammogram Images Using Resource-Efficient CNN Architecture.

The automatic computer-assisted mammogram classification system is important for women patients to detect and diagnose the cancer regions. In this work, the mammogram images are classified into three cases: healthy, benign and cancer, using the proposed Resource Efficient Convolutional Neural Network (RECNN architecture). The proposed mammogram image classification system consists of Data Augmentation (DA) module and Spatial transformation module and CNN architecture with a segmentation module. The DA methods are used to increase the mammogram image count and Spatial Gabor Transform is used as the spatial transformation module for transforming the spatial pixels into spatial-frequency pixels. Then, the proposed RECNN architecture is used to perform the classification of mammogram images into healthy, benign and cancer cases. Further, the cancer mammogram images are diagnosed as either 'Early' or 'Severe' using the proposed RECNN architecture in this work. The proposed MCDS obtains 98.65% SeDR, 98.93% SpDR and 98.84% ADR for benign case mammogram images on DDSM dataset and also obtains 98.84% SeDR, 98.7% SpDR and 98.92% ADR for benign case mammogram images on DDSM dataset. The proposed MCDS obtains 98.94% SeDR, 98.86% SpDR and 98.96% ADR for benign case mammogram images on DDSM dataset and also obtains 98.89% SeDR, 98.88% SpDR and 99.03% ADR for benign case mammogram images on MIAS dataset. This proposed method is tested on the mammogram images from DDSM and MIAS datasets and the experimental results are compared with other similar mammogram classification works in this paper. Based on several performance evaluation measures, the experimental results show that MCDS outperforms the state-of-the-art methods currently used for the diagnosis and detection of mammography cancer.

Auto encoder-based defense mechanism against popular adversarial attacks in deep learning.

Convolutional Neural Network (CNN)-based models are prone to adversarial attacks, which present a significant hurdle to their reliability and robustness. The vulnerability of CNN-based models may be exploited by attackers to launch cyber-attacks. An attacker typically adds small, carefully crafted perturbations to original medical images. When a CNN-based model receives the perturbed medical image as input, it misclassifies the image, even though the added perturbation is often imperceptible to the human eye. The emergence of such attacks has raised security concerns regarding the implementation of deep learning-based medical image classification systems within clinical environments. To address this issue, a reliable defense mechanism is required to detect adversarial attacks on medical images. This study will focus on the robust detection of pneumonia in chest X-ray images through CNN-based models. Various adversarial attacks and defense strategies will be evaluated and analyzed in the context of CNN-based pneumonia detection. From earlier studies, it has been observed that a single defense mechanism is usually not effective against more than one type of adversarial attack. Therefore, this study will propose a defense mechanism that is effective against multiple attack types. A reliable defense framework for pneumonia detection models will ensure secure clinical deployment, facilitating radiologists and doctors in their diagnosis and treatment planning. It can also save time and money by automating routine tasks. The proposed defense mechanism includes a convolutional autoencoder to denoise perturbed Fast Gradient Sign Method (FGSM) and Projected Gradient Descent (PGD) adversarial images, two state- of-the-art attacks carried out at five magnitudes, i.e., ε (epsilon) values. Two pre-trained models, VGG19 and VGG16, and our hybrid model of MobileNetV2 and DenseNet169, called Stack Model, have been used to compare their results. This study shows that the proposed defense mechanism outperforms state-of-the-art studies. The PGD attack using the VGG16 model shows a better attack success rate by reducing overall accuracy by up to 67%. The autoencoder improves accuracy by up to 16% against PGD attacks in both the VGG16 and VGG19 models.

Data-driven Smart Farming to Grade and Classify Tomatoes using CNN and FFNN for Agricultural Innovation

Identifying images poses a challenge in computer vision, but the use of deep learning methods has greatly enhanced the performance of image classification systems. In this research, Convolutional Neural Networks (CNN) and Feed Forward Neural Networks (FFNN) have been utilized for image classification. CNN is extremely effective in picture classification, which extracts relevant information from images using convolutional and pooling layers to minimize the dimensionality of the derived features, while FFNN algorithm is a classic neural network with fully linked layers. It can be used to further process the features extracted by CNN. The study makes use of CNN and FFNN models to train a huge dataset of tomato images to categorize them based on their type, ripeness, and damage status. CNN is found to be more effective in the case of tomato classification as compared to FFNN algorithm in all the use cases. The accuracy for classification of an image (tomato or not) using CNN is 95.83%, type classification using CNN is 81.52%, whereas using FFNN is 66.30%; ripeness grading for CNN is 92.86%, whereas for FFNN it is 57.14%; and damage status grading is 92.86% using CNN and 67.86% using FFNN. Therefore, it can be concluded that quality processing of tomatoes can be improved using CNN.

Construction Jobsite Image Classification Using an Edge Computing Framework

Image classification is increasingly being utilized on construction sites to automate project monitoring, driven by advancements in reality-capture technologies and artificial intelligence (AI). Deploying real-time applications remains a challenge due to the limited computing resources available on-site, particularly on remote construction sites that have limited telecommunication support or access due to high signal attenuation within a structure. To address this issue, this research proposes an efficient edge-computing-enabled image classification framework for support of real-time construction AI applications. A lightweight binary image classifier was developed using MobileNet transfer learning, followed by a quantization process to reduce model size while maintaining accuracy. A complete edge computing hardware module, including components like Raspberry Pi, Edge TPU, and battery, was assembled, and a multimodal software module (incorporating visual, textual, and audio data) was integrated into the edge computing environment to enable an intelligent image classification system. Two practical case studies involving material classification and safety detection were deployed to demonstrate the effectiveness of the proposed framework. The results demonstrated the developed prototype successfully synchronized multimodal mechanisms and achieved zero latency in differentiating materials and identifying hazardous nails without any internet connectivity. Construction managers can leverage the developed prototype to facilitate centralized management efforts without compromising accuracy or extra investment in computing resources. This research paves the way for edge “intelligence” to be enabled for future construction job sites and promote real-time human-technology interactions without the need for high-speed internet.

Few-shot image classification using graph neural network with fine-grained feature descriptors

Graph computation via Graph Neural Networks (GNNs) is emerging as a pivotal approach for addressing the challenges in image classification tasks. This paper introduces a novel strategy for image classification using minimal labeled data from the mini-ImageNet database. The primary contributions include the development of an innovative Fine-Grained Feature Descriptor (FGFD) module. Following this, the GNN is employed at a more granular level to enhance image classification efficiency. Additionally, ablation studies were conducted in conjunction with existing state-of-the-art systems for few-shot image classification. Comparative analyses were performed, and the simulation results demonstrate that the proposed method significantly improves classification accuracy over traditional few-shot image classification methods.

Defense against Adversarial Attacks in Image Recognition Based on Multilayer Filters

The security and privacy of a system are urgent issues in achieving secure and efficient learning-based systems. Recent studies have shown that these systems are susceptible to subtle adversarial perturbations applied to inputs. Although these perturbations are difficult for humans to detect, they can easily mislead deep learning classifiers. Noise injection, as a defense mechanism, can offer a provable defense against adversarial attacks by reducing sensitivity to subtle input changes. However, these methods face issues of computational complexity and limited adaptability. We propose a multilayer filter defense model, drawing inspiration from filter-based image denoising techniques. This model inserts a filtering layer after the input layer and before the convolutional layer, and incorporates noise injection techniques during the training process. This model substantially enhances the resilience of image classification systems to adversarial attacks. We also investigated the impact of various filter combinations, filter area sizes, standard deviations, and filter layers on the effectiveness of defense. The experimental results indicate that, across the MNIST, CIFAR10, and CIFAR100 datasets, the multilayer filter defense model achieves the highest average accuracy when employing a double-layer Gaussian filter (filter area size of 3×3, standard deviation of 1). We compared our method with two filter-based defense models, and the experimental results demonstrated that our method attained an average accuracy of 71.9%, effectively enhancing the robustness of the image recognition classifier against adversarial attacks. This method not only performs well on small-scale datasets but also exhibits robustness on large-scale datasets (miniImageNet) and modern models (EfficientNet and WideResNet).

Robust image classification system via cloud computing, aligned multimodal embeddings, centroids and neighbours

We propose a framework for a cloud-based application of an image classification system that is highly accessible, maintains data confidentiality, and robust to incorrect training labels. The end-to-end system is implemented using Amazon Web Services (AWS), with a detailed guide provided for replication, enhancing the ways which researchers can collaborate with a community of users for mutual benefits. A front-end web application allows users across the world to securely log in, contribute labelled training images conveniently via a drag-and-drop approach, and use that same application to query an up-to-date model that has knowledge of images from the community of users. This resulting system demonstrates that theory can be effectively interlaced with practice, with various considerations addressed by our architecture. Users will have access to an image classification model that can be updated and automatically deployed within minutes, gaining benefits from and at the same time providing benefits to the community of users. At the same time, researchers, who will act as administrators, will be able to conveniently and securely engage a large number of users with their respective machine learning models and build up a labelled database over time, paying only variable costs that is proportional to utilization.

Automatic Classification of Nodules from 2D Ultrasound Images Using Deep Learning Networks.

In clinical practice, thyroid nodules are typically visually evaluated by expert physicians using 2D ultrasound images. Based on their assessment, a fine needle aspiration (FNA) may be recommended. However, visually classifying thyroid nodules from ultrasound images may lead to unnecessary fine needle aspirations for patients. The aim of this study is to develop an automatic thyroid ultrasound image classification system to prevent unnecessary FNAs. An automatic computer-aided artificial intelligence system is proposed for classifying thyroid nodules using a fine-tuned deep learning model based on the DenseNet architecture, which incorporates an attention module. The dataset comprises 591 thyroid nodule images categorized based on the Bethesda score. Thyroid nodules are classified as either requiring FNA or not. The challenges encountered in this task include managing variability in image quality, addressing the presence of artifacts in ultrasound image datasets, tackling class imbalance, and ensuring model interpretability. We employed techniques such as data augmentation, class weighting, and gradient-weighted class activation maps (Grad-CAM) to enhance model performance and provide insights into decision making. Our approach achieved excellent results with an average accuracy of 0.94, F1-score of 0.93, and sensitivity of 0.96. The use of Grad-CAM gives insights on the decision making and then reinforce the reliability of the binary classification for the end-user perspective. We propose a deep learning architecture that effectively classifies thyroid nodules as requiring FNA or not from ultrasound images. Despite challenges related to image variability, class imbalance, and interpretability, our method demonstrated a high classification accuracy with minimal false negatives, showing its potential to reduce unnecessary FNAs in clinical settings.

Design of image classification system for fabric inspection process using Raspberry Pi

This research is designed as a prototype of defect inspection system on fabric production using machine learning-based image processing technology using the open source Google teachable machine application integrated with Raspberry Pi-3B. The prototype of fabric defect inspection system is built by utilizing two rollers that function as a fabric roll house before and after the inspection process. On both rollers, a fabric is stretched to be inspected, so that from a roll of fabric with a certain length, it can be seen how many defects occur on the fabric. The inspection system is carried out using a web camera with a certain level of lighting connected to a raspberry pi as a control device. Raspberry Pi functions as an image processing device and fabric rolling motor controller. In addition to the category of fabric in good condition, this system classifies into two categories of defects, namely slap defects and sparse defects. The test results show that this system has an average frame per second (FPS) of 4.85, an average inference time of 181.1 ms, with an accuracy of image classification results of 98.4 %.

Machine learning for automating subjective clinical assessment of gait impairment in people with acquired brain injury – a comparison of an image extraction and classification system to expert scoring

BackgroundWalking impairment is a common disability post acquired brain injury (ABI), with visually evident arm movement abnormality identified as negatively impacting a multitude of psychological factors. The International Classification of Functioning, Disability and Health (ICF) qualifiers scale has been used to subjectively assess arm movement abnormality, showing strong intra-rater and test-retest reliability, however, only moderate inter-rater reliability. This impacts clinical utility, limiting its use as a measurement tool. To both automate the analysis and overcome these errors, the primary aim of this study was to evaluate the ability of a novel two-level machine learning model to assess arm movement abnormality during walking in people with ABI.MethodsFrontal plane gait videos were used to train four networks with 50%, 75%, 90%, and 100% of participants (ABI: n = 42, healthy controls: n = 34) to automatically identify anatomical landmarks using DeepLabCut™ and calculate two-dimensional kinematic joint angles. Assessment scores from three experienced neurorehabilitation clinicians were used with these joint angles to train random forest networks with nested cross-validation to predict assessor scores for all videos. Agreement between unseen participant (i.e. test group participants that were not used to train the model) predictions and each individual assessor’s scores were compared using quadratic weighted kappa. One sample t-tests (to determine over/underprediction against clinician ratings) and one-way ANOVA (to determine differences between networks) were applied to the four networks.ResultsThe machine learning predictions have similar agreement to experienced human assessors, with no statistically significant (p < 0.05) difference for any match contingency. There was no statistically significant difference between the predictions from the four networks (F = 0.119; p = 0.949). The four networks did however under-predict scores with small effect sizes (p range = 0.007 to 0.040; Cohen’s d range = 0.156 to 0.217).ConclusionsThis study demonstrated that machine learning can perform similarly to experienced clinicians when subjectively assessing arm movement abnormality in people with ABI. The relatively small sample size may have resulted in under-prediction of some scores, albeit with small effect sizes. Studies with larger sample sizes that objectively and automatically assess dynamic movement in both local and telerehabilitation assessments, for example using smartphones and edge-based machine learning, to reduce measurement error and healthcare access inequality are needed.

Automatic Annotation Diagnostic Framework for Nasopharyngeal Carcinoma via Pathology-Fidelity GAN and Prior-Driven Classification.

Non-keratinizing carcinoma is the most common subtype of nasopharyngeal carcinoma (NPC). Its poorly differentiated tumor cells and complex microenvironment present challenges to pathological diagnosis. AI-based pathological models have demonstrated potential in diagnosing NPC, but the reliance on costly manual annotation hinders development. To address the challenges, this paper proposes a deep learning-based framework for diagnosing NPC without manual annotation. The framework includes a novel unpaired generative network and a prior-driven image classification system. With pathology-fidelity constraints, the generative network achieves accurate digital staining from H&E to EBER images. The classification system leverages staining specificity and pathological prior knowledge to annotate training data automatically and to classify images for NPC diagnosis. This work used 232 cases for study. The experimental results show that the classification system reached a 99.59% accuracy in classifying EBER images, which closely matched the diagnostic results of pathologists. Utilizing PF-GAN as the backbone of the framework, the system attained a specificity of 0.8826 in generating EBER images, markedly outperforming that of other GANs (0.6137, 0.5815). Furthermore, the F1-Score of the framework for patch level diagnosis was 0.9143, exceeding those of fully supervised models (0.9103, 0.8777). To further validate its clinical efficacy, the framework was compared with experienced pathologists at the WSI level, showing comparable NPC diagnosis performance. This low-cost and precise diagnostic framework optimizes the early pathological diagnosis method for NPC and provides an innovative strategic direction for AI-based cancer diagnosis.

Deep Learning Used with a Colorimetric Sensor Array to Detect Indole for Nondestructive Monitoring of Shrimp Freshness.

Intelligent colorimetric freshness indicator is a low-cost way to intuitively monitor the freshness of fresh food. A colorimetric strip sensor array was prepared by p-dimethylaminocinnamaldehyde (PDL)-doped poly(vinyl alcohol) (PVA) and chitosan (Chit) for the quantitative analysis of indole, which is an indicator of shrimp freshness. As a result of indole simulation, the array strip turned from faint yellow to pink or mulberry color with the increasing indole concentration, like a progress bar. The indicator film exhibited excellent permeability, mechanical and thermal stability, and color responsiveness to indole, which was attributed to the interactions between PDL and Chit/PVA. Furthermore, the colorimetric strip sensor array provided a good relationship between the indole concentration and the color intensity within a range of 50-350 ppb. The pathogens and spoilage bacteria of shrimp possessed the ability to produce indole, which caused the color changes of the strip sensor array. In the shrimp freshness monitoring experiment, the color-changing progress of the strip sensor array was in agreement with the simulation and could distinguish the shrimp freshness levels. The image classification system based on deep learning were developed, the accuracies of four DCNN algorithms are above 90%, with VGG16 achieving the highest accuracy at 97.89%. Consequently, a "progress bar" strip sensor array has the potential to realize nondestructive, more precise, and commercially available food freshness monitoring using simple visual inspection and intelligent equipment identification.

Classification of Marine Fish Based on Image Using Convolutional Neural Network Algorithm and VGG16

Marine fish are one of the many natural resources that frequently consumed by people. However, several types of marine fish are prohibited from consumption due to being nearly extinct. Additionally, some fish species contain high levels of mercury that can be harmful to human if consumed. Because of the large number of marine fish species, it becomes challenging to identify them without knowledge of fisheries. Moreover, computers have become highly advanced devices that facilitate various human activities. This advancement allows for the creation of systems capable of processing information from images, known as image classification. There are numerous methods that can be employed in designing an image classification system, one of which is transfer learning. This study was aimed to design an image classification system using the transfer learning method with a pre-trained VGG16 model and Convolutional Neural Network algorithm. The research results showed a training data accuracy of 100% and a validation data accuracy of 99.3%, with an overall accuracy of 84% and a loss value of 0.6591.

A deep learning-based system for accurate diagnosis of pelvic bone tumors

Bone image analysis and categorizing bone cancers have both seen advancements thanks to deep learning (DL), more notably convolution neural networks (CNN). This study suggests a brand-new CNN-based methodology for categorizing pelvic bone tumors specifically. This work aims to create a pelvic bone computed tomography (CT) image categorization system based on deep learning. The proposed technique uses a convolutional neural network (CNN) architecture to automatically extract information from the CT images and classify them into distinct categories of tumors. A total of 178 3D CT pictures was discovered and added retroactively. DenseNet created the image-based model with Adam optimizer and cross entropy loss. The suggested system's accuracy is assessed using a variety of performance indicators, including sensitivity, specificity, and F1-score. As demonstrated by the experiment findings, the suggested deep learning based classification system has a high degree of accuracy (94%), making it useful for the diagnosis and treatment of pelvic bone tumors. Our promising results might hasten the use of DL-assisted CT diagnosis for pelvic bone tumors in the future.

Confidence Calibration of a Medical Imaging Classification System That is Robust to Label Noise.

A classification model is calibrated if its predicted probabilities of outcomes reflect their accuracy. Calibrating neural networks is critical in medical analysis applications where clinical decisions rely upon the predicted probabilities. Most calibration procedures, such as temperature scaling, operate as a post processing step by using holdout validation data. In practice, it is difficult to collect medical image data with correct labels due to the complexity of the medical data and the considerable variability across experts. This study presents a network calibration procedure that is robust to label noise. We draw on the fact that the confusion matrix of the noisy labels can be expressed as the matrix product between the confusion matrix of the clean labels and the label noises. The method is based on estimating the noise level as part of a noise-robust training method. The noise level is then used to estimate the network accuracy required by the calibration procedure. We show that despite the unreliable labels, we can still achieve calibration results that are on a par with the results of a calibration procedure using data with reliable labels.

MTWSI-Net: Towards Improved Multi-Task Whole Slide Image Classification with Contrastive Learning

Pathology is a digital technology for the capture and analysis of high-resolution Whole Slide Images (WSIs). WSI entails scanning glass pathology slides, typically containing tissue samples, into a digital format. This facilitates comprehensive digital viewing, analysis, and interpretation by pathologists. Despite the undeniable utility of this method, the inherent time-consuming and labor-intensive nature of traditional pathology image analysis, which is heavily reliant on expert pathologists, is well-known. Recent years have seen a surge in research aiming to address these challenges through the development of automated systems using machine learning approaches. While promising, such systems often exhibit bias towards specific datasets and struggle to transition effectively to real-world scenarios. For this reason, there is a need to establish a uniform machine learning training approach for generating more robust and consistent results. In this paper, I introduce a contrastive learning-based multi-task whole slide image classification system. The proposed system excels at extracting consistently reliable features for identical cancer categories, thereby enhancing accuracy in downstream tasks. Through extensive experiments, the results demonstrate that the proposed system outperforms pre-existing state-of-the-art machine learning models. I expect that the proposed system can significantly contribute to pathologists by offering valuable cancer screening capabilities in WSIs.