V2 Model Research Articles

EasyDAM_V2: Efficient Data Labeling Method for Multishape, Cross-Species Fruit Detection.

In modern smart orchards, fruit detection models based on deep learning require expensive dataset labeling work to support the construction of detection models, resulting in high model application costs. Our previous work combined generative adversarial networks (GANs) and pseudolabeling methods to transfer labels from one specie to another to save labeling costs. However, only the color and texture features of images can be migrated, which still needs improvement in the accuracy of the data labeling. Therefore, this study proposes an EasyDAM_V2 model as an improved data labeling method for multishape and cross-species fruit detection. First, an image translation network named the Across-CycleGAN is proposed to generate fruit images from the source domain (fruit image with labels) to the target domain (fruit image without labels) even with partial shape differences. Then, a pseudolabel adaptive threshold selection strategy was designed to adjust the confidence threshold of the fruit detection model adaptively and dynamically update the pseudolabel to generate labels for images from the unlabeled target domain. In this paper, we use a labeled orange dataset as the source domain, and a pitaya, a mango dataset as the target domain, to evaluate the performance of the proposed method. The results showed that the average labeling precision values of the pitaya and mango datasets were 82.1% and 85.0%, respectively. Therefore, the proposed EasyDAM_V2 model is proven to be used for label transfer of cross-species fruit even with partial shape differences to reduce the cost of data labeling.

Optimal Deep Learning Based Inception Model for Cervical Cancer Diagnosis

Prevention of cervical cancer becomes essential and is carried out by the use of Pap smear images. Pap smear test analysis is laborious and tiresome work performed visually using a cytopathologist. Therefore, automated cervical cancer diagnosis using automated methods are necessary. This paper designs an optimal deep learning based Inception model for cervical cancer diagnosis (ODLIM-CCD) using pap smear images. The proposed ODLIM-CCD technique incorporates median filtering (MF) based pre-processing to discard the noise and Otsu model based segmentation process. Besides, deep convolutional neural network (DCNN) based Inception with Residual Network (ResNet) v2 model is utilized for deriving the feature vectors. Moreover, swallow swarm optimization (SSO) based hyperparameter tuning process is carried out for the optimal selection of hyperparameters. Finally, recurrent neural network (RNN) based classification process is done to determine the presence of cervical cancer or not. In order to showcase the improved diagnostic performance of the ODLIM-CCD technique, a series of simulations occur on benchmark test images and the outcomes highlighted the improved performance over the recent approaches with a superior accuracy of 0.9661.

Fruits and Vegetable Diseases Recognition Using Convolutional Neural Networks

As they have nutritional, therapeutic, so values, plants were regarded as important and they’re the main source of humankind’s energy supply. Plant pathogens will affect its leaves at a certain time during crop cultivation, leading to substantial harm to crop productivity & economic selling price. In the agriculture industry, the identification of fungal diseases plays a vital role. However, it requires immense labor, greater planning time, and extensive knowledge of plant pathogens. Computerized approaches are developed and tested by different researchers to classify plant disease identification, and that in many cases they have also had important results several times. Therefore, the proposed study presents a new framework for the recognition of fruits and vegetable diseases. This work comprises of the two phases wherein the phase-I improved localization model is presented that comprises of the two different types of the deep learning models such as You Only Look Once (YOLO)v2 and Open Exchange Neural (ONNX) model. The localization model is constructed by the combination of the deep features that are extracted from the ONNX model and features learning has been done through the convolutional-05 layer and transferred as input to the YOLOv2 model. The localized images passed as input to classify the different types of plant diseases. The classification model is constructed by ensembling the deep features learning, where features are extracted dimension of from pre-trained Efficientnetb0 model and supplied to next 07 layers of the convolutional neural network such as 01 features input, 01 ReLU, 01 Batch-normalization, 02 fully-connected. The proposed model classifies the plant input images into associated labels with approximately 95% prediction scores that are far better as compared to current published work in this domain.

Embedding Extraction for Arabic Text Using the AraBERT Model

Nowadays, we can use the multi-task learning approach to train a machine-learning algorithm to learn multiple related tasks instead of training it to solve a single task. In this work, we propose an algorithm for estimating textual similarity scores and then use these scores in multiple tasks such as text ranking, essay grading, and question answering systems. We used several vectorization schemes to represent the Arabic texts in the SemEval2017-task3-subtask-D dataset. The used schemes include lexical-based similarity features, frequency-based features, and pre-trained model-based features. Also, we used contextual-based embedding models such as Arabic Bidirectional Encoder Representations from Transformers (AraBERT). We used the AraBERT model in two different variants. First, as a feature extractor in addition to the text vectorization schemes’ features. We fed those features to various regression models to make a prediction value that represents the relevancy score between Arabic text units. Second, AraBERT is adopted as a pre-trained model, and its parameters are fine-tuned to estimate the relevancy scores between Arabic textual sentences. To evaluate the research results, we conducted several experiments to compare the use of the AraBERT model in its two variants. In terms of Mean Absolute Percentage Error (MAPE), the results show minor variance between AraBERT v0.2 as a feature extractor (21.7723) and the fine-tuned AraBERT v2 (21.8211). On the other hand, AraBERT v0.2-Large as a feature extractor outperforms the fine-tuned AraBERT v2 model on the used data set in terms of the coefficient of determination () values (0.014050,−0.032861), respectively.

Deep Learning Enabled Object Detection and Tracking Model for Big Data Environment

Recently, big data becomes evitable due to massive increase in the generation of data in real time application. Presently, object detection and tracking applications becomes popular among research communities and finds useful in different applications namely vehicle navigation, augmented reality, surveillance, etc. This paper introduces an effective deep learning based object tracker using Automated Image Annotation with Inception v2 based Faster RCNN (AIA-IFRCNN) model in big data environment. The AIA-IFRCNN model annotates the images by Discriminative Correlation Filter (DCF) with Channel and Spatial Reliability tracker (CSR), named DCF-CSRT model. The AIA-IFRCNN technique employs Faster RCNN for object detection and tracking, which comprises region proposal network (RPN) and Fast R-CNN. In addition, inception v2 model is applied as a shared convolution neural network (CNN) to generate the feature map. Lastly, softmax layer is applied to perform classification task. The effectiveness of the AIA-IFRCNN method undergoes experimentation against a benchmark dataset and the results are assessed under diverse aspects with maximum detection accuracy of 97.77%.

Disease Identification of Lentinus Edodes Sticks Based on Deep Learning Model

Lentinus edodes sticks are susceptible to mold infection during the culture process, and manual identification of infected sticks is heavy, untimely, and inaccurate. Aiming to solve this problem, this paper proposes a method for identifying infected Lentinus edodes sticks based on improved ResNeXt‐50(32 × 4d) deep transfer learning. First, a dataset of Lentinus edodes stick diseases was constructed. Second, based on the ResNeXt‐50(32 × 4d) model and the pretraining weight of the ImageNet dataset, the influence of pretraining weight parameters on recognition accuracy was studied. Finally, six fine‐tuning strategies of the fully connected layer were designed to modify the fully connected layer of ResNeXt‐50(32 × 4d). The experimental results show that the recognition accuracy of the method proposed in this paper can reach 94.27%, which is higher than the Vgg16, GoogLeNet, ResNet50, and MobileNet v2 models by 8.47%, 6.49%, 4.68%, and 9.38%, respectively, and the F1‐score can reach 0.9422. The improved method proposed in this paper can reduce the calculation pressure and overfitting problem of the model, improve the accuracy of the model in the identification of Lentinus edodes stick mold diseases, and provide an effective solution for the selection of diseased sticks.

Deep Learning Based License Plate Number Recognition for Smart Cities

Smart city-aspiring urban areas should have a number of necessary elements in place to achieve the intended objective. Precise controlling and management of traffic conditions, increased safety and surveillance, and enhanced incident avoidance and management should be top priorities in smart city management. At the same time, Vehicle License Plate Number Recognition (VLPNR) has become a hot research topic, owing to several real-time applications like automated toll fee processing, traffic law enforcement, private space access control, and road traffic surveillance. Automated VLPNR is a computer vision-based technique which is employed in the recognition of automobiles based on vehicle number plates. The current research paper presents an effective Deep Learning (DL)-based VLPNR called DL-VLPNR model to identify and recognize the alphanumeric characters present in license plate. The proposed model involves two main stages namely, license plate detection and Tesseract-based character recognition. The detection of alphanumeric characters present in license plate takes place with the help of fast RCNN with Inception V2 model. Then, the characters in the detected number plate are extracted using Tesseract Optical Character Recognition (OCR) model. The performance of DL-VLPNR model was tested in this paper using two benchmark databases, and the experimental outcome established the superior performance of the model compared to other methods.

Use of Radiation Circuits for Diagnosis of Melanoma Skin Cancer in Images of Skin Lesions Using Convolutional Neural Networks

Melanoma skin cancer is a fatal illness. However, most melanomas can be treated with minimal surgery if found early. In this regard, the addition of image analysis techniques that automate skin cancer diagnosis would support and increase dermatologists’ diagnosis accuracy. As a result, enhanced melanoma detection can benefit patients who are showing indicators of the disease. Convolutional neural networks can learn from features hierarchically. Since the implementation of a neural network requires a large volume of images to achieve high accuracy rates, an insufficient number of skin cancer images represent an additional challenge in the detection of skin lesions; the current work aims to develop an intelligent system that allows, based on the analysis of images of skin lesions and contextual information of the patient, to accurately determine if it represents a case of melanoma‐type skin cancer. The TensorFlow library was used to execute models in the constructed app. The Mobilenet V2 model was used with a collection of 305 pictures retrieved from the Internet. Diagnoses included melanoma, plaque and psoriatic skin conditions, and Kaposi’s sarcoma and atopic dermatitis. There were two separate machines used to conduct the application tests. There was more than 75% acceptable performance in predicting Kaposi’s sarcoma‐like illnesses for melanoma‐like lesions, as well as plaque psoriasis and atopic dermatitis, respectively. Despite the low amount of images used in training, the constructed mobile application performed well.

A Deep Learning Model for Idiopathic Osteosclerosis Detection on Panoramic Radiographs

Objective: The purpose of the study was to create an artificial intelligence (AI) system for detecting idiopathic osteosclerosis (IO) on panoramic radiographs for automatic, routine, and simple evaluations. Subject and Methods: In this study, a deep learning method was carried out with panoramic radiographs obtained from healthy patients. A total of 493 anonymized panoramic radiographs were used to develop the AI system (CranioCatch, Eskisehir, Turkey) for the detection of IOs. The panoramic radiographs were acquired from the radiology archives of the Department of Oral and Maxillofacial Radiology, Faculty of Dentistry, Eskisehir Osmangazi University. GoogLeNet Inception v2 model implemented with TensorFlow library was used for the detection of IOs. Confusion matrix was used to predict model achievements. Results: Fifty IOs were detected accurately by the AI model from the 52 test images which had 57 IOs. The sensitivity, precision, and F-measure values were 0.88, 0.83, and 0.86, respectively. Conclusion: Deep learning-based AI algorithm has the potential to detect IOs accurately on panoramic radiographs. AI systems may reduce the workload of dentists in terms of diagnostic efforts.

Deep Learning Based Intelligent Industrial Fault Diagnosis Model

In the present industrial revolution era, the industrial mechanical system becomes incessantly highly intelligent and composite. So, it is necessary to develop data-driven and monitoring approaches for achieving quick, trustable, and high-quality analysis in an automated way. Fault diagnosis is an essential process to verify the safety and reliability operations of rotating machinery. The advent of deep learning (DL) methods employed to diagnose faults in rotating machinery by extracting a set of feature vectors from the vibration signals. This paper presents an Intelligent Industrial Fault Diagnosis using Sailfish Optimized Inception with Residual Network (IIFD-SOIR) Model. The proposed model operates on three major processes namely signal representation, feature extraction, and classification. The proposed model uses a Continuous Wavelet Transform (CWT) is for preprocessed representation of the original vibration signal. In addition, Inception with ResNet v2 based feature extraction model is applied to generate high-level features. Besides, the parameter tuning of Inception with the ResNet v2 model is carried out using a sailfish optimizer. Finally, a multilayer perceptron (MLP) is applied as a classification technique to diagnose the faults proficiently. Extensive experimentation takes place to ensure the outcome of the presented model on the gearbox dataset and a motor bearing dataset. The experimental outcome indicated that the IIFD-SOIR model has reached a higher average accuracy of 99.6% and 99.64% on the applied gearbox dataset and bearing dataset. The simulation outcome ensured that the proposed model has attained maximum performance over the compared methods.

Detection of circuit components on hand-drawn circuit images by using faster R-CNN method

In this study, one of deep learning methods, which has been very popular in recent years, is employed for the detection and classification of circuit components in hand-drawn circuit images. Each circuit component located in different positions on the scanned images of hand-drawn circuits, which are frequently used in electrical and electronics engineering, is considered as a separate object. In order to detect the components on the circuit image, Faster Region Based Convolutional Neural Network (R-CNN) method is used instead of conventional methods. With the Faster R-CNN method, which has been developed in recent years to detect and classify objects, preprocessing on image data is minimized, and the feature extraction phase is done automatically. In the study, it is aimed to detect and classify four different circuit components in the scanned images of hand-drawn circuits with high accuracy by using the Python programming language on the Google Colab platform. The circuit components to be detected on the hand-drawn circuits are specified as resistor, inductor, capacitor, and voltage source. For the training of the model used, a data set was created by collecting 800 circuit images consisting of hand drawings of different people. For the detection of the components, the pretrained Faster R-CNN Inception V2 model was used after fine tuning and arrangements depending on the process requirements. The model was trained in 50000 epochs, and the success of the trained model has been tested on the circuits drawn in different styles on the paper. The trained model was able to detect circuit components quickly and with a high rate of performance. In addition, the loss graphics of the model were examined. The proposed method shows its efficiency by quickly detecting each of the 4 different circuit components on the image and classifying them with high performance.

A robust bitmap-based real-time position tracking algorithm for rats in radial arm maze tests

This paper aims to develop a position tracking algorithm by which a rat in a radial arm maze can be accurately located in real time. An infrared (IR) night-vision camera was hung above the maze to capture IR images of the rat. The IR images were binarized and then duplicated for subsequent intersection and opening operations. Due to simple operations and a high robustness against the noise spots formed by the droppings of the rat, it took just minutes to process more than 9000 frames, and an accuracy above 99% was reached as well. The maze was intruded by an experimenter to further test the robustness, and the accuracy slightly fell to 98%. For comparison purposes, the same experiments were carried out using a pre-trained YOLO v2 model. The YOLO counterpart gave an accuracy beyond 97% in the absence and in the presence of the intruder. In other words, this work slightly outperformed the YOLO counterpart in terms of the accuracy in both cases, which indicates the robustness of this work. However, it took the YOLO counterpart an hour or so to locate a rat contained in the frames, which highlights the contribution of this work.

A Multi-defect detection system for sewer pipelines based on StyleGAN-SDM and fusion CNN

With the development of deep learning, convolutional neural networks (CNN) have been gradually used in pipeline defeats detection. However, due to the complex environment inside the pipeline, few defeat images are not enough for the training of CNN. A multi-defect detection system based on StyleGAN-SDM and fusion CNN for sewer pipelines is proposed in this paper. First, aiming at the problem of data acquisition and small data volume, raw images are preprocessed by StyleGAN-SDM, which integrates StyleGAN v2 and sharpness discrimination model (SDM) to generate multi-defect images and automatically select clear images. The indexes of Inception-Residual score (IRS), accuracy and macro-F1 score to evaluate the quality of the images generated are 2.968 ± 0.024, 99.64%, and 0.997, respectively. Second, to improve the detection accuracy, a multi-defect classification model (MDCM) based on fusion CNN, which combines Inception network and Residual network, is proposed to classify the on-site images into four categories. Third, compared with conventional deep-learning methods, the mean accuracy and macro-F1 score of the proposed model reach 95.64% and 0.955, which are increased by 1.51% and 0.015 by StyleGAN-SDM, respectively. Finally, to solve the timeliness problem of on-site detection, a real-time multi-defeat detection system for sewer pipelines is established with the computer vision library of OpenCV. Some on-site videos are detected with the mean speed of 24.11 FPS and these results could aid the staff.

Diagnostic charting of panoramic radiography using deep-learning artificial intelligence system.

The goal of this study was to develop and evaluate the performance of a new deep-learning (DL) artificial intelligence (AI) model for diagnostic charting in panoramic radiography. One thousand eighty-four anonymous dental panoramic radiographs were labeled by two dento-maxillofacial radiologists for ten different dental situations: crown, pontic, root-canal treated tooth, implant, implant-supported crown, impacted tooth, residual root, filling, caries, and dental calculus. AI Model CranioCatch, developed in Eskişehir, Turkey and based on a deep CNN method, was proposed to be evaluated. A Faster R-CNN Inception v2 (COCO) model implemented with the TensorFlow library was used for model development. The assessment of AI model performance was evaluated with sensitivity, precision, and F1 scores. When the performance of the proposed AI model for detecting dental conditions in panoramic radiographs was evaluated, the best sensitivity values were obtained from the crown, implant, and impacted tooth as 0.9674, 0.9615, and 0.9658, respectively. The worst sensitivity values were obtained from the pontic, caries, and dental calculus, as 0.7738, 0.3026, and 0.0934, respectively. The best precision values were obtained from pontic, implant, implant-supported crown as 0.8783, 0.9259, and 0.8947, respectively. The worst precision values were obtained from residual root, caries, and dental calculus, as 0.6764, 0.5096, and 0.1923, respectively. The most successful F1 Scores were obtained from the implant, crown, and implant-supported crown, as 0.9433, 0.9122, and 0.8947, respectively. The proposed AI model has promising results at detecting dental conditions in panoramic radiographs, except for caries and dental calculus. Thanks to the improvement of AI models in all areas of dental radiology, we predict that they will help physicians in panoramic diagnosis and treatment planning, as well as digital-based student education, especially during the pandemic period.

A two-stage model of V2 demonstrates efficient higher-order feature representation

A two-stage model of V2 demonstrates efficient higher-order feature representation

Novel deep learning model for vehicle and pothole detection

The most important aspect of automatic driving and traffic surveillance is vehicle detection. In addition, poor road conditions caused by potholes are the cause of traffic accidents and vehicle damage. The proposed work uses deep learning models. The proposed method can detect vehicles and potholes using images. The faster region-based convolutional neural network (CNN) and the inception network V2 model are used to implement the model. The proposed work compares the performance, accuracy numbers, detection time, and advantages and disadvantages of the faster region-based convolution neural network (Faster R-CNN) with single shot detector (SSD) and you only look once (YOLO) algorithms. The proposed method shows good progress than the existing methods such as SSD and YOLO. The measure of performance evaluation is Accuracy. The proposed method shows an improvement of 5% once compared with the previous methods such as SSD and YOLO.

Report of clinical bone age assessment using deep learning for an Asian population in Taiwan.

IntroductionA deep learning-based automatic bone age identification system (ABAIs) was introduced in medical imaging. This ABAIs enhanced accurate, consistent, and timely clinical diagnostics and enlightened research fields of deep learning and artificial intelligence (AI) in medical imaging.AimThe goal of this study was to use the Deep Neural Network (DNN) model to assess bone age in months based on a database of pediatric left-hand radiographs.MethodsThe Inception Resnet V2 model with a Global Average Pooling layer to connect to a single fully connected layer with one neuron using the Rectified Linear Unit (ReLU) activation function consisted of the DNN model for bone age assessment (BAA) in this study. The medical data in each case contained posterior view of X-ray image of left hand, information of age, gender and weight, and clinical skeletal bone assessment.ResultsA database consisting of 8,061 hand radiographs with their gender and age (0–18 years) as the reference standard was used. The DNN model’s accuracies on the testing set were 77.4%, 95.3%, 99.1% and 99.7% within 0.5, 1, 1.5 and 2 years of the ground truth respectively. The MAE for the study subjects was 0.33 and 0.25 year for male and female models, respectively.ConclusionIn this study, Inception Resnet V2 model was used for automatic interpretation of bone age. The convolutional neural network based on feature extraction has good performance in the bone age regression model, and further improves the accuracy and efficiency of image-based bone age evaluation. This system helps to greatly reduce the burden on clinical personnel.

An artif\u0131cial \u0131ntelligence approach to automatic tooth detection and numbering in panoramic radiographs

BackgroundPanoramic radiography is an imaging method for displaying maxillary and mandibular teeth together with their supporting structures. Panoramic radiography is frequently used in dental imaging due to its relatively low radiation dose, short imaging time, and low burden to the patient. We verified the diagnostic performance of an artificial intelligence (AI) system based on a deep convolutional neural network method to detect and number teeth on panoramic radiographs.MethodsThe data set included 2482 anonymized panoramic radiographs from adults from the archive of Eskisehir Osmangazi University, Faculty of Dentistry, Department of Oral and Maxillofacial Radiology. A Faster R-CNN Inception v2 model was used to develop an AI algorithm (CranioCatch, Eskisehir, Turkey) to automatically detect and number teeth on panoramic radiographs. Human observation and AI methods were compared on a test data set consisting of 249 panoramic radiographs. True positive, false positive, and false negative rates were calculated for each quadrant of the jaws. The sensitivity, precision, and F-measure values were estimated using a confusion matrix.ResultsThe total numbers of true positive, false positive, and false negative results were 6940, 250, and 320 for all quadrants, respectively. Consequently, the estimated sensitivity, precision, and F-measure were 0.9559, 0.9652, and 0.9606, respectively.ConclusionsThe deep convolutional neural network system was successful in detecting and numbering teeth. Clinicians can use AI systems to detect and number teeth on panoramic radiographs, which may eventually replace evaluation by human observers and support decision making.

Computer-Aided Colon Polyp Detection on High Resolution Colonoscopy Using Transfer Learning Techniques.

Colonoscopies reduce the incidence of colorectal cancer through early recognition and resecting of the colon polyps. However, the colon polyp miss detection rate is as high as 26% in conventional colonoscopy. The search for methods to decrease the polyp miss rate is nowadays a paramount task. A number of algorithms or systems have been developed to enhance polyp detection, but few are suitable for real-time detection or classification due to their limited computational ability. Recent studies indicate that the automated colon polyp detection system is developing at an astonishing speed. Real-time detection with classification is still a yet to be explored field. Newer image pattern recognition algorithms with convolutional neuro-network (CNN) transfer learning has shed light on this topic. We proposed a study using real-time colonoscopies with the CNN transfer learning approach. Several multi-class classifiers were trained and mAP ranged from 38% to 49%. Based on an Inception v2 model, a detector adopting a Faster R-CNN was trained. The mAP of the detector was 77%, which was an improvement of 35% compared to the same type of multi-class classifier. Therefore, our results indicated that the polyp detection model could attain a high accuracy, but the polyp type classification still leaves room for improvement.

Research on Pepper External Quality Detection Based on Transfer Learning Integrated with Convolutional Neural Network.

A pepper quality detection and classification model based on transfer learning combined with convolutional neural network is proposed as a solution for low efficiency of manual pepper sorting at the current stage. The pepper dataset was amplified with data pre-processing methods including rotation, luminance switch, and contrast ratio switch. To improve training speed and precision, a network model was optimized with a fine-tuned VGG 16 model in this research, transfer learning was applied after parameter optimization, and comparative analysis was performed by combining ResNet50, MobileNet V2, and GoogLeNet models. It turned out that the VGG 16 model output anticipation precision was 98.14%, and the prediction loss rate was 0.0669 when the dropout was settled as 0.3, learning rate settled as 0.000001, batch normalization added, and ReLU as activation function. Comparing with other finetune models and network models, this model was of better anticipation performance, as well as faster and more stable convergence rate, which embodied the best performance. Considering the basis of transfer learning and integration with strong generalization and fitting capacity of the VGG 16 finetune model, it is feasible to apply this model to the external quality classification of pepper, thus offering technical reference for further realizing the automatic classification of pepper quality.