Mask R-CNN Model Research Articles

Microbial Colony Detection Based on Deep Learning

In clinical drug sensitivity experiments, it is necessary to plate culture pathogenic bacteria and pick suitable colonies for bacterial solution preparation, which is a process that is currently carried out completely by hand. Moreover, the problems of plate contamination, a long culture period, and large image annotation in colony plate image acquisition can lead to a small amount of usable data. To address the issues mentioned above, we adopt a deep learning approach and conduct experiments on the AGAR dataset. We propose to use style transfer to extend the trainable dataset and successfully obtain 4k microbial colony images using this method. In addition, we introduce the Swin Transformer as a feature extraction network in the Cascade Mask R-CNN model architecture to better extract the feature information of the images. After our experimental comparison, the model achieves a mean Average Precision (mAP) of 61.4% at the Intersection over Union (IoU) [0.50:0.95]. This performance surpasses that of the Cascade R-CNN with HRNet, which is the top-performing model in experiments conducted on the AGAR dataset, by a margin of 2.2%. Furthermore, we perform experiments using YOLOv8x on the AGAR dataset, which results in a mAP of 76.7%.

Segmentation and Phenotype Calculation of Rapeseed Pods Based on YOLO v8 and Mask R-Convolution Neural Networks.

Rapeseed is a significant oil crop, and the size and length of its pods affect its productivity. However, manually counting the number of rapeseed pods and measuring the length, width, and area of the pod takes time and effort, especially when there are hundreds of rapeseed resources to be assessed. This work created two state-of-the-art deep learning-based methods to identify rapeseed pods and related pod attributes, which are then implemented in rapeseed pots to improve the accuracy of the rapeseed yield estimate. One of these methods is YOLO v8, and the other is the two-stage model Mask R-CNN based on the framework Detectron2. The YOLO v8n model and the Mask R-CNN model with a Resnet101 backbone in Detectron2 both achieve precision rates exceeding 90%. The recognition results demonstrated that both models perform well when graphic images of rapeseed pods are segmented. In light of this, we developed a coin-based approach for estimating the size of rapeseed pods and tested it on a test dataset made up of nine different species of Brassica napus and one of Brassica campestris L. The correlation coefficients between manual measurement and machine vision measurement of length and width were calculated using statistical methods. The length regression coefficient of both methods was 0.991, and the width regression coefficient was 0.989. In conclusion, for the first time, we utilized deep learning techniques to identify the characteristics of rapeseed pods while concurrently establishing a dataset for rapeseed pods. Our suggested approaches were successful in segmenting and counting rapeseed pods precisely. Our approach offers breeders an effective strategy for digitally analyzing phenotypes and automating the identification and screening process, not only in rapeseed germplasm resources but also in leguminous plants, like soybeans that possess pods.

Automated estimation of stomatal number and aperture in haskap (Lonicera caerulea L.).

This study developed the reliable Mask R-CNN model to detect stomata in Lonicera caerulea. The obtained data could be utilized for evaluating some characters such as stomatal number and aperture area. The native distribution of haskap (Lonicera caerulea L.), a small-shrub species, extends through Northern Eurasia, Japan, and North America. Stomatal observation is important for plant research to evaluate the physiological status and to investigate the effect of ploidy levels on phenotypes. However, manual annotation of stomata using microscope software or ImageJ is time consuming. Therefore, an efficient method to phenotype stomata is needed. In this study, we used the Mask Regional Convolutional Neural Network (Mask R-CNN), a deep learning model, to analyze the stomata of haskap efficiently and accurately. We analyzed haskap plants (dwarf and giant phenotypes) with the same ploidy but different phenotypes, including leaf area, stomatal aperture area, stomatal density, and total number of stomata. The R-square value of the estimated stomatal aperture area was 0.92 and 0.93 for the dwarf and giant plants, respectively. The R-square value of the estimated stomatal number was 0.99 and 0.98 for the two phenotypes. The results showed that the measurements obtained using the models were as accurate as the manual measurements. Statistical analysis revealed that the stomatal density of the dwarf plants was higher than that of the giant plants, but the maximum stomatal aperture area, average stomatal aperture area, total number of stomata, and average leaf area were lower than those of the giant plants. A high-precision, rapid, and large-scale detection method was developed by training the Mask R-CNN model. This model can help save time and increase the volume of data.

Swgan: A new algorithm of adhesive rice image segmentation based on improved generative adversarial networks

Image segmentation is a crucial part in the automatic detection of rice appearance quality. Due to morphological characteristics of rice grains, missed detection and non-smooth boundaries may exist in the image segmentation of adhesive rice. To address the above issues, this study proposes a novel model named Swgan combined generative adversarial networks (GANs) with nested skip connections for obtaining accurate masks. In order to learn the mask distribution of each object in adhesive rice image and further avoid missed detection, the discriminator in GAN is used as a modifier of Cascade Mask R-CNN model to allow the generator to overcome the limitation of mask generation training, namely detecting multiply objects as a single target. Moreover, the Swgan utilizes Swin-Transformer as the backbone network and incorporates the Cascade Mask R-CNN framework and Nested Feature Pyramid Network (Nested-FPN) to maintain the mask’s boundary smoothness during forward propagation. Experimental results indicate that the Swgan is used to obtain better segmentation results from objective detection and segmentation under complex conditions of adhesive rice when compared with state-of-art algorithms. Overall, the Swgan with satisfactory accuracy in image segmentation of adhesive rice combined with physical indicators detection provide reliable quality assessment of rice grains.

Indian traffic sign detection and recognition using deep learning

Traffic signs play a crucial role in managing traffic on the road, disciplining the drivers, thereby preventing injury, property damage, and fatalities. Traffic sign management with automatic detection and recognition is very much part of any Intelligent Transportation System (ITS). In this era of self-driving vehicles, calls for automatic detection and recognition of traffic signs cannot be overstated. This paper presents a deep-learning-based autonomous scheme for cognizance of traffic signs in India. The automatic traffic sign detection and recognition was conceived on a Convolutional Neural Network (CNN)- Refined Mask R-CNN (RM R-CNN)-based end-to-end learning. The proffered concept was appraised via an innovative dataset comprised of 6480 images that constituted 7056 instances of Indian traffic signs grouped into 87 categories. We present several refinements to the Mask R-CNN model both in architecture and data augmentation. We have considered highly challenging Indian traffic sign categories which are not yet reported in previous works. The dataset for training and testing of the proposed model is obtained by capturing images in real-time on Indian roads. The evaluation results indicate lower than 3% error. Furthermore, RM R-CNN’s performance was compared with the conventional deep neural network architectures such as Fast R-CNN and Mask R-CNN. Our proposed model achieved precision of 97.08% which is higher than precision obtained by Mask R-CNN and Faster R-CNN models.

A comparison of two CNN-based instrument detection approaches for automated surgical assistance systems

Abstract The shortage of operating room technicians has led to a growing demand for automated systems in the OR to maintain the quality of care. Robotic scrub nurse (RSN) systems are increasingly being developed, which perform tasks such as handling instruments and documenting the surgery. While research has focused on detecting instruments in the hands of surgical staff or recognizing surgical phases, there is a lack of research on detecting instruments on the instrument tray. Therefore, this study proposes and evaluates two distinct methodologies for instrument detection on the OR table using the deep learning approaches YOLOv5 and Mask R-CNN. The performance of the two approaches has been evaluated on 18 YOLOv5 models and twelve Mask R-CNN models, mainly differing in model size. Two sets of instruments were used to assess generalizability of the models. The results show a mean average precision (mAP) score of 0.978 for YOLOv5 and 0.846 for Mask R-CNN on the test dataset comprising three classes. An mAP of 0.874 and 0.707 have been computed respectively for the test dataset including six classes. The study provides a comparison of the performance of two suitable approaches for instrument detection on the instrument tray in the OR to enhance the development of RSN systems.

FishSeg: 3D Fish Tracking Using Mask R-CNN in Large Ethohydraulic Flumes

To study the fish behavioral response to up- and downstream fish passage structures, live-fish tests are conducted in large flumes in various laboratories around the world. The use of multiple fisheye cameras to cover the full width and length of a flume, low color contrast between fish and flume bottom and non-uniform illumination leading to fish shadows, air bubbles wrongly identified as fish as well as fish being partially hidden behind each other are the main challenges for video-based fish tracking. This study improves an existing open-source fish tracking code to better address these issues by using a modified Mask Regional-Convolutional Neural Network (Mask R-CNN) as a tracking method. The developed workflow, FishSeg, consists of four parts: (1) stereo camera calibration, (2) background subtraction, (3) multi-fish tracking using Mask R-CNN, and (4) 3D conversion to flume coordinates. The Mask R-CNN model was trained and validated with datasets manually annotated from background subtracted videos from the live-fish tests. Brown trout and European eel were selected as target fish species to evaluate the performance of FishSeg with different types of body shapes and sizes. Comparison with the previous method illustrates that the tracks generated by FishSeg are about three times more continuous with higher accuracy. Furthermore, the code runs more stable since fish shadows and air bubbles are not misidentified as fish. The trout and eel models produced from FishSeg have mean Average Precisions (mAPs) of 0.837 and 0.876, respectively. Comparisons of mAPs with other R-CNN-based models show the reliability of FishSeg with a small training dataset. FishSeg is a ready-to-use open-source code for tracking any fish species with similar body shapes as trout and eel, and further fish shapes can be added with moderate effort. The generated fish tracks allow researchers to analyze the fish behavior in detail, even in large experimental facilities.

Non-destructive detection of single-seed viability in maize using hyperspectral imaging technology and multi-scale 3D convolutional neural network.

The viability of Zea mays seed plays a critical role in determining the yield of corn. Therefore, developing a fast and non-destructive method is essential for rapid and large-scale seed viability detection and is of great significance for agriculture, breeding, and germplasm preservation. In this study, hyperspectral imaging (HSI) technology was used to obtain images and spectral information of maize seeds with different aging stages. To reduce data input and improve model detection speed while obtaining more stable prediction results, successive projections algorithm (SPA) was used to extract key wavelengths that characterize seed viability, then key wavelength images of maize seed were divided into small blocks with 5 pixels ×5 pixels and fed into a multi-scale 3D convolutional neural network (3DCNN) for further optimizing the discrimination possibility of single-seed viability. The final discriminant result of single-seed viability was determined by comprehensively evaluating the result of all small blocks belonging to the same seed with the voting algorithm. The results showed that the multi-scale 3DCNN model achieved an accuracy of 90.67% for the discrimination of single-seed viability on the test set. Furthermore, an effort to reduce labor and avoid the misclassification caused by human subjective factors, a YOLOv7 model and a Mask R-CNN model were constructed respectively for germination judgment and bud length detection in this study, the result showed that mean average precision (mAP) of YOLOv7 model could reach 99.7%, and the determination coefficient of Mask R-CNN model was 0.98. Overall, this study provided a feasible solution for detecting maize seed viability using HSI technology and multi-scale 3DCNN, which was crucial for large-scale screening of viable seeds. This study provided theoretical support for improving planting quality and crop yield.

Multi-Parameter Health Assessment of Jujube Trees Based on Unmanned Aerial Vehicle Hyperspectral Remote Sensing

To address the current difficult problem of scientifically assessing the health status of date palm trees due to a single parameter for date palm health assessment, an imperfect index system, and low precision. In this paper, using jujube trees in 224 regiment of the 14th division of Xinjiang Production and Construction Corps “Kunyu city” as the research object, we carried out the inversion study of various physicochemical parameters of jujube trees (canopy chlorophyll content, leaf area index (LAI), tree height, canopy area) using the unmanned aerial vehicle (UAV) hyperspectral imagery of jujube trees during the period of fruit expansion, and put forward a model for assessing the health of jujube trees based on multiple physicochemical parameters. First, we calculated six spectral indices for inversion of chlorophyll content and four spectral index for inversion of LAI, analyzed the spectral index with high correlation with chlorophyll content and LAI of jujube trees canopy, and constructed the inversion models of chlorophyll content and LAI. Second, the Mask R-CNN model was used to achieve jujube trees’ canopy segmentation and area extraction, and the segmented canopy was matched with the Canopy Height Model (CHM) for jujube trees’ height extraction. Finally, based on the four physicochemical parameters of inversion, we construct four jujube trees’ health assessment models, namely, Partial Least Squares Regression Analysis (PLSR), Random Forest (RF), Support Vector Machines (SVM), and Decision Tree (DT). The results showed that the R2 of the PLSR tree health assessment model constructed based on the multi-physical and chemical parameters of chlorophyll content, LAI, tree height, and canopy area was 0.853, and the RMSE was 0.3. Compared with the jujube trees’ health assessment models constructed by RF, SVM, and DT, the R2 increased by 0.127, 0.386, and 0.165, and the RMSE decreased by 0.04, 0.175, and 0.063, respectively. This paper can achieve rapid and accurate inversion of multi-physical and chemical parameters of jujube trees with the help of UAV hyperspectral images, and the PLSR model constructed based on multi-physical and chemical parameters can accurately assess the health status of jujube trees and provide a reference for a scientific and reasonable assessment of jujube trees’ health.

Extraction of Pine Wilt Disease Regions Using UAV RGB Imagery and Improved Mask R-CNN Models Fused with ConvNeXt

Pine wilt disease (PWD) is one of the most concerning diseases in forestry and poses a considerable threat to forests. Since the deep learning approach can interpret the raw images acquired by UAVs, it provides an effective means for forest health detection. However, the fact that only PWD can be detected but not the degree of infection can be evaluated hinders forest management, so it is necessary to establish an effective method to accurately detect PWD and extract regions infected by PWD. Therefore, a Mask R-CNN-based PWD detection and extraction algorithm is proposed in this paper. Firstly, the extraction of image features is improved by using the advanced ConvNeXt network. Then, it is proposed to change the original multi-scale structure to PA-FPN and normalize it by using GN and WS methods, which effectively enhances the data exchange between the bottom and top layers under low Batch-size training. Finally, a branch is added to the Mask module to improve the ability to extract objects using fusion. In addition, a PWD region extraction module is proposed in this paper for evaluating the damage caused by PWD. The experimental results show that the improved method proposed in this paper can achieve 91.9% recognition precision, 90.2% mapping precision, and 89.3% recognition rate of the affected regions on the PWD dataset. It can effectively identify the distribution of diseased pine trees and calculate the damage proportion in a relatively accurate way to facilitate the management of forests.

Deep learning-based high-throughput detection of in vitro germination to assess pollen viability from microscopic images.

In vitro pollen germination is considered the most efficient method to assess pollen viability. The pollen germination frequency and pollen tube length, which are key indicators of pollen viability, should be accurately measured during in vitro culture. In this study, a Mask R-CNN model trained using microscopic images of tree peony (Paeonia suffruticosa) pollen has been proposed to rapidly detect the pollen germination rate and pollen tube length. To reduce the workload during image acquisition, images of synthesized crossed pollen tubes were added to the training dataset, significantly improving the model accuracy in recognizing crossed pollen tubes. At an Intersection over Union threshold of 50%, a mean average precision of 0.949 was achieved. The performance of the model was verified using 120 testing images. The R2 value of the linear regression model using detected pollen germination frequency against the ground truth was 0.909 and that using average pollen tube length was 0.958. Further, the model was successfully applied to two other plant species, indicating a good generalizability and potential to be applied widely.

Instance Segmentation of Lotus Pods and Stalks in Unstructured Planting Environment Based on Improved YOLOv5

Accurate segmentation of lotus pods and stalks with pose variability is a prerequisite for realizing the robotic harvesting of lotus pods. However, the complex growth environment of lotus pods causes great difficulties in conducting the above task. In this study, an instance segmentation model, LPSS-YOLOv5, for lotus pods and stalks based on the latest YOLOv5 v7.0 instance segmentation model was proposed. The CBAM attention mechanism was integrated into the network to improve the model’s feature extraction ability. The scale distribution of the multi-scale feature layer was adjusted, a 160 × 160 small-scale detection layer was added, and the original 20 × 20 large-scale detection layer was removed, which improved the model’s segmentation accuracy for small-scale lotus stalks and reduced the model size. On the medium-large scale test set, LPSS-YOLOv5 achieved a mask mAP0.5 of 99.3% for all classes. On the small-scale test set, the mAP0.5 for all classes and AP0.5 for stalks were 88.8% and 83.3%, which were 2.6% and 5.0% higher than the baseline, respectively. Compared with the mainstream Mask R-CNN and YOLACT models, LPSS-YOLOv5 showed a much higher segmentation accuracy, speed, and smaller size. The 2D and 3D localization tests verified that LPSS-YOLOv5 could effectively support the picking point localization and the pod–stalk affiliation confirmation.

Improving instrument detection for a robotic scrub nurse using multi-view voting

PurposeA basic task of a robotic scrub nurse is surgical instrument detection. Deep learning techniques could potentially address this task; nevertheless, their performance is subject to some degree of error, which could render them unsuitable for real-world applications. In this work, we aim to demonstrate how the combination of a trained instrument detector with an instance-based voting scheme that considers several frames and viewpoints is enough to guarantee a strong improvement in the instrument detection task.MethodsWe exploit the typical setup of a robotic scrub nurse to collect RGB data and point clouds from different viewpoints. Using trained Mask R-CNN models, we obtain predictions from each view. We propose a multi-view voting scheme based on predicted instances that combines the gathered data and predictions to produce a reliable map of the location of the instruments in the scene.ResultsOur approach reduces the number of errors by more than 82% compared with the single-view case. On average, the data from five viewpoints are sufficient to infer the correct instrument arrangement with our best model.ConclusionOur approach can drastically improve an instrument detector’s performance. Our method is practical and can be applied during an actual medical procedure without negatively affecting the surgical workflow. Our implementation and data are made available for the scientific community (https://github.com/Jorebs/Multi-view-Voting-Scheme).

Cassava stalk detection for a cassava harvesting robot based on YOLO v4 and Mask R-CNN

The quality of fresh cassava roots can be increased through the use of precision equipment. As a first step towards developing an automatic cassava root cutting system, this study demonstrates the use of a computer vision system with deep learning for cassava stalk detection. An RGB image of a cassava tree mounted on a cassava-pulling machine was captured, and the YOLO v4 model and two Mask R-CNN models with ResNet 101 and ResNet 50 base architectures were employed to train the weights to predict the position of the cassava stalk. One hundred test images of stalks of various shapes and sizes were used to determine the grasping point and inclination, and the results from manual annotation were compared with the predicted results. Regarding localisation, Mask R-CNN with ResNet 101 gave a significantly higher performance than the other models, with an F1 score and a mean IoU of 0.81 and 0.70, respectively. YOLO v4 showed the highest correlation for the x- and y-coordinates for the prediction of the grasping point, with values for R2 of 0.89 and 0.53, respectively. For inclination prediction, Mask R-CNN with ResNet 101 and Mask R-CNN with ResNet 50 gave the same level of correlation, with values for R2 of 0.50 and 0.61, respectively. These results were acceptable for use as design criteria for developing a cassava rootcutting robot.

A boundary optimization model of instance segmentation combined with wavelet transform on Buildings

Data driven deep learning methods have become the mainstream method of building extraction from remote sensing images. In this paper, deep learning algorithm is used to classify and extract buildings from remote sensing images of rural areas around the Great Wall in the suburbs of Beijing captured by unmanned aerial vehicles. Aiming at the shortcomings of the current mainstream instance segmentation algorithm Mask R-CNN in feature fusion and poor prediction of instance mask boundaries, this paper proposes a boundary optimization algorithm for building instance segmentation based on discrete wavelet transform. Firstly, the discrete wavelet transform is introduced into the segmentation task branch of Mask R-CNN algorithm to extract the low-frequency and high-frequency information of the real mask, in which the high-frequency information includes the boundary information. Secondly, the pixel by pixel prediction of the mask turns into the learning of the low-frequency and high-frequency information of the real mask. The learning of the high-frequency information helps the segmentation network to learn the boundary features better. Finally, using the reversibility of discrete wavelet transform, the low-frequency and high-frequency information of the learned mask is inversely transformed to reconstruct the final mask. The improved algorithm is evaluated on the dataset COCO, and applied to the automatic extraction of buildings. The DWT Mask R-CNN algorithm model achieved 70.2% segmentation accuracy and 71.4% detection accuracy, which were improved by 1% and 0.7% respectively compared with the Mask R-CNN and Cascade Mask R-CNN models. The experimental results show that the instance segmentation edge optimization algorithm combined with wavelet transform has achieved better results on the segmentation boundary, improved the poor effect of mask edge detection and achieved higher detection accuracy, and can accurately extract village buildings.

Prostate cancer of magnetic resonance imaging automatic segmentation and detection of based on 3D-Mask RCNN

BackgroundProstate cancer is a widespread form of cancer that impacts men across the world. MRI plays a pivotal role in the detection and precise localization of cancerous regions, aiding medical professionals in devising effective treatment strategies for patients. As a result, MRI is often used in the diagnosis of prostate cancer. PurposeOur proposed method employs deep learning to achieve automatic segmentation and detection of prostate cancer in MRI single series, particularly T2-weighted imaging (T2WI). Materials and methodsOur study utilized data from 133 patients at a hospital, consisting of 71 cases of prostate cancer and 62 cases of benign prostatic tumors. We employed T2-weighted imaging (T2WI) MRI single series from 93 prostates as the training set for our 3D-Mask RCNN model, while the remaining data from 40 prostates were used for validation. The masks were manually delineated by an experienced radiologist, with pathology serving as the reference standard. Our approach was evaluated using several metrics, such as dice similarity coefficient (DSC), accuracy, sensitivity, specificity, and receiver operating characteristic (ROC) curve analysis. ResultsOur study produced promising results using the 3D Mask R-CNN model. The training set yielded a DSC score of 0.856, sensitivity of 0.921, and specificity of 0.961. The test set was also successful, with a DSC score of 0.849, sensitivity of 0.911, and specificity of 0.931. Furthermore, our model achieved an AUC value of 0.865 and an accuracy, sensitivity, and specificity of 0.866, 0.875, and 0.835, respectively, for the training set. The test set had an AUC value of 0.842 and an accuracy, sensitivity, and specificity of 0.836, 0.847, and 0.819, respectively. These findings demonstrate that our approach is capable of accurately detecting and segmenting prostate cancer in MRI single series - T2WI. ConclusionThe use of the 3D-Mask RCNN model in segmenting prostate tumors and detecting cancer in MRI T2WI has been shown to be highly effective and precise. This approach has the potential to greatly benefit radiologists by improving the accuracy and efficiency of diagnoses, leading to more effective treatment planning for patients with prostate cancer. By automating the segmentation process, this approach can also reduce the workload of radiologists and increase the consistency of diagnoses. The high performance of this model highlights the potential of deep learning techniques in medical imaging and demonstrates the significant impact that these approaches can have on improving patient outcomes.

DEEP LEARNING FOR SEGMENTATION AND COUNTING OF WHITE BLOOD CELLS IN CLINICAL DIAGNOSIS

In the field of cytopathology, the accurate identification and counting of white blood cells (WBCs) in blood smears is crucial for diagnosing various types of cancer. The process of manually detecting and segmenting these structures, however, can be challenging due to their variable morphologies and the presence of overlapping objects in the images. This makes manual detection time-consuming, labor-intensive, and prone to error, particularly for individuals without extensive experience in cytopathology. In this paper, a deep learning algorithm is developed based on a Mask R-CNN model and driven by a sub-algorithm called KOWN (Keep Only White Blood Cells with Nuclei) for WBC segmentation and counting. The proposed algorithm improves the accuracy of measurements compared to other rapidly growing deep learning works, providing maximum precision in detecting and counting WBCs in both low- and high-blood-cell-density images.

Automated Detection and Scoring of Tumor-Infiltrating Lymphocytes in Breast Cancer Histopathology Slides.

Detection of tumor-infiltrating lymphocytes (TILs) in cancer images has gained significant importance as these lymphocytes can be used as a biomarker in cancer detection and treatment procedures. Our goal was to develop and apply a TILs detection tool that utilizes deep learning models, following two sequential steps. First, based on the guidelines from the International Immuno-Oncology Biomarker Working Group (IIOBWG) on Breast Cancer, we labeled 63 large pathology imaging slides and annotated the TILs in the stroma area to create the dataset required for model development. In the second step, various machine learning models were employed and trained to detect the stroma where U-Net deep learning structure was able to achieve 98% accuracy. After detecting the stroma area, a Mask R-CNN model was employed for the TILs detection task. The R-CNN model detected the TILs in various images and was used as the backbone analysis network for the GUI development of the TILs detection tool. This is the first study to combine two deep learning models for TILs detection at the cellular level in breast tumor histopathology slides. Our novel approach can be applied to scoring TILs in large cancer slides. Statistical analysis showed that the output of the implemented approach had 95% concordance with the scores assigned by the pathologists, with a p-value of 0.045 (n = 63). This demonstrated that the results from the developed software were statistically meaningful and highly accurate. The implemented approach in analyzing whole tumor histology slides and the newly developed TILs detection tool can be used for research purposes in biomedical and pathology applications and it can provide researchers and clinicians with the TIL score for various input images. Future research using additional breast cancer slides from various sources for further training and validation of the developed models is necessary for more inclusive, rigorous, and robust clinical applications.

Optimized Matrix Feature Analysis – Convolutional Neural Network (OMFA-CNN) Model for Potato Leaf Diseases Detection System

One of the most often grown crops is the potato. As a main food, potatoes are prioritised for cultivation worldwide. Because potatoes are such a rich source of vitamins and minerals, we can create a robust system for food security. However, a number of illnesses delay the growth of agriculture and harm potato output. Consequently, early disease identification can offer a better answer for effective crop production. In this research work aim is to classify and detect the potato leave (PL) diseases using OMFA-CNN deep learning model. An optimized matrix feature analysis-CNN deep learning model for PL disease detection is implemented. In the first phase, the PLs features are extracted from the potato leave images using K-means clustering image segmentation method. At the last phase, a new OMFA-CNN model are proposed using CNN to classify virus, and bacterial diseases of PLs, The PL disease dataset consists 2351 images gathered in real-time and from the Kaggle (PlantVillage) dataset. The implemented OMFA-CNN model attained 99.3 % precision and 99 % recall on potato disease detection. The implemented method is also compared with MASK RCNN,SVM and other models and attained significantly high precision and recall.

Cementron: Machine learning the alite and belite phases in cement clinker from optical images

The performance of cement hydrate depends on constituent phases, viz., alite, belite, aluminate, and ferrites present in cement clinker. Traditionally, clinker phases are analyzed from the optical image using empirical image processing techniques. However, the non-uniformity of images, variations in geometry, size of phases, experimental approaches, and imaging methods make it challenging to identify individual phases. Here, we present a machine learning (ML) approach to automatically and accurately detect the major clinker microstructure phases, namely, alite and belite, from optical microscopy images. To this extent, we create an annotated dataset of cement clinker by manually labelling alite and belite phases in microscopy images. We then demonstrate the use of supervised ML methods to train models for identifying alite and belite regions by using a small fraction of annotations on a single image. Further, we finetune the image detection and segmentation Mask R-CNN model using Detectron-2 by considering all the annotated images of the cement microstructure to develop a model for detecting cement phases, namely, Cementron. We demonstrate that Cementron, trained on literature data, generalized well on completely new data obtained from in-house experiments, demonstrating its wider applicability.