Learning Approach Research Articles

Application of Response Surface Methodology and Machine Learning Approaches to Predict Porosity and Compression Strength of Selective Laser-Sintered Polyamide-12 Scaffold Parts

Application of Response Surface Methodology and Machine Learning Approaches to Predict Porosity and Compression Strength of Selective Laser-Sintered Polyamide-12 Scaffold Parts

Radiometric Infrared Thermography of Solar Photovoltaic Systems: An Explainable Predictive Maintenance Approach for Remote Aerial Diagnostic Monitoring

Solar photovoltaic (SPV) arrays are crucial components of clean and sustainable energy infrastructure. However, SPV panels are susceptible to thermal degradation defects that can impact their performance, thereby necessitating timely and accurate fault detection to maintain optimal energy generation. The considered case study focuses on an intelligent fault detection and diagnosis (IFDD) system for the analysis of radiometric infrared thermography (IRT) of SPV arrays in a predictive maintenance setting, enabling remote inspection and diagnostic monitoring of the SPV power plant sites. The proposed IFDD system employs a custom-developed deep learning approach which relies on convolutional neural networks for effective multiclass classification of defect types. The diagnosis of SPV panels is a challenging task for issues such as IRT data scarcity, defect-patterns’ complexity, and low thermal image acquisition quality due to noise and calibration issues. Hence, this research carefully prepares a customized high-quality but severely imbalanced six-class thermographic radiometric dataset of SPV panels. With respect to previous approaches, numerical temperature values in floating-point are used to train and validate the predictive models. The trained models display high accuracy for efficient thermal anomaly diagnosis. Finally, to create a trust in the IFDD system, the process underlying the classification model is investigated with perceptive explainability, for portraying the most discriminant image features, and mathematical-structure-based interpretability, to achieve multiclass feature clustering.

A real-time traffic sign detection in intelligent transportation system using YOLOv8-based deep learning approach

A real-time traffic sign detection in intelligent transportation system using YOLOv8-based deep learning approach

Training Vehicle Detection and Classification Models with Less Data: An Active Learning Approach

The application of computer vision in transportation engineering has facilitated real-time traffic flow optimization, vehicle counting, anomaly detection, and ameliorated transportation safety. Most vision systems are, however, developed through a supervised learning process, which can be data hungry and costly because it requires manual annotation of objects from a variety of sources. The general rule of thumb for building accurate and transferrable vision models has been to increase the quality, diversity, and quantity of the annotated datasets used in model training. This paper presents a simple, yet efficient active learning framework that significantly reduces the number of annotations needed to build a state-of-the-art vehicle detection and classification model. To achieve this, we first leverage a vision transformer that generates embeddings rich with information needed to quantify the similarity and diversity between images in a two-dimensional embedding space. To select which images from the embedding space should be annotated, we propose a scoring and sampling strategy that minimizes class imbalance and model uncertainty through an iterative process. The latest iteration of the You Only Look Once (YOLO) model, YOLOv8, is used as the active learner. We compare the efficacy of our proposed active learning methods with models developed at much higher sampling rates using the mean average precision. The models developed were also integrated with tracking algorithms to evaluate differences in accuracy for vehicle counts and their practical implications for direction counts.

Enhancing Water treatment predictions: a Machine Learning Approach with CNN and Water Wave optimization

Enhancing Water treatment predictions: a Machine Learning Approach with CNN and Water Wave optimization

Advancing rapid urban flood prediction: a spatiotemporal deep learning approach with uneven rainfall and attention mechanism

ABSTRACT Urban floods pose a significant threat to human communities, making its prediction essential for comprehensive flood risk assessment and the formulation of effective resource allocation strategies. Data-driven deep learning approaches have gained traction in urban emergency flood prediction, addressing the efficiency constraints of physical models. However, the spatial structure of rainfall, which has a profound influence on urban flooding, is often overlooked in many deep learning investigations. In this study, we introduce a novel deep learning model known as CRU-Net equipped with an attention mechanism to predict inundation depths in urban terrains based on spatiotemporal rainfall patterns. This method utilizes eight topographic parameters related to the height of urban waterlogging, combined with spatial rainfall data as inputs to the model. Comparative evaluations between the developed CRU-Net and two other deep learning models, U-Net and ResU-Net, reveal that CRU-Net adeptly interprets the spatiotemporal traits of rainfall and accurately estimates flood depths, emphasizing deep inundation and flood-vulnerable regions. The model demonstrates exceptional accuracy, evidenced by a root mean square error of 0.054 m and a Nash–Sutcliffe efficiency of 0.975. CRU-Net also accurately predicts over 80% of inundation locations with depths exceeding 0.3 m. Remarkably, CRU-Net delivers predictions for 3 million grids in 2.9 s, showcasing its efficiency.

Advanced detection and localization of open circuit faults in two-level three-phase IGBT-based inverters using machine learning approaches and discrete wavelet transform

Advanced detection and localization of open circuit faults in two-level three-phase IGBT-based inverters using machine learning approaches and discrete wavelet transform

Impact of functional electrical stimulation on nerve-damaged muscles by quantifying fat infiltration using deep learning.

Quantitative imaging in life sciences has evolved into a powerful approach combining advanced microscopy acquisition and automated analysis of image data. The focus of the present study is on the imaging-based evaluation of the posterior cricoarytenoid muscle (PCA) influenced by long-term functional electrical stimulation (FES), which may assist the inspiration of patients with bilateral vocal fold paresis. To this end, muscle cross-sections of the PCA of sheep were examined by quantitative image analysis. Previous investigations of the muscle fibers and the collagen amount have not revealed signs of atrophy and fibrosis due to FES by a laryngeal pacemaker. It was therefore hypothesized that regardless of the stimulation parameters the fat in the muscle cross-sections would not be significantly altered. We here extending our previous investigations using quantitative imaging of intramuscular fat in cross-sections. In order to perform this analysis both reliably and faster than a qualitative evaluation and time-consuming manual annotation, the selection of the automated method was of crucial importance. To this end, our recently established deep neural network IMFSegNet, which provides more accurate results compared to standard machine learning approaches, was applied to more than 300 H&E stained muscle cross-sections from 22 sheep. It was found that there were no significant differences in the amount of intramuscular fat between the PCA with and without long-term FES, nor were any significant differences found between the low and high duty cycle stimulated groups. This study on a human-like animal model not only confirms the hypothesis that FES with the selected parameters has no negative impact on the PCA, but also demonstrates that objective and automated deep learning-based quantitative imaging is a powerful tool for such a challenging analysis.

An efficient computational framework for gastrointestinal disorder prediction using attention-based transfer learning

Diagnosing gastrointestinal (GI) disorders, which affect parts of the digestive system such as the stomach and intestines, can be difficult even for experienced gastroenterologists due to the variety of ways these conditions present. Early diagnosis is critical for successful treatment, but the review process is time-consuming and labor-intensive. Computer-aided diagnostic (CAD) methods provide a solution by automating diagnosis, saving time, reducing workload, and lowering the likelihood of missing critical signs. In recent years, machine learning and deep learning approaches have been used to develop many CAD systems to address this issue. However, existing systems need to be improved for better safety and reliability on larger datasets before they can be used in medical diagnostics. In our study, we developed an effective CAD system for classifying eight types of GI images by combining transfer learning with an attention mechanism. Our experimental results show that ConvNeXt is an effective pre-trained network for feature extraction, and ConvNeXt+Attention (our proposed method) is a robust CAD system that outperforms other cutting-edge approaches. Our proposed method had an area under the receiver operating characteristic curve of 0.9997 and an area under the precision-recall curve of 0.9973, indicating excellent performance. The conclusion regarding the effectiveness of the system was also supported by the values of other evaluation metrics.

Defence against Side-Channel Attacks for Encrypted Network Communication Using Multiple Paths

As more network communication is encrypted to provide data privacy for users, attackers are focusing their attention on traffic analysis methods for side-channel attacks on user privacy. These attacks exploit patterns in particular features of communication flows such as interpacket timings and packet sizes. Unsupervised machine learning approaches, such as Hidden Markov Models (HMMs), can be trained on unlabelled data to estimate these flow attributes from an exposed packet flow, even one that is encrypted, so it is highly feasible for an eavesdropper to perform this attack. Traditional defences try to protect specific side channels by modifying the packet transmission for the flow, e.g., by adding redundant information (padding of packets or use of junk packets) and perturbing packet timings (e.g., artificially delaying packet transmission at the sender). Such defences incur significant overhead and impact application-level performance metrics, such as latency, throughput, end-to-end delay, and jitter. Furthermore, these mechanisms can be complex, often ineffective, and are not general solutions—a new profile must be created for every application, which is an infeasible expectation to place on software developers. We show that an approach exploiting multipath communication can be effective against HMM-based traffic analysis. After presenting the core analytical background, we demonstrate the efficacy of this approach with a number of diverse, simulated traffic flows. Based on the results, we define some simple design rules for software developers to adopt in order to exploit the mechanism we describe, including a critical examination of existing communication protocol behavior.

Implementation Paper on Automated 2D Image to 3D Model Generation

With the rise of digital world, traditional learning methods, while time-tested, often fall short in meeting the dynamic educational needs of today’s learners. They are constrained by several drawbacks that impede effective comprehension and engagement. This abstract sheds light on the limitations of traditional learning approaches and introduces how the integration of 3D model reconstruction can mitigate these challenges, thereby enhancing the learning experience. We proposed deep Conventional techniques, which create a virtual view from a reference picture, use two distinct steps: depth image-based rendering (DIBR) with estimated depth and depth (or disparity) estimation for the reference image and based on these steps we can create 3D model. Which allows educators to create immersive and interactive learning environments that engage students on a profound level. By converting abstract concepts into tangible and visually stimulating representations, 3D models bridge the gap between theory and practice, making complex subjects more accessible. Keywords: 2D Image, 3D Model, CNN, DIBR

Agricultural land use modeling and climate change adaptation: A reinforcement learning approach

AbstractThis paper provides a novel approach to integrate farmers' behavior in spatially explicit agricultural land use modeling to investigate climate change adaptation strategies. More specifically, we develop and apply a computationally efficient machine learning approach based on reinforcement learning to simulate the adoption of agroforestry practices. Using data from an economic experiment with crop farmers in Southeast Germany, our results show that a change in climate, market, and policy conditions shifts the spatial distribution of the uptake of agroforestry systems. Our modeling approach can be used to advance currently used models for ex ante policy analysis by upscaling existing knowledge about farmers behavioral characteristics and combine it with spatially explicit environmental and farm structural data. The approach presents a potential solution for researchers who aim to upscale information, potentially enriching and complementing existing land use modeling approaches.

Enabling social approaches for contextualised learning at primary schools

Through a project undertaken under a programme funded by United Kingdom Research and Innovation (UKRI) called Transforming Education for Sustainable Futures (TESF), alternative learning approaches associated with the introduction of a form of vertical farming called ‘tower gardens’ at primary schools were explored. Methods that were new to the local education context were used to support the learning process, for example role-playing sketches that allowed learners to share their own knowledge about gardening activities with their peers, teachers and staff from the non-governmental organisation that facilitated the process. This collective sharing and recall were key elements of the social learning process, building into individual and group knowledge. Corroborated memory recall contributed to group learning and also built into the collective storage of knowledge. Learning was firmly embedded in social interaction, in collective symbolism and arts – music specifically. These forms of learning and storing of knowledge resonated with the learners as it was a continuation of life as they know it in their community. It became clear from the project that educators saw the value of introducing concepts from classroom subjects when constructing and managing the tower gardens and were pleasantly surprised by the responses of the learners to this new way of learning, suggesting that creating scope within the curriculum and schoolwork plan is necessary in tandem with building the required capacity to replicate this without external support.

A strategic framework for optimal decisions in football 1-vs-1 shot-taking situations: an integrated approach of machine learning, theory-based modeling, and game theory

A strategic framework for optimal decisions in football 1-vs-1 shot-taking situations: an integrated approach of machine learning, theory-based modeling, and game theory

Prediction of Positive Patient Health Questionnaire-2 Screening Using Area Deprivation Index in Primary Care.

Depression is recognized as a significant public health issue in the United States. The National Survey on Drug Use and Health reports that 21.0 million adults aged 18 or older had major depressive disorder in 2020, including 14.8 million experiencing a major depressive episode with severe impairment. The aim is to predict the positivity of Patient Health Questionnaire-2 (PHQ-2) outcomes among patients in primary care settings by analyzing a range of variables, including socioeconomic status, demographic characteristics, and health behaviors, thereby identifying those at increased risk for depression. Employing a machine learning approach, the study utilizes retrospective data from electronic health records across 15 primary care clinics in South Florida to explore the relationship between social determinants of health (SDoH), including area of deprivation index (ADI) and PHQ-2 positivity. The study encompasses 15 primary care clinics located in South Florida, where a diverse patient population receives care. Analysis included 94,572 patient visits; 74,636 records were included in the study. If a zip+4 was not available or an ADI score did not exist, the visit was not included in the final analysis. Screening involved the PHQ-2, assessing depressed mood and anhedonia, with a cutoff >2 indicating positive screening. ADI was used to assess SDoH by matching patients' residential postal codes to ADI national percentiles. Demographics, sexual history, tobacco use, caffeine intake, and community involvement were also evaluated in the study. Over 40 machine learning algorithms were explored for their accuracy in predicting PHQ-2 outcomes, using software tools including Scikit-learn and stats models in Python. Variables were normalized, scored, and then subjected to predictive regression models, with Random Forest showing outstanding performance. Feature engineering and correlation analysis identified ADI, age, education, visit type, coffee intake, and marital status as significant predictors of PHQ-2 positivity. The area under the curve and model accuracies varied across clinics, with specific clinics showing higher predictive accuracy and others (p > .05). The study concludes that the ADI, as a proxy for SDoH, alongside other individual factors, can predict PHQ-2 positivity. Health organizations can use this information to anticipate health needs and resource allocation.

A non-invasive preoperative prediction model for predicting axillary lymph node metastasis in breast cancer based on a machine learning approach: combining ultrasonographic parameters and breast gamma specific imaging features.

The most common route of breast cancer metastasis is through the mammary lymphatic network. An accurate assessment of the axillary lymph node (ALN) burden before surgery can avoid unnecessary axillary surgery, consequently preventing surgical complications. In this study, we aimed to develop a non-invasive prediction model incorporating breast specific gamma image (BSGI) features and ultrasonographic parameters to assess axillary lymph node status. Cohorts of breast cancer patients who underwent surgery between 2012 and 2021 were created (The training set included 1104 ultrasound images and 940 BSGI images from 235 patients, the test set included 568 ultrasound images and 296 BSGI images from 99 patients) for the development of the prediction model. six machine learning (ML) methods and recursive feature elimination were trained in the training set to create a strong prediction model. Based on the best-performing model, we created an online calculator that can make a linear predictor in patients easily accessible to clinicians. The receiver operating characteristic (ROC) and calibration curve are used to verify the model performance respectively and evaluate the clinical effectiveness of the model. Six ultrasonographic parameters (transverse diameter of tumour, longitudinal diameter of tumour, lymphatic echogenicity, transverse diameter of lymph nodes, longitudinal diameter of lymph nodes, lymphatic color Doppler flow imaging grade) and one BSGI features (axillary mass status) were selected based on the best-performing model. In the test set, the support vector machines' model showed the best predictive ability (AUC = 0.794, sensitivity = 0.641, specificity = 0.8, PPV = 0.676, NPV = 0.774 and accuracy = 0.737). An online calculator was established for clinicians to predict patients' risk of ALN metastasis ( https://wuqian.shinyapps.io/shinybsgi/ ). The result in ROC showed the model could benefit from incorporating BSGI feature. This study developed a non-invasive prediction model that incorporates variables using ML method and serves to clinically predict ALN metastasis and help in selection of the appropriate treatment option.

Predicting who has delayed cerebral ischemia after aneurysmal subarachnoid hemorrhage using machine learning approach: a multicenter, retrospective cohort study.

Early prediction of delayed cerebral ischemia (DCI) is critical to improving the prognosis of aneurysmal subarachnoid hemorrhage (aSAH). Machine learning (ML) algorithms can learn from intricate information unbiasedly and facilitate the early identification of clinical outcomes. This study aimed to construct and compare the ability of different ML models to predict DCI after aSAH. Then, we identified and analyzed the essential risk of DCI occurrence by preoperative clinical scores and postoperative laboratory test results. This was a multicenter, retrospective cohort study. A total of 1039 post-operation patients with aSAH were finally included from three hospitals in China. The training group contained 919 patients, and the test group comprised 120 patients. We used five popular machine-learning algorithms to construct the models. The area under the receiver operating characteristic curve (AUC), accuracy, sensitivity, specificity, precision, and f1 score were used to evaluate and compare the five models. Finally, we performed a Shapley Additive exPlanations analysis for the model with the best performance and significance analysis for each feature. A total of 239 patients with aSAH (23.003%) developed DCI after the operation. Our results showed that in the test cohort, Random Forest (RF) had an AUC of 0.79, which was better than other models. The five most important features for predicting DCI in the RF model were the admitted modified Rankin Scale, D-Dimer, intracranial parenchymal hematoma, neutrophil/lymphocyte ratio, and Fisher score. Interestingly, clamping or embolization for the aneurysm treatment was the fourth button-down risk factor in the ML model. In this multicenter study, we compared five ML methods, among which RF performed the best in DCI prediction. In addition, the essential risks were identified to help clinicians monitor the patients at high risk for DCI more precisely and facilitate timely intervention.

Differentiating Microplastics from Natural Particles in Aqueous Suspensions Using Flow Cytometry with Machine Learning.

Microplastics (MPs) in natural waters are heterogeneously mixed with other natural particles including algal cells and suspended sediments. An easy-to-use and rapid method for directly measuring and distinguishing MPs from other naturally present colloids in the environment would expedite analytical workflows. Here, we established a database of MP scattering and fluorescence properties, either alone or in mixtures with natural particles, by stain-free flow cytometry. The resulting high-dimensional data were analyzed using machine learning approaches, either unsupervised (e.g., viSNE) or supervised (e.g., random forest algorithms). We assessed our approach in identifying and quantifying model MPs of diverse sizes, morphologies, and polymer compositions in various suspensions including phototrophic microorganisms, suspended biofilms, mineral particles, and sediment. We could precisely quantify MPs in microbial phototrophs and natural sediments with high organic carbon by both machine learning models (identification accuracies over 93%), although it was not possible to distinguish between different MP sizes or polymer compositions. By testing the resulting method in environmental samples through spiking MPs into freshwater samples, we further highlight the applicability of the method to be used as a rapid screening tool for MPs. Collectively, this workflow can be easily applied to a diverse set of samples to assess the presence of MPs in a time-efficient manner.

Media Pembelajaran Bagi Siswa Autis Menurut Perspektif Islam

This research covers various educational media for children with special needs (autism), such as audiovisual aids and engaging images. These methods aim to support the interest and understanding of learning for children with special needs. Since children with special needs require different and more intensive learning approaches compared to typical children, and considering the Islamic perspective that does not discriminate based on ability, status, physical condition, or financial situation in accessing education, this journal aims to dispel the notion that children with special needs do not deserve the same educational opportunities as typical children. This journal is written using a literature review method, drawing from several journals with themes relevant to the chosen title.

Phosphate mine by-products as new cementitious binders for eco-mortars production: Experiments and machine learning approach

Phosphate mining industry generates different types of by-products that have significant environmental impacts such as ecosystems destruction and soil contamination. To reduce their environmental footprint, these wastes were investigated as supplementary cementitious materials (SCMs). The generated by-products included a clayey material and calcareous marl which were used in the current study. Blends of the abovementioned materials with cement (ratio of 1:1) were investigated using X-Ray Fluorescence spectrometry (XRF), X-Ray Diffraction (XRD), Thermogravimetric Analysis (TDA-TG), Mercury Porosimetry, Fourier-Transform Infrared Spectroscopy (FTIR), Scanning Electron Microscopy (SEM) and Electromechanical testing device. Using these results, a learning model based on multiple linear regression (MLR) was proposed to predict the compressive strength and the specific surface area from the constituents of the material, the additives, the L/S ratio, and the hardening regime. The accuracy of the models was assessed using the correlation coefficient (R2), mean absolute error (MAE), and root mean square error (RMSE). Compressive strength results confirmed that the sample's strength improved with the amount of calcined clay. Unlike the water demand where the mixtures required more water than the OPC mixture. SEM-EDS examinations proved the existence of the C–S–H gel, responsible for the specimen strength. The used machine learning model demonstrated excellent performance and practical potential to predict both compressive strength (CS) and specific surface area (SS) by capturing both linear and nonlinear relationships. As well as time and plasticizer were the most influential factors on the properties studied (CS and SS) and their effect was positive. This sensitivity study provides important information on the critical factors influencing compressive strength and specific surface area in the different ranges considered.