Variety Of Data Sources Research Articles

A comparative performance assessment of artificial intelligence based classifiers and optimized feature reduction technique for breast cancer diagnosis

Breast cancer (BC) is a catastrophic global health concern that causes numerous fatalities worldwide. Early detection of breast cancer may mitigate death rates; however, the prevailing diagnostic procedure for the malignancy necessitates numerous multifaceted laboratory tests that must be performed by medical professionals. In this article machine learning, a branch of Artificial Intelligence (AI), has been employed to improve cancer diagnosis, prognoses and survival rates while reducing the vulnerability of humans. Support Vector Machine (SVM), K-nearest Neighbors (KNN), Decision Tree (DT), Random Forest (RF) and Grey Wolf Optimizer (GWO) are implemented to prognosticate breast cancer. Comprehensive insights into the efficacy of these approaches for breast cancer prognosis are provided by the performance assessment that is accomplished using the confusion matrix, Receiver Operating Characteristic (ROC) curves and parallel coordinate plots. Both UCI (University of California Irvine) and SEER (Surveillance, Epidemiology and End Results) datasets have been utilized to confirm the investigation's findings and ensure their generalizability across diverse data sources. The results conclusively demonstrate that SVM is the cohort's most accurate classifier. With a stupendous accuracy rate of 99.1 %, the GWO-SVM compares favorably to all other algorithms. Furthermore, feature reduction approaches such as Minimum Redundancy Maximum Relevance (mRMR), ReliefF and Principal Component Analysis (PCA) are utilized. ReliefF has demonstrated exceptional effectiveness with a maximum accuracy of 98.2 %.

An in-depth exploration of ethnomedicinal applications, phytochemical profiles, and pharmacological potentials: unveiling Withania somnifera

Researchers have extensively studied Withania somnifera (L.) Dunal, a woody shrub renowned for its multifaceted medicinal attributes such as antibacterial, anti-inflammatory, adaptogenic, aphrodisiac, and tonifying properties, because of its medicinal and traditional values. However, comprehensive information about its medicinal uses and pharmacological implications is scattered across various sources. Thus, this study aims to provide a comprehensive review of its ethnomedicinal uses, phytochemistry, and pharmacological attributes, consolidating information from diverse data sources. Systematic investigations have revealed the presence of diverse phytochemicals in W. somnifera, including major alkaloids, withanolides, flavonoids, tannins, oils, phytosterols, and amino acids. Extracts, fractions, and bioactive compounds derived from W. somnifera exhibited potent antibacterial, anti-inflammatory, anti-aging, anti-analgesic, anti-cancer, antivenom, anti-fungal, and anti-viral activities. W. somnifera serves as a valuable source of phytochemicals with diverse biological activities, offering significant therapeutic benefits globally. However, further studies are needed to assess potential side effects. Additionally, while several isolated compounds have demonstrated notable bioactivities, future research should focus on elucidating their mechanistic features to facilitate their integration into drug discovery endeavors.

Short communication: Dairy Victory™ Platform: A Novel Benchmarking Platform to Empower Economic Decisions on Dairy Farms.

In the face of diminishing economic margins, dairy farmers globally are compelled to maintain economic competitiveness. Benchmarking emerges as a strategic tool to establish new, achievable improvement objectives that balance ambition with practicality. This typically requires integrating diverse data sources such as feed, milk production, diet, and market prices. However, many farms lack essential, cow-level data like daily milk output and milk income over feed cost (IOFC), which hampers economic performance visibility and informed decision-making. To address this challenge, we introduce “Dairy Victory™ platform (DVP)” a novel cloud-based benchmarking platform designed to simplify complex analyses. The DVP uniquely calculates zootechnical and economic key performance indicators (KPIs) at the cow and herd levels and benchmarks these against a dynamically selected cohort of farms, facilitating comparisons across various farm sizes, and milk production levels. The primary objective of this paper is to demonstrate the utility of DVP as a decision-making tool in supporting farmers and consultants with both operational and strategic decisions. It emphasizes leveraging benchmarking information to enhance decision-making processes, thereby highlighting the significant value that DVP brings to farmers, consultants, and dairy farm stakeholders. Our study analyzed data from 712 farms from December 2023, focusing on several KPIs, such as milk production, milk quality, feed efficiency, and IOFC using Dairy Herd Improvement (DHI) records. This approach showcases DV's ability to utilize minimal data inputs for detailed analysis, leveraging peer performance to set desirable and/or achievable goals. We present a case study demonstrating how the DVP platform can guide dairy farms using anonymized peer data. This approach enables users to potentially improve their IOFC by up to 35%. Our findings highlight DVP's potential as a powerful tool for generating insightful analyses, simulations, and recommendations, primarily from test-day data, but also integrated with market and estimated data. This supports more strategic decision-making in dairy management, including automatic goal-setting based on peer performance.

Amazonian amphibians: diversity, spatial distribution patterns, conservation and sampling deficits.

The Amazon biome is home to the largest tropical forest on the planet and has the greatest global biodiversity on Earth. Despite this, several less charismatic taxonomic groups, such as amphibians, lack comprehensive studies on their species richness and spatial distribution in the Amazon Region. In this study, we investigated: i) patterns of richness and endemism of Amazonian amphibians across geopolitical and biogeographic divisions, ii) similarities between different Amazonian bioregions, iii) temporal trends in amphibian sampling, iv) conservation status of amphibians according to assessments of the IUCN and v) the importance of diverse data sources in building a robust database of amphibian occurrences. We aggregated data from four different sources: publicly accessible platforms, peer-reviewed articles, grey literature and fieldwork inventories spanning 15 years (2007-2021), ultimately compiling 160,643 records of 947 species across 7,418 sampled sites. The greatest diversity of species was found in Peru, Brazil and Ecuador, with notable amphibian diversity and endemism in regions such as the western basins and the Tapajós River Basin in the central-southern Amazon. Geographical analysis of species diversity revealed four distinct groups defined by latitudinal (the Amazon River) and longitudinal (the Juruá, Madeira and Tapajós Rivers) gradients, with low species similarity (< 40%), particularly in the basins of north-western Amazonia. Amphibian sampling in the Amazon has intensified since the 1950s with the establishment of important research centres such as INPA and the GOELD Museum in the Brazilian Amazon. Approximately 18% of Amazonian amphibian species face extinction risk, according to IUCN assessments, highlighting the need for comprehensive data sources to understand and conserve species in this megadiverse region. Our findings suggest that river systems likely influence Amazonian amphibian species composition due to biogeographic history, emphasising the need for robust taxonomic and spatial databases. This study, therefore, contributes a valuable large-scale dataset for Amazonian amphibians, guiding future research and strategies for amphibian conservation.

Histopathology in focus: a review on explainable multi-modal approaches for breast cancer diagnosis.

Precision and timeliness in breast cancer detection are paramount for improving patient outcomes. Traditional diagnostic methods have predominantly relied on unimodal approaches, but recent advancements in medical data analytics have enabled the integration of diverse data sources beyond conventional imaging techniques. This review critically examines the transformative potential of integrating histopathology images with genomic data, clinical records, and patient histories to enhance diagnostic accuracy and comprehensiveness in multi-modal diagnostic techniques. It explores early, intermediate, and late fusion methods, as well as advanced deep multimodal fusion techniques, including encoder-decoder architectures, attention-based mechanisms, and graph neural networks. An overview of recent advancements in multimodal tasks such as Visual Question Answering (VQA), report generation, semantic segmentation, and cross-modal retrieval is provided, highlighting the utilization of generative AI and visual language models. Additionally, the review delves into the role of Explainable Artificial Intelligence (XAI) in elucidating the decision-making processes of sophisticated diagnostic algorithms, emphasizing the critical need for transparency and interpretability. By showcasing the importance of explainability, we demonstrate how XAI methods, including Grad-CAM, SHAP, LIME, trainable attention, and image captioning, enhance diagnostic precision, strengthen clinician confidence, and foster patient engagement. The review also discusses the latest XAI developments, such as X-VARs, LeGrad, LangXAI, LVLM-Interpret, and ex-ILP, to demonstrate their potential utility in multimodal breast cancer detection, while identifying key research gaps and proposing future directions for advancing the field.

Prediction Model for Electricity Energy Consumption and Pricing Using Xgboosts With L1 Regularization

The increasing global demand for electricity, driven by rapid industrialization, urbanization, and digitalization, necessitates more accurate and efficient predictive models for electricity generation and consumption. Traditional statistical techniques often fall short in incorporating the complex environmental factors influencing energy demand. This study presents an advanced machine learning model, leveraging XGBoost with L1 regularization, to improve the accuracy of electricity consumption and generation predictions. By integrating comprehensive datasets, including economic indicators and weather variables, the model addresses the critical gaps in existing forecasting methods. The research involved rigorous data pre-processing, feature engineering, and model validation using metrics such as RMSE, MAPE, and MAE. The model achieves a RMSE of 2.212 and MAPE of 2.393%, indicating good predictive performance. Effective data cleaning, feature engineering, and the application of PCA contributed to this result. The results demonstrate significant improvements in prediction accuracy, highlighting the potential of the proposed model to enhance energy management practices, optimize grid operations, and support the integration of renewable energy sources. This study provides a robust framework for future research and practical applications, contributing to the advancement of sustainable energy systems and informed policy-making. The findings underscore the importance of integrating diverse data sources and sophisticated machine-learning techniques to meet the growing challenges in the energy sector.

A weighted Bayesian integration method for predicting drug combination using heterogeneous data

BackgroundIn the management of complex diseases, the strategic adoption of combination therapy has gained considerable prominence. Combination therapy not only holds the potential to enhance treatment efficacy but also to alleviate the side effects caused by excessive use of a single drug. Presently, the exploration of combination therapy encounters significant challenges due to the vast spectrum of potential drug combinations, necessitating the development of efficient screening strategies.MethodsIn this study, we propose a prediction scoring method that integrates heterogeneous data using a weighted Bayesian method for drug combination prediction. Heterogeneous data refers to different types of data related to drugs, such as chemical, pharmacological, and target profiles. By constructing a multiplex drug similarity network, we formulate new features for drug pairs and propose a novel Bayesian-based integration scheme with the introduction of weights to integrate information from various sources. This method yields support strength scores for drug combinations to assess their potential effectiveness.ResultsUpon comprehensive comparison with other methods, our method shows superior performance across multiple metrics, including the Area Under the Receiver Operating Characteristic Curve, accuracy, precision, and recall. Furthermore, literature validation shows that many top-ranked drug combinations based on the support strength score, such as goserelin and letrozole, have been experimentally or clinically validated for their effectiveness.ConclusionsOur findings have significant clinical and practical implications. This new method enhances the performance of drug combination predictions, enabling effective pre-screening for trials and, thereby, benefiting clinical treatments. Future research should focus on developing new methods for application in various scenarios and for integrating diverse data sources.

Large circuit models: opportunities and challenges

Within the electronic design automation (EDA) domain, artificial intelligence (AI)-driven solutions have emerged as formidable tools, yet they typically augment rather than redefine existing methodologies. These solutions often repurpose deep learning models from other domains, such as vision, text, and graph analytics, applying them to circuit design without tailoring to the unique complexities of electronic circuits. Such an “AI4EDA” approach falls short of achieving a holistic design synthesis and understanding, overlooking the intricate interplay of electrical, logical, and physical facets of circuit data. This study argues for a paradigm shift from AI4EDA towards AI-rooted EDA from the ground up, integrating AI at the core of the design process. Pivotal to this vision is the development of a multimodal circuit representation learning technique, poised to provide a comprehensive understanding by harmonizing and extracting insights from varied data sources, such as functional specifications, register-transfer level (RTL) designs, circuit netlists, and physical layouts. We champion the creation of large circuit models (LCMs) that are inherently multimodal, crafted to decode and express the rich semantics and structures of circuit data, thus fostering more resilient, efficient, and inventive design methodologies. Embracing this AI-rooted philosophy, we foresee a trajectory that transcends the current innovation plateau in EDA, igniting a profound “shift-left” in electronic design methodology. The envisioned advancements herald not just an evolution of existing EDA tools but a revolution, giving rise to novel instruments of design-tools that promise to radically enhance design productivity and inaugurate a new epoch where the optimization of circuit performance, power, and area (PPA) is achieved not incrementally, but through leaps that redefine the benchmarks of electronic systems’ capabilities.

Application of knowledge graph in smart irrigation district management decision making

Regarding the traditional irrigation and drainage management methods in China's irrigation districts, there are problems such as complex management processes, dispersed information systems, difficulty in resource sharing, diverse data sources, and insufficient intelligent auxiliary decision-making. In order to further realize refined intelligent management decision-making on issues related to smart irrigation districts, this article uses the basic information of 28 Yellow River diversion irrigation districts in Henan Province, as well as the overall plan reports and related issue management manuals of 7 management offices of the first and second phase projects of Zhaokou Irrigation District as data sources. Collect and organize data from irrigation areas, and use these to build a knowledge graph for management of issues in irrigation areas diverted from the Yellow River. At the same time, the BERT + BiLSTM + CRF model is used to intelligently identify entities such as irrigation projects and problem events in the Zhaokou Irrigation District inspection log text, and entity alignment technology is used to match the inspection text with entities in the knowledge graph. Finally, combined with the graph retrieval function, the intelligent generation of smart irrigation district management decision-making solutions is realized. The validation of specific irrigation district examples and analysis of the evaluation indexes of relevant models demonstrate the reliability of the problem management decision-making scheme proposed in this paper. This application effectively facilitates the integration of information data in the Yellow River diversion irrigation area and enables visual management of intelligent irrigation zones, presenting a novel concept for the informationization construction of China's irrigation areas.

Hyperdimensional computing: A fast, robust, and interpretable paradigm for biological data.

Advances in bioinformatics are primarily due to new algorithms for processing diverse biological data sources. While sophisticated alignment algorithms have been pivotal in analyzing biological sequences, deep learning has substantially transformed bioinformatics, addressing sequence, structure, and functional analyses. However, these methods are incredibly data-hungry, compute-intensive, and hard to interpret. Hyperdimensional computing (HDC) has recently emerged as an exciting alternative. The key idea is that random vectors of high dimensionality can represent concepts such as sequence identity or phylogeny. These vectors can then be combined using simple operators for learning, reasoning, or querying by exploiting the peculiar properties of high-dimensional spaces. Our work reviews and explores HDC's potential for bioinformatics, emphasizing its efficiency, interpretability, and adeptness in handling multimodal and structured data. HDC holds great potential for various omics data searching, biosignal analysis, and health applications.

Estimating Chlorophyll-a and Phycocyanin Concentrations in Inland Temperate Lakes across New York State Using Sentinel-2 Images: Application of Google Earth Engine for Efficient Satellite Image Processing

Harmful algae blooms (HABs) have been reported with greater frequency in lakes across New York State (NYS) in recent years. In situ sampling is used to assess water quality, but such observations are time intensive and therefore practically limited in their spatial extent. Previous research has used remote sensing imagery to estimate phytoplankton pigments (typically chlorophyll-a or phycocyanin) as HAB indicators. The primary goal of this study was to validate a remote sensing-based method to estimate cyanobacteria concentrations at high temporal (5 days) and spatial (10–20 m) resolution, to allow identification of lakes across NYS at a significant risk of algal blooms, thereby facilitating targeted field investigations. We used Google Earth Engine (GEE) as a cloud computing platform to develop an efficient methodology to process Sentinel-2 image collections at a large spatial and temporal scale. Our research used linear regression to model the correlation between in situ observations of chlorophyll-a (Chl-a) and phycocyanin and indices derived from Sentinel-2 data to evaluate the potential of remote sensing-derived inputs for estimating cyanobacteria concentrations. We tested the performance of empirical models based on seven remote-sensing-derived indices, two in situ measurements, two cloud mitigation approaches, and three temporal sampling windows across NYS lakes for 2019 and 2020. Our best base model (R2 of 0.63), using concurrent sampling data and the ESA cloud masking—i.e., the QA60 bitmask—approach, related the maximum peak height (MPH) index to phycocyanin concentrations. Expanding the temporal match using a one-day time window increased the available training dataset size and improved the fit of the linear regression model (R2 of 0.71), highlighting the positive impact of increasing the training dataset on model fit. Applying the Cloud Score+ method for filtering cloud and cloud shadows further improved the fit of the phycocyanin estimation model, with an R2 of 0.84, but did not result in substantial improvements in the model’s application. The fit of the Chl-a models was generally poorer, but these models still had good accuracy in detecting moderate and high Chl-a values. Future work will focus on exploring alternative algorithms that can incorporate diverse data sources and lake characteristics, contributing to a deeper understanding of the relationship between remote sensing data and water quality parameters. This research provides a valuable tool for cyanobacteria parameter estimation with confidence quantification to identify lakes at risk of algal blooms.

Development of a comprehensive open access "molecules with androgenic activity resource (MAAR)" to facilitate risk assessment of chemicals.

The increasing prevalence of endocrine-disrupting chemicals (EDCs) and their potential adverse effects on human health underscore the necessity for robust tools to assess and manage associated risks. The androgen receptor (AR) is a critical component of the endocrine system, playing a pivotal role in mediating the biological effects of androgens, which are male sex hormones. Exposure to androgen-disrupting chemicals during critical periods of development, such as fetal development or puberty, may result in adverse effects on reproductive health, including altered sexual differentiation, impaired fertility, and an increased risk of reproductive disorders. Therefore, androgenic activity data is critical for chemical risk assessment. A large amount of androgenic data has been generated using various experimental protocols. Moreover, the data are reported in different formats and in diverse sources. To facilitate utilization of androgenic activity data in chemical risk assessment, the Molecules with Androgenic Activity Resource (MAAR) was developed. MAAR is the first open-access platform designed to streamline and enhance the risk assessment of chemicals with androgenic activity. MAAR's development involved the integration of diverse data sources, including data from public databases and mining literature, to establish a reliable and versatile repository. The platform employs a user-friendly interface, enabling efficient navigation and extraction of pertinent information. MAAR is poised to advance chemical risk assessment by offering unprecedented access to information crucial for evaluating the androgenic potential of a wide array of chemicals. The open-access nature of MAAR promotes transparency and collaboration, fostering a collective effort to address the challenges posed by androgenic EDCs.

Advancements in Machine Learning and Deep Learning for Early Diagnosis of Chronic Kidney Diseases: A Comprehensive Review

Chronic kidney disease (CKD) is a prevalent and debilitating condition worldwide, characterized by progressive loss of kidney function over time. Early detection plays a crucial role in mitigating its impact on patient health and healthcare systems. In recent years, there has been a burgeoning interest in leveraging machine learning (ML) and deep learning (DL) techniques to enhance the early diagnosis of CKD. This comprehensive review explores the advancements in ML and DL models applied to CKD diagnosis, focusing on their ability to integrate diverse data sources including clinical biomarkers, imaging modalities, and patient demographics. Key ML algorithms such as Support Vector Machines (SVM), Random Forests (RF), and neural network architectures like Convolutional Neural Networks (CNNs) and Long Short-Term Memory networks (LSTMs) are examined in the context of their performance in predicting CKD progression, classifying disease stages, and identifying at-risk populations. Furthermore, the review discusses challenges such as data quality, model interpretability, and integration into clinical practice, alongside emerging trends in explainable AI, transfer learning, federated learning, and integration with electronic health records (EHRs). By synthesizing findings from recent literature, this paper aims to provide insights into current methodologies, identify gaps for future research, and underscore the transformative potential of ML and DL in revolutionizing early CKD diagnosis and management..

Estimation of dynamic Origin–Destination matrices in a railway transportation network integrating ticket sales and passenger count data

Accurately estimating Origin–Destination matrices is a pressing challenge in transportation management and urban planning. However, traditional methods like travel surveys have limitations in availability and comprehensiveness, which have been further exacerbated by the recent changes in mobility patterns induced by the COVID-19 pandemic. To address this issue, we focused on the Trenord railway network in Lombardy, Italy, and developed an innovative pipeline to integrate ticket and subscription sales and Automated Passenger Counting data using the Iterative Proportional Fitting algorithm. By effectively navigating the complexities of diverse and incomplete data sources, our approach showcases adaptability across various transportation contexts. Our research offers a valuable tool for operators, policymakers, and researchers, bridging the gap between data availability and the need for precise OD matrices. Additionally, we emphasise the potential of dynamic OD matrices and showcase methods for detecting anomalies in mobility trends, interpreting them in the context of events from the last months of 2022.

Documenting Geographically and Contextually Diverse Language Data Sources

Documenting Geographically and Contextually Diverse Language Data Sources

Artificial intelligence-based suicide prevention and prediction: A systematic review (2019–2023)

Suicide is a major global public health concern, and the application of artificial intelligence (AI) methods, such as natural language processing (NLP), machine learning (ML), and deep learning (DL), has shown promise in advancing suicide prediction and prevention efforts. Recent advancements in AI – particularly NLP and DL have opened up new avenues of research in suicide prediction and prevention. While several papers have reviewed specific detection techniques like NLP or DL, there has been no recent study that acts as a one-stop-shop, providing a comprehensive overview of all AI-based studies in this field. In this work, we conduct a systematic literature review to identify relevant studies published between 2019 and 2023, resulting in the inclusion of 156 studies. We provide a comprehensive overview of the current state of research conducted on AI-driven suicide prevention and prediction, focusing on different data types and AI techniques employed. We discuss the benefits and challenges of these approaches and propose future research directions to improve the practical application of AI in suicide research. AI is highly capable of improving the accuracy and efficiency of risk assessment, enabling personalized interventions, and enhancing our understanding of risk and protective factors. Multidisciplinary approaches combining diverse data sources and AI methods can help identify individuals at risk by analyzing social media content, patient histories, and data from mobile devices, enabling timely intervention. However, challenges related to data privacy, algorithmic bias, model interpretability, and real-world implementation must be addressed to realize the full potential of these technologies. Future research should focus on integrating prediction and prevention strategies, harnessing multimodal data, and expanding the scope to include diverse populations. Collaboration across disciplines and stakeholders is essential to ensure that AI-driven suicide prevention and prediction efforts are ethical, culturally sensitive, and person-centered.

A population-based repeated cross-sectional study using administrative health data to examine the impact of the COVID-19 pandemic on mental wellness in citizens of the Métis Nation of Ontario

ObjectiveLinking data on people who experience drug overdoses can provide new insights and opportunities for intervention. However, because public health data infrastructure in the United States (US) is often siloed, linkage activities can require incentivization and support. In 2023, we began funding 20 states to conduct overdose-related data linkage. We sought to understand baseline capacity in funded states. ApproachData linkages in this project focus on two areas: 1) linking fatal and nonfatal overdose data and 2) linking fatal or nonfatal overdose data to prescription drug monitoring program (PDMP), criminal justice, or social determinants of health (SDOH) data. We report opportunities identified during implementation regarding states’ capacity to perform the required linkages as well as needs for additional training and technical assistance. ResultsOf 20 funded states, 11 (55%) reported some previous experience linking fatal and nonfatal overdose data; 10 (50%) have linked PDMP data, while only 3 (15%) have linked SDOH data and 2 (10%) criminal justice data. Jurisdictional needs included: training on data linkage methods, including developing and validating linkage algorithms; overcoming administrative barriers to data sharing, such as data use agreements; and developing standardized approaches to characterizing events of interest in diverse data sources. States valued sharing strategies and experiences with each other. Conclusions/ImplicationsAdditional capacity building is needed for states to successfully link and utilize overdose-related data. We are actively collaborating with state partners to facilitate peer-to-peer knowledge exchange to develop successful linkage programs.

AVaTER: Fusing Audio, Visual, and Textual Modalities Using Cross-Modal Attention for Emotion Recognition.

Multimodal emotion classification (MEC) involves analyzing and identifying human emotions by integrating data from multiple sources, such as audio, video, and text. This approach leverages the complementary strengths of each modality to enhance the accuracy and robustness of emotion recognition systems. However, one significant challenge is effectively integrating these diverse data sources, each with unique characteristics and levels of noise. Additionally, the scarcity of large, annotated multimodal datasets in Bangla limits the training and evaluation of models. In this work, we unveiled a pioneering multimodal Bangla dataset, MAViT-Bangla (Multimodal Audio Video Text Bangla dataset). This dataset, comprising 1002 samples across audio, video, and text modalities, is a unique resource for emotion recognition studies in the Bangla language. It features emotional categories such as anger, fear, joy, and sadness, providing a comprehensive platform for research. Additionally, we developed a framework for audio, video and textual emotion recognition (i.e., AVaTER) that employs a cross-modal attention mechanism among unimodal features. This mechanism fosters the interaction and fusion of features from different modalities, enhancing the model's ability to capture nuanced emotional cues. The effectiveness of this approach was demonstrated by achieving an F1-score of 0.64, a significant improvement over unimodal methods.

BIG DATA IN CREDIT RISK MANAGEMENT: A SYSTEMATIC REVIEW OF TRANSFORMATIVE PRACTICES AND FUTURE DIRECTIONS

This systematic review examines the profound impact of big data analytics on credit risk management in financial institutions, highlighting both its transformative benefits and the associated challenges. By integrating a wide range of real-time and diverse data sources—such as customer behavior, market trends, and macroeconomic indicators—financial institutions have significantly enhanced the accuracy, efficiency, and predictive power of their credit risk models. The findings reveal that institutions employing big data analytics have achieved substantial reductions in default rates, with improvements of up to 30% over traditional risk assessment methods. However, the adoption of big data also presents considerable challenges, particularly in ensuring data privacy and security, navigating complex regulatory environments, and overcoming technical hurdles related to data integration, storage, and processing. These issues necessitate robust data governance frameworks and significant investments in IT infrastructure. Despite these challenges, big data is expected to play an increasingly central role in credit risk management, offering early adopters a strategic advantage through enhanced risk assessment and decision-making capabilities. This review provides critical insights for financial institutions, policymakers, and researchers, emphasizing the need for ongoing innovation and adaptation to fully harness the potential of big data in this field.

BIG DATA IN CREDIT RISK MANAGEMENT: A SYSTEMATIC REVIEW OF TRANSFORMATIVE PRACTICES AND FUTURE DIRECTIONS

This systematic review examines the profound impact of big data analytics on credit risk management in financial institutions, highlighting both its transformative benefits and the associated challenges. By integrating a wide range of real-time and diverse data sources—such as customer behavior, market trends, and macroeconomic indicators—financial institutions have significantly enhanced the accuracy, efficiency, and predictive power of their credit risk models. The findings reveal that institutions employing big data analytics have achieved substantial reductions in default rates, with improvements of up to 30% over traditional risk assessment methods. However, the adoption of big data also presents considerable challenges, particularly in ensuring data privacy and security, navigating complex regulatory environments, and overcoming technical hurdles related to data integration, storage, and processing. These issues necessitate robust data governance frameworks and significant investments in IT infrastructure. Despite these challenges, big data is expected to play an increasingly central role in credit risk management, offering early adopters a strategic advantage through enhanced risk assessment and decision-making capabilities. This review provides critical insights for financial institutions, policymakers, and researchers, emphasizing the need for ongoing innovation and adaptation to fully harness the potential of big data in this field.