Dynamic Data Research Articles

Grounding Fault Diagnosis of Running Rails Based on a Multi-scale One-Dimensional Convolutional Neural Network in a DC Subway System

AbstractRunning rails are the return conductors of the traction current in DC subway systems, which should be insulated from the earth. Due to the large length of the line, as well as the humidity and metal dust in the tunnel, grounding fault of the running rails usually occurs, which will increase stray current (SC) leakage and endanger power supply safety. In this paper, a method of grounding fault diagnosis of running rails based on a multi-scale one-dimensional convolutional neural network (MS-1DCNN) is proposed. Firstly, a platform for the dynamic distribution of SC and rail potential (RP) with grounding faults existing in the running rails is established, which generates the dynamic RP data with various grounding faults. Secondly, a grounding fault diagnostic method of running rails based on MS-1DCNN is proposed, so as to realize the effective identification of ground fault types in subway systems. Thirdly, with the proposed diagnostic method, the datasets under two operating conditions of a single train and two trains are tested; a comparison test between MS-1DCNN and the 1D convolutional neural network (1DCNN) is carried out, and the effectiveness of the proposed method is verified. Results demonstrate that the proposed model can significantly improve the ground fault diagnostic accuracy of running rails. The dynamic RP simulation platform for trains established in this paper lays a theoretical foundation for the grounding fault research of running rail. Moreover, the deep learning method is proposed for the first time to diagnose the grounding fault of running rail, and the high diagnostic accuracy is obtained, which is of great significance for the safe and stable operation of the subway line.

An Enhanced Long-Term Wind Speed Prediction Using Dynamic Unified Ensemble Learning and Data Assimilation Techniques: A Case Study in Tamil Nadu, India

Reliable wind speed prediction is essential for effective grid management since wind energy is a key component of renewable energy generation. However, controlling wind speed just right is no easy feat since the wind flow changes constantly. This paper presents an innovative method for predicting wind speeds in the future. It uses state-of-the-art data assimilation methods and a dynamic unified ensemble learning model. For efficient wind energy planning and monitoring, WSP accuracy is crucial. Data from a single site limited the accuracy of WSPs in previous research. An improved accuracy of long-term wind speed predictions is achieved by the proposed model via the integration of data assimilation and ensemble learning. To increase forecast accuracy, the model uses sophisticated data assimilation methods like the Kalman filter to combine data from many sources. Specifically, the model employs the Stacked CNN + BiLSTM with Data Assimilator (SCBLSTM+DA) technique, which integrates Wind Speed (WS) data from adjacent areas with the CNN + BiLSTM-based Ensemble Learning Model (ELM) and the Four-Dimensional Variational and Ensemble Kalman Filter (4DVar/EnKF) Data Assimilation method. Using real-world wind speed data from nine meteorological stations in Tamil Nadu, India, we find that current prediction models, including both classical statistical and cutting-edge machine learning models, perform better. Further, unlike standalone models, the suggested model shows less susceptibility to changes in prediction time scales. Promising a solution to improve long-term wind speed predictions accuracy, this study has significant consequences for wind energy management and production.

Identification research of chemical process leakage based on deep learning and correlation-distance graph coding

As a leak identification method in chemical processes, deep learning is limited by inadequate sample labels and highly coupled, nonlinear process variables, therefore difficult to model with a high identification accuracy. To address these problems, a fusion correlation-distance graph (CDG) coding aided deep learning method is proposed. First, the mechanism model is built based on dynamic process data with different leakage labels. Then, the weighted degree and spatial distribution of the dynamic dataset are computed through innovatively designed correlation and distance coding, aided by sliding window fusion into a correlation-distance matrix. Finally, the well-trained long short-term memory (LSTM) is constructed to learn the deep features of the leakage process and identify them. The applications in two industrial cases, CO2 capture and ammonia synthesis, show that CDG-LSTM presents state-of-the-art identification performance with R2 scores of 0.994 and 0.986. 6.6% and 18.4% improvement over LSTM. In addition, the proposed method effectively categorizes the unknown leak samples into known labels with nearby locations, providing a valuable reference for operators to determine the unknown leak locations.

Dynamic thresholding logarithmic companding for PAPR reduction in MIMO-OFDM systems for 5G wireless communication

In order to advance 5G wireless communication technology, this paper presents a novel method for lowering the Peak-to-Average Power Ratio (PAPR) in Multiple-Input Multiple-Output Orthogonal Frequency-Division Multiplexing (MIMO-OFDM) systems. It is called the Dynamic Thresholding-based μ-law (DT-μ-law) logarithmic companding technique, and it greatly improves the performance of the system by effectively broadcasting data streams on a single frequency across multiple channels. This technique's ability lies in compressing the amplitude of the transmitting signal beyond a specific threshold value before the parallel-to-serial conversion block in the MIMO-OFDM system. It employs the direct insertion of an offset value into the guard bits, rather than using a step function for the amplitude reduction process, which can reduce additional system complexity and data loss during signal expansion at the receiver end. This technique is more adequately suited for dynamic data rate shifting and interference within a limited threshold value. The dynamic thresholding value (α) is determined by calculating the median and standard deviation of the μ-law companding. This ensures the effective compression of higher amplitude signals at the transmitter, using μ-law log companding. To streamline the decompanding process at the receiver, an offset is introduced, facilitating a smoother transition and reducing complexity. The results demonstrate that the proposed DT- μ-law companding technique significantly improves PAPR reduction while maintaining low Bit Error Rates (BER) and high average spectral power efficiency. This efficiency is optimal when the μ value is maintained within the range of 4–4.5. Furthermore, it was observed that an increase in the μ value corresponds to a decrease in both PAPR value and BER. Specifically, at a signal-to-noise ratio of 15.2 dB, the BER stabilizes at 10−1. Compared to existing methods like the Max-Min Decomp-SLM approach, this technique offers lower Signal-to-Noise Ratio (SNR) values, thereby enhancing spectral efficiency and maximizing data capacity.

A Practical probabilistic history matching framework for characterizing fracture network parameters of shale gas reservoirs

Simulating fluid flow in complex fracture systems encountered in subsurface systems, such as those encountered in tight or shale gas reservoirs, presents considerable challenges. Sophisticated numerical techniques and characterization approaches are required to integrate static and dynamic data from multiple sources to account for the intricate interplay between fractures and the surrounding rock matrix. A novel workflow using an indicator-based probability perturbation method (PPM) is applied to characterize uncertain discrete fracture network parameters. The posterior probability distributions of primary and secondary fracture transmissivity, aperture, length, height, and intensity of the secondary fracture are estimated according to the production (flow) histories. A case study based on the Horn River shale gas reservoir is presented. A pilot point scheme is formulated to update the distributions of P32L. The forward modelling entails upscaling each fracture model into a dual-porosity dual-permeability model and performing multiphase flow simulation. This approach produces an ensemble of history-matched discrete fracture and upscaled models by incorporating static and dynamic data. The results demonstrate the utility of the developed method for estimating secondary fracture parameters, which are not inferrable from other static information alone. The inference of both primary and secondary fractures offers a more comprehensive characterization of the fracture networks in tight or shale gas reservoirs. Integrating a pilot point parameterization technique and a sequential simulation approach into the PPM framework presents significant novelties in contributing to a comprehensive and effective method of simulating fluid flow in complex fracture systems, addressing the challenges associated with non-linear relationships between fracture model parameters and the corresponding flow response.

Reconstruction of occluded pelvis markers during marker-based motion capture with industrial exoskeletons

Industrial back support exoskeletons are a promising solution to alleviate lumbar musculoskeletal strain. Due to the complexity of spinal loading, evaluation of EMG data alone has been considered insufficient to assess their support effects, and complementary kinematic and dynamic data are required. However, the acquisition of marker-based kinematics is challenging with exoskeletons, as anatomical reference points, particularly on the pelvis, are occluded by exoskeleton structures. The aim of this study was therefore to develop and validate a method to reliably reconstruct the occluded pelvic markers. The movement data of six subjects, for whom pelvic markers could be placed while wearing an exoskeleton, were used to test the reconstructions and compare them to anatomical landmarks during lifting, holding and walking. Two separate approaches were used for the reconstruction. One used a reference coordinate system based on only exoskeleton markers (EXO), as has been suggested in the literature, while our proposed method adds a technical marker in the lumbar region (LUMB) to compensate for any shifting between exoskeleton and pelvis. Reconstruction with EXO yielded on average an absolute linear deviation of 54 mm ± 16 mm (mean ± 1SD) compared to anatomical markers. The additional marker in LUMB reduced mean deviations to 14 mm ± 7 mm (mean ± 1SD). Both methods were compared to reference values from the literature for expected variances due to marker placement and soft tissue artifacts. For LUMB 99% of reconstructions were within the defined threshold of 24 mm ±9 mm while for EXO 91% were outside.

Seismic Tomography 2024

ABSTRACT Seismic tomography is the most abundant source of information about the internal structure of the Earth at scales ranging from a few meters to thousands of kilometers. It constrains the properties of active volcanoes, earthquake fault zones, deep reservoirs and storage sites, glaciers and ice sheets, or the entire globe. It contributes to outstanding societal problems related to natural hazards, resource exploration, underground storage, and many more. The recent advances in seismic tomography are being translated to nondestructive testing, medical ultrasound, and helioseismology. Nearly 50 yr after its first successful applications, this article offers a snapshot of modern seismic tomography. Focused on major challenges and particularly promising research directions, it is intended to guide both Earth science professionals and early-career scientists. The individual contributions by the coauthors provide diverse perspectives on topics that may at first seem disconnected but are closely tied together by a few coherent threads: multiparameter inversion for properties related to dynamic processes, data quality, and geographic coverage, uncertainty quantification that is useful for geologic interpretation, new formulations of tomographic inverse problems that address concrete geologic questions more directly, and the presentation and quantitative comparison of tomographic models. It remains to be seen which of these problems will be considered solved, solved to some extent, or practically unsolvable over the next decade.

Unraveling near real-time spatial dynamics of population using geographical ensemble learning

Dynamic gridded population data are crucial in fields such as disaster reduction, public health, urban planning, and global change studies. Despite the use of multi-source geospatial data and advanced machine learning models, current frameworks for population spatialization often struggle with spatial non-stationarity, temporal generalizability, and fine temporal resolution. To address these issues, we introduce a framework for dynamic gridded population mapping using open-source geospatial data and machine learning. The framework consists of (i) delineation of human footprint zones, (ii) construction of muliti-scale population prediction models using automated machine learning (AutoML) framework and geographical ensemble learning strategy, and (iii) hierarchical population spatial disaggregation with pycnophylactic constraint-based corrections. Employing this framework, we generated hourly time-series gridded population maps for China in 2016 with a 1-km spatial resolution. The average accuracy evaluated by root mean square deviation (RMSD) is 325, surpassing datasets like LandScan, WorldPop, GPW, and GHSL. The generated seamless maps reveal the temporal dynamic of population distribution at fine spatial scales from hourly to monthly. This framework demonstrates the potential of integrating spatial statistics, machine learning, and geospatial big data in enhancing our understanding of spatio-temporal heterogeneity in population distribution, which is essential for urban planning, environmental management, and public health.

Inference of Dynamic Spatial Panel Data Model and Its Application in Carbon Emission Analysis

The Spatial Dynamic Panel Data (SDPD) model is a widely used statistical model in the fields of economics and social sciences and has been the subject of extensive research by many scholars in recent years. Existing methods for parameter estimation primarily focus on improvements to the Generalized Method of Moments (GMM) and Quasi-Maximum Likelihood (QML). In this paper, we employ the method of Empirical Likelihood (EL) for statistical inference of the dynamic spatial panel data model and obtain confidence regions for the parameters. Through numerical simulations, we present the performance of the confidence regions obtained using the Empirical Likelihood (EL) and the Asymptotically Normal (NA) methods under finite samples and compare the two approaches. Finally, we analyze carbon using the suggested model and techniques.

Well-Candidate-Recognition Solution Offers Time Savings, Production Enhancement

_ This article, written by JPT Technology Editor Chris Carpenter, contains highlights of paper SPE 213329, “Data-Driven Well-Candidate-Recognition Solution: Case Study in a Digital Oil Field in Abu Dhabi,” by Erismar Rubio, SPE, Nagaraju Reddicharla, SPE, and Mayada Ali Sultan Ali, ADNOC, et al. The paper has not been peer reviewed. _ A well-candidate-recognition (WCR) data-analytics solution was developed to expedite the process of identifying unhealthy wells that may require rig or rigless interventions based on data integration, automation, and advanced data-driven models. The solution expedites the well-performance-review process to pinpoint candidates for stimulation, nitrogen lift, gas lift conversion, and water or gas shutoff, providing a flexible visualization platform to highlight hidden well-performance insight. Introduction Mature oil fields will face challenges in terms of increasing water cut, lack of pressure support, and the requirement of artificial lift. The critical concern is prioritization of remedial actions that are economically attractive with high returns and low risk. In the past, the asset was prioritizing the rig and rigless intervention candidates on a manual basis with no technical framework, mostly relying on engineers’ backgrounds and experience. Lack of understanding and failure to apply lessons learned from previous jobs were frequent outcomes because no single, comprehensive database or documentation existed that effectively captured well-intervention history. Every year, the operator requested a well-performance-review report for every reservoir containing hundreds of diagnostic plots that required massive manual updates, although the subject asset is a digital oil field fully instrumented with real-time data streaming. However, no tools were available to integrate periodic and nonperiodic required data. The complete paper addresses these challenges of integrating huge amounts of data and model frameworks and developing a systematic workflow to identify opportunities for production enhancement. Data-driven models, combined with the integration of static and dynamic data, enable proactive surveillance routines that allow engineers to focus on problematic wells and opportunity generation in a timely manner. Objective The WCR data-analytics solution was developed as part of the operator’s digital transformation strategy to streamline the process of improving diagnostics, identifying unhealthy wells, and reviewing value gain. The solution aims to help achieve the following objectives: - Facilitate well-performance review to pinpoint candidates for rig and rigless intervention - Provide a flexible visualization platform to highlight hidden well performance insight - Integration of real-time data and official databases - Create a collaborative environment for improved decision-making - Improve rigless success factor for the most-expensive activities - Optimize and prioritize the reservoir-monitoring plan (RMP)

Prediction of the axial strain development curve of soft clay under dynamic triaxial conditions based on LSTM

The dynamic triaxial test results of soft clay show that a long-term cyclic traffic load lead to significant deformation of soft clay. Considering that the dynamic triaxial test data of soft clay under cyclic loading have apparent time series characteristics, the long short-term memory (LSTM) model can be used to predict the deformation law of soft clay. Through a dynamic triaxial test of Shanghai soft clay, time series data, such as axial stress, pore water pressure, and axial strain were obtained to establish the sample data of the LSTM model. The LSTM model is then used to predict the axial strain development curve. The results showed that the LSTM model had a good fitting precision for the sample data under different dynamic stresses and frequencies, and its accuracy was above 97% in all conditions. The prediction results can reproduce the fluctuation law of the axial strain under cyclic loads and can be used to study elastic and plastic strains. The research results can provide technical support for disaster prevention and control in soft clay.

How can the digital economy alleviate multidimensional energy poverty? —Empirical evidence of 21 prefecture-level cities in Guangdong Province

Utilizing dynamic panel data from 21 Guangdong cities (2006–2021), this study employs a GMM model to examine the relationship between the digital economy (DE) and energy poverty (EP), analyzing its heterogeneous effects and robustness. The findings indicate that DE significantly reduces EP by enhancing energy utilisation, with varied impacts across regions and stages. Specifically, DE's contribution is more significant in economically developed Pearl River Delta regions, and increased after 2012 policy implementations. Furthermore, technological innovation acts as a threshold for DE's eradication of EP. Only when technological innovation reaches a certain threshold does the digital economy exhibit a significant effect on eradicating energy poverty. Based on these insights, policy recommendations are proposed to promote sustainable energy development in Guangdong and nationwide.

Human Capital Efficiency and Firm Performance of Quality-Certified Firms from EFQM Excellence Model: A Dynamic Panel Data Study

Abstract Purpose The study’s main purpose is to investigate the impacts of human capital efficiency (HCE) on the firm performance of non-certified and quality-certified firms from the European Foundation for Quality Management (EFQM) Excellence Model. The study also examines the relationship between firm performance and quality-certificates from the European Foundation. Design/methodology/approach By using a sample of 282 non-certified and 22 quality-certified firms from 2017 to 2021, the current study employed a two-step system generalized method of moments (GMM) estimation to analyse the empirical data. The dummy variable is used to examine the relationship between quality-certificates and firm performance. The dummy interaction term is employed to quantify the impacts of HCE on the firm’s performance for quality-certified firms. Findings The results revealed that quality-certificates and firm performance have a positive relationship. Quality-certified firms perform better and earn more profits than non-certified firms. HCE has a positive impact on firm performance for both types of firms. Moreover, the quality-certified firms utilize HCE in an efficient way to earn more profits compared to the non-certified firms. Originality This is the first study to use a comprehensive analysis to emphasize the HCE for non-certified and quality-certified firms separately. The effects of quality-certificates on firm performance in the context of HCE are also being highlighted for the first time in this research. Practical implications The current study’s findings are fruitful for academics, managers, researchers, policymakers, and other firm management. The findings will encourage the management of the firms to implement the total quality management (TQM) approach within their firms.

Conditional survival of patients with primary bone lymphoma of the spine: how survival changes after initial diagnosis.

The current survival prediction methodologies for primary bone lymphoma (PBL) of the spine are deficient. This study represents the inaugural utilization of conditional survival (CS) to assess the outcome of this disease. Moreover, our objective was to devise a CS-based nomogram for predicting overall survival (OS) in real-time for spinal PBL. Patients with PBL of the spine diagnosed between January 2000 and December 2015 were extracted from the Surveillance, Epidemiology, and End Results (SEER) database. The OS was determined through the Kaplan-Meier method. The CS characteristic of patients with spinal PBL was delineated, with the CS being estimated utilizing the formula: CS(α|β) = OS(α+β)/OS(β). CS(α|β) denotes the probability of additional α-year survivorship, assuming the patient has already survived β years after the time of observation. Three methods including univariate Cox regression, best subset regression (BSR) and the least absolute shrinkage and selection operator (LASSO) regression were used to identify predictors for CS-based nomogram construction. Kaplan-Meier analysis was executed to determine the OS rate for these patients, revealing a survival rate of 68% and subsequently 63% at the 3-year and 5-year mark respectively. We then investigated the CS patterning exhibited by these patients and discovered the survival of PBL in the spine progressively improved with time. Meanwhile, through three different prognostic factor selection methods, we identified the best predicter subset including age, tumor histology, tumor stage, chemotherapy and marital status, for survival prediction model construction. Finally, we successfully established and validated a novel CS-based nomogram model for real-time and dynamic survival estimation. Moreover, we further designed a risk stratification system to facilitate the identification of high-risk patients. This is the first study to analyze the CS pattern of PBL of the spine. And we have also developed a CS-based nomogram that provide dynamic prognostic data in real-time, thereby aiding in the formulation of personalized treatment strategies in clinical practice.

Development of a dynamic mathematical model of PEM electrolyser for integration into large-scale power systems

Proton exchange membrane (PEM) electrolyser stands as a promising candidate for sustainable hydrogen production from renewable energy sources (RESs). Given the fluctuating nature of RESs, accurate modelling of the PEM electrolyser is crucial. Nonetheless, complex models of the PEM electrolyser demand substantial time and resource investments when integrating them into a large-scale power system. The majority of introduced models in the literature are either overly intricate or fail to effectively reproduce the dynamic behaviour of the PEM electrolyser. To this end, this article aims to develop a model that not only captures the dynamic response of the PEM electrolyser, crucial for conducting flexibility studies in the power system, but also avoids complexity for seamless integration into large-scale simulations without comprising accuracy. To verify the model, it is validated against static and dynamic experimental data. Compared to the investigated experimental cases, the model exhibited an average error of 0.66% and 3.93% in the static and dynamic operation modes, respectively.

Governance, institutions, and climate change resilience in Sub-Saharan Africa: assessing the threshold effects

The concerns about institutional weakness in Sub-Saharan Africa (SSA) are central to the discussion on environmental degradation in the region. This study employs a robust dynamic panel data estimator to explore the relationships between institutions, governance, and environmental quality, focusing on the ecological footprint of 25 SSA nations from 1990 to 2020. The results reveal the threshold effects of the interaction between institutions and governance, following an inverted U-shape pattern. This suggests that beyond a certain ecological footprint, increased interaction between institutions and governance leads to a decrease in ecological footprint. Additionally, high institutional quality (IQ) is associated with a lower environmental impact, while improved governance contributes to mitigating the decline in institutional performance. The panel causality tests among the variables and control components indicate a one-way causal relationship from ecological footprint to governance, infrastructural development, and energy use. Conversely, a feedback causal relationship exists between IQ, industrialization, and ecological footprints. Policymakers should prioritize investments in energy consumption that align with environmental quality, ensuring efficient use of energy budgets through coordinated planning, execution, and transfer of sound energy practices to prevent duplication of efforts.

Fast Attack Detection for Cyber-Physical Systems Using Dynamic Data Encryption.

To defend the cyber-physical system (CPSs) from cyber-attacks, this work proposes an unified intrusion detection mechanism which is capable to fast hunt various types of attacks. Focusing on securing the data transmission, a novel dynamic data encryption scheme is developed and historical system data is used to dynamically update a secret key involved in the encryption. The core idea of the dynamic data encryption scheme is to establish a dynamic relationship between original data, secret key, ciphertext and its decrypted value, and in particular, this dynamic relationship will be destroyed once an attack occurs, which can be used to detect attacks. Then, based on dynamic data encryption, a unified fast attack detection method is proposed to detect different attacks, including replay, false data injection (FDI), zero-dynamics, and setpoint attacks. Extensive comparison studies are conducted by using the power system and flight control system. It is verified that the proposed method can immediately trigger the alarm as soon as attacks are launched while the conventional χ2 detection could only capture the attacks after the estimation residual goes over the predetermined threshold. Furthermore, the proposed method does not degrade the system performance. Last but not the least, the proposed dynamic encryption scheme turns to normal operation mode as the attacks stop.

Dynamic decision making for situational awareness using drones: Requirements, identification and comparison of decision support methods

Decision makers increasingly operate in real-time information-rich environments, where limited time is available for interpreting data to inform decisions. These environments are driven by static or mobile sensing devices that can provide numerous dynamic data points. A prominent approach in this space is to utilise drones, which can be deployed to gather targeted information. However, deciding how best to deploy available drones is nontrivial, and stands to benefit from decision support aids that plan routes. Such a system must operate under time constraints created by the changing attributes of routes as the situation unfolds. This study describes a dynamic decision support system (DSS) for situational awareness with drones. The system applies Multi-Criteria Decision Making (MCDM) methods within a dynamic genetic algorithm to provide a continuously revised ranking of routes. Five desiderata for dynamic decision support are presented. It is shown how a dynamic DSS can be equipped with declarative specification of preferences (Desiderata 1), dynamic revision of recommendations (Desiderata 2), and high diversity of options (Desiderata 3). The study then compares four MCDM methods, namely the Weighted Product Model (WPM), the Analytic Hierarchy Process (AHP), the Technique for Order of Preference by Similarity to Ideal Solution (TOPSIS), and the Preference Ranking Organization METHod for Enrichment Evaluation (PROMETHEE), with regards to how consistently they trade-off between criteria (Desiderata 4) and the stability of results under small changes to criteria values (Desiderata 5). To evaluate the trade-offs between criteria we analyse the smoothness of change in criteria outcomes as criteria weightings increase for each algorithm. The outcomes are calculated by automating the selection of routes in a case study that applies drones to the task of harbour management. The stability of results for the different MCDM methods are compared. Perturbations were applied to sets of routes ranked by each algorithm then each algorithm was reapplied and the magnitude of the changes in ranking was assessed. Overall, TOPSIS was found to be the algorithm which made the most consistent trade-offs between criteria, only under-performing another algorithm with respect to a single criterion. AHP and WPM were the next most consistent algorithms and PROMETHEE was the least consistent algorithm. TOPSIS was also found to be the most stable method under small changes to criteria values. AHP was the second most stable, followed by PROMETHEE and WPM respectively. The results show that TOPSIS achieves the best result for both Desiderata 4 and 5 and consequently the study finds TOPSIS to be an appropriate MCDM method for dynamic decision support.

A study on concept drift detection algorithms for real-world data streams

The arrival of data has changed in today's digital environment, becoming more dynamic. Dynamic data is characterized by its speed, variety, and infinite size. Data streams are one category of dynamic data. To address the issues with data streams, several strategies and AI models were developed. One such problem is concept drift, which results from changes in the data's distribution and eventually lowers the performance of the AI model. This means that regular updates to the model are required. In our work, we will analyse the performance using evaluation metrics and compare the effectiveness of the current error-based methods with window-based methods for real-world datasets.

Stock Market Prediction and Visualisation

Abstract: Stock price forecasting is a widely discussed and significant topic in both financial and academic circles. The stock market is inherently unpredictable, lacking clear rules for estimating or predicting share prices. Various methods, including technical analysis, fundamental analysis, time series analysis, and statistical analysis, have been employed to forecast stock prices. However, none of these methods consistently serve as reliable prediction tools. In this paper, we explore the implementation, prediction, and analysis of stock market prices. Artificial Neural Networks and Machine Learning prove effective for forecasting stock prices, returns, and modeling stock behavior. By conducting statistical analyses, we establish relationships between selected factors and share prices, contributing to more accurate predictions. While the stock market remains inherently uncertain, this paper aims to apply data analysis and prediction concepts to forecast stock prices. In the era of global digitization, stock market prediction has undergone significant technological advancements, transforming traditional trading models. As market capitalization continues to rise, stock trading becomes a focal point for financial investors. Analysts and researchers have developed tools and techniques to predict stock price movements, aiding decision-making. Advanced models leverage non-traditional textual data from social platforms for market prediction. Machine learning approaches, including text data analytics and ensemble methods, have significantly improved prediction accuracy. However, analyzing and predicting stock markets remains challenging due to dynamic, erratic, and chaotic data. This study explores machine learning-based approaches for stock market prediction, emphasizing a generic framework. By critically analyzing findings from the last decade (2011–2021) from digital libraries like ACM and Scopus, we provide insights for emerging researchers to delve into this promising area.