Real-time Data Processing Research Articles

Enhancing System Efficiency through AI, Edge Computing, and Resource Optimization in Modern Infrastructure

This paper explores innovative strategies for enhancing system efficiency in modern infrastructure by integrating artificial intelligence (AI), edge computing, and resource optimization techniques. As the complexity of infrastructure systems increases, traditional methods often fall short in addressing the evolving demands of operational efficiency and reliability. By leveraging AI algorithms for predictive analytics and resource allocation, and utilizing edge computing for real-time data processing, organizations can significantly improve performance and responsiveness. The study examines case studies that highlight successful implementations of these technologies across various sectors, including infrastructure monitoring, and grid maintenance. Insights from this research provide a framework for practitioners to adopt these advanced methodologies, ultimately leading to more resilient and efficient infrastructure systems.

Decentralized Machine Learning Framework for the Internet of Things: Enhancing Security, Privacy, and Efficiency in Cloud-Integrated Environments

The Internet of things (IoT) presents unique challenges for the deployment of machine learning (ML) models, particularly due to constraints on computational resources, the necessity for decentralized processing, and concerns regarding security and privacy in interconnected environments such as the Internet of cloud. In this paper, a novel decentralized ML framework is proposed for IoT environments characterized by wireless communication, dynamic data streams, and integration with cloud services. The framework integrates incremental learning algorithms with a robust decentralized model exchange protocol, ensuring that data privacy is preserved, while enabling IoT devices to participate in collaborative learning from distributed data across cloud networks. By incorporating a gossip-based communication protocol, the framework ensures energy-efficient, scalable, and secure model exchange, fostering effective knowledge sharing among devices, while addressing the potential security threats inherent in cloud-based IoT ecosystems. The framework’s performance was evaluated through simulations, demonstrating its ability to handle the complexities of real-time data processing in resource-constrained IoT environments, while also mitigating security and privacy risks within the Internet of cloud.

Optimization of artificial intelligence in localized big data real-time query processing task scheduling algorithm

Optimization of artificial intelligence in localized big data real-time query processing task scheduling algorithm

Enhancing financial reporting and management efficiency through enterprise resource planning (ERP) systems: A theoretical review for large-scale energy operations

Enterprise Resource Planning (ERP) systems have emerged as essential tools in streamlining financial reporting and improving management efficiency across various industries, including large-scale energy operations. This theoretical review explores how ERP systems enhance financial reporting by integrating real-time data, automating financial processes, and fostering transparency. In energy operations, where financial activities are complex and data-intensive, ERP systems centralize financial data, reducing errors, improving compliance, and supporting decision-making through enhanced visibility and accuracy. By automating tasks such as budgeting, forecasting, and financial statement generation, ERP systems enable energy companies to efficiently manage their financial resources, thus optimizing cost control and profitability. Additionally, ERP systems provide significant benefits for management efficiency, particularly in large-scale operations. The integration of financial, operational, and managerial processes within a single platform allows for better resource allocation, improved communication across departments, and faster response times to market fluctuations. These capabilities are crucial in the energy sector, where companies face volatile market conditions, regulatory pressures, and high operational risks. ERP systems enhance managerial decision-making by providing real-time insights into key performance indicators (KPIs), enabling executives to make data-driven decisions that support long-term strategic goals. However, implementing ERP systems in large-scale energy operations presents challenges, including high costs, lengthy implementation periods, and the need for employee training. This review also examines these barriers and suggests strategies for successful ERP adoption, including phased implementation, stakeholder engagement, and customization to industry-specific needs. In conclusion, ERP systems hold the potential to revolutionize financial reporting and management efficiency in large-scale energy operations. By leveraging ERP's real-time data integration and process automation, energy companies can significantly improve their financial management, enhance decision-making, and adapt more quickly to market changes. Keywords: ERP Systems, Financial Reporting, Management Efficiency, Large-Scale Energy Operations, Process Automation, Real-Time Data Integration, Decision-Making, Cost Control, Market Fluctuations, Energy Sector.

Automatic Indoor Thermal Comfort Monitoring Based on BIM and IoT Technology

Building Information Modeling (BIM) and Internet of Thing (IoT) integration technologies can improve operational efficiency in the operational phase of construction projects. Currently, research on the integration of BIM and IoT has yet to ensure secure data transmission and lacks real-time data processing capabilities. This study builds a framework to collect and analyze BIM and IoT data in real time. The framework is verified to be effective through a case study in an office building. The monitoring system can automatically calculate the Predicted Mean Vote (PMV) value, upload and update real-time temperature and humidity data, and visualize thermal comfort through heat maps. The proposed integration approach offers building management strategies to enhance thermal comfort in office environments, fostering a more inclusive and accommodating workspace that acknowledges the diverse cultural backgrounds of occupants.

Optimizing Business Operations through Edge Computing: Advancements in Real-Time Data Processing for the Big Data Era

The question of big data brought new opportunities and threats to business environment primarily in terms of processing increasingly large amounts of data in realtime. This paper examines the way in which edge computing can /should benefit business processes by offering improvements to real-time data analysis beyond what is provided by cloud-based systems while overcoming the challenge of latency, bandwidth and scalability. The study uses both primary and secondary data collected from 50 companies that use edge computing for processing of big data in industries including manufacturing, health, and retail. It involves cases where the factors are manifested, practices involving changes in numerical values of operations and other models involving the management of real-time data. Studies show that edge computing cuts down data processing delay by 40-60% on average, cuts data utilization and improves decision-making. This work also examines the use-cases of edge computing in order to demonstrate its potential across industries that must analyze data in near realtime, including self-driving automobiles, IoT gadgets, and logistics. Toward this end, this research provides an analysis of the ethical issues of decentralized data handling especially focusing on data security and data privacy. In response to the research questions of the paper, this study provides practical recommendations to help the companies in pursuing edge computing in the big data environment for the sake of sustaining market competitiveness. The research enriches the existing knowledge in business technology by presenting the possibility of change that edge computing brings.

Development of an Intelligent Coal Production and Operation Platform Based on a Real-Time Data Warehouse and AI Model

Smart mining solutions currently suffer from inadequate big data support and insufficient AI applications. The main reason for these limitations is the absence of a comprehensive industrial internet cloud platform tailored for the coal industry, which restricts resource integration. This paper presents the development of an innovative platform designed to enhance safety, operational efficiency, and automation in fully mechanized coal mining in China. This platform integrates cloud edge computing, real-time data processing, and AI-driven analytics to improve decision-making and maintenance strategies. Several AI models have been developed for the proactive maintenance of comprehensive mining face equipment, including early warnings for periodic weighting and the detection of common faults such as those in the shearer, hydraulic support, and conveyor. The platform leverages large-scale knowledge graph models and Graph Retrieval-Augmented Generation (GraphRAG) technology to build structured knowledge graphs. This facilitates intelligent Q&A capabilities and precise fault diagnosis, thereby enhancing system responsiveness and improving the accuracy of fault resolution. The practical process of implementing such a platform primarily based on open-source components is summarized in this paper.

Broadband and parallel multiple-order optical spatial differentiation enabled by Bessel vortex modulated metalens

Optical analog image processing technology is expected to provide an effective solution for high-throughput and real-time data processing with low power consumption. In various operations, optical spatial differential operations are essential in edge extraction, data compression, and feature classification. Unfortunately, existing methods can only perform low-order or selectively perform a particular high-order differential operation. Here, we propose and experimentally demonstrate a Bessel vortex modulated metalens composed of a single complex amplitude metasurface, which can perform multiple-order radial differential operations over a wide band by presetting the order of the corresponding Bessel vortex. This architecture further enables angle multiplexing to create multiple information channels that synchronously perform multi-order spatial differential operations, indicating the superiority of the proposed devices in parallel processing. Our approach may find various applications in artificial intelligence, machine vision, autonomous driving, and advanced biomedical imaging.

Designing Personalized Learning Paths for Foreign Language Acquisition Using Big Data: Theoretical and Empirical Analysis

This study introduces the Data-Driven Personalized Learning Model (DDPLM), a sophisticated framework designed to enhance foreign language acquisition through the integration of big data analytics. Implemented within the educational platforms Edmodo and Duolingo, DDPLM utilizes real-time data processing to tailor learning paths and content dynamically to individual learner needs. Our findings indicate significant improvements in language learning efficiency, engagement, and retention. The model’s adaptability across different digital environments showcases its potential scalability and effectiveness in various educational contexts. Additionally, the research addresses the critical role of personalized feedback and adaptive challenges in maintaining learner motivation and promoting deeper linguistic comprehension. The outcomes suggest that DDPLM significantly transforms traditional language education, making it more personalized, efficient, and aligned with individual learning preferences.

Enhancing the Heat Dissipation Efficiency of Computing Units Within Autonomous Driving Systems and Electric Vehicles

With the rapid development of autonomous driving technology and electric vehicles, the demand for computing units in vehicles has surged, particularly for high-density computing related to artificial intelligence, sensor fusion, and real-time data processing. This increase has posed significant heat dissipation challenges for automotive electronic systems. Effective heat dissipation is essential for ensuring system stability, safety, and extending the lifespan of these systems. This study explores the thermal design of computing units in current autonomous driving systems and electric vehicles. The electronic components within the computing units generate significant heat, but due to environmental constraints, fans can not be used for internal cooling, as their operation can draw in dust from the environment, contaminating the internal electronic components. Therefore, computing units are often designed with a sealed structure, utilizing the thermal conductivity of metal casings to quickly dissipate internal heat sources. The results of this study show that comparing embedded cooling modules within the casing to commonly used thermal pads reveals that changing the materials of the cooling module can significantly enhance cooling performance, noticeably reducing the temperature of the internal electronic components and minimizing the risk of overheating. Additionally, this can improve the overall reliability and performance of the system, providing new ideas and application prospects for future automotive thermal design.

What does e-invoice data bring to SNA and real-time economy?

This paper explores the potential of electronic invoice data to enhance the System of National Accounts (SNA) and facilitate a Real-Time Economy (RTE). The rise of data science and advancements in information and communication technologies have increased the use of big data in economic statistics. E-invoice data is being digitized in Europe to detect VAT fraud, but it also contains a vast amount of information on economic entities that make up the SNA. This study focuses on integrating electronic accounting information to improve the coverage, granularity, and update speed of SNA. The paper examines the concept of RTE, which emphasizes real-time data processing and automation, particularly in Estonia and Finland. It also highlights the benefits and challenges of using invoice data for economic statistics, including issues related to data storage formats, legislative systems, and the coordination of data linkages. The research demonstrates invoice data’s theoretical and practical applications for constructing Input–Output Tables (IOTs) and monitoring financial situations. Despite the technical and institutional hurdles, the study suggests integrating invoice data can significantly transform economic statistics.

Leveraging Big Data and AI for Enhanced Business Decision-Making: Strategies, Challenges, and Future Directions

Big data and artificial intelligence (AI) are the buzzwords of the moment in business decision-making. In this paper, I will show how predictive analytics, real-time data processing and natural language processing (NLP) are key strategies that allow businesses to optimise their operations and customer interaction. Moreover, through this paper I will present some of the challenges involved in the adoption of AI, such as the ethical and legal questions about data privacy, as well as the real problem of integrating AI systems within legacy business models. Furthermore, future trends in AI will be presented, such as the advances in quantum computing and the rise of so-called autonomous AI systems, that will define the future of decision-making in logistics, finance and a variety of other sectors. Overall, by addressing both the strategic advantages and the pitfalls involved in the adoption of AI based on some real business cases, this paper will provide a complete picture of what AI and big data can bring to decision-making as a tool for business success. This topic is of paramount importance as these technologies have not only brought a new wave of innovation but are also increasing the importance of human oversight of AI systems.

Multi-Layered Unsupervised Learning Driven by Signal-to-Noise Ratio-Based Relaying for Vehicular Ad Hoc Network-Supported Intelligent Transport System in eHealth Monitoring.

Every year, about 1.19 million people are killed in traffic accidents; hence, the United Nations has a goal of halving the number of road traffic deaths and injuries by 2030. In line with this objective, technological innovations in telecommunication, particularly brought about by the rise of 5G networks, have contributed to the development of modern Vehicle-to-Everything (V2X) systems for communication. A New Radio V2X (NR-V2X) was introduced in the latest Third Generation Partnership Project (3GPP) releases which allows user devices to exchange information without relying on roadside infrastructures. This, together with Massive Machine Type Communication (mMTC) and Ultra-Reliable Low Latency Communication (URLLC), has led to the significantly increased reliability, coverage, and efficiency of vehicular communication networks. The use of artificial intelligence (AI), especially K-means clustering, has been very promising in terms of supporting efficient data exchange in vehicular ad hoc networks (VANETs). K-means is an unsupervised machine learning (ML) technique that groups vehicles located near each other geographically so that they can communicate with one another directly within these clusters while also allowing for inter-cluster communication via cluster heads. This paper proposes a multi-layered VANET-enabled Intelligent Transportation System (ITS) framework powered by unsupervised learning to optimize communication efficiency, scalability, and reliability. By leveraging AI in VANET solutions, the proposed framework aims to address road safety challenges and contribute to global efforts to meet the United Nations' 2030 target. Additionally, this framework's robust communication and data processing capabilities can be extended to eHealth monitoring systems, enabling real-time health data transmission and processing for continuous patient monitoring and timely medical interventions. This paper's contributions include exploring AI-driven approaches for enhanced data interaction, improved safety in VANET-based ITS environments, and potential applications in eHealth monitoring.

Using Online Algorithms to Solve NP-Hard Problems

This paper explores the application of online algorithms to tackle NP-hard problems, a class of computational challenges characterized by their intractability and wide-ranging real-world implications. Unlike traditional offline algorithms that have access to complete input data, online algorithms make decisions sequentially, often under constraints of incomplete information. We investigate various strategies, including greedy approaches, randomization, and competitive analysis, to assess their effectiveness in solving NP-hard problems such as the Traveling Salesman Problem, the Knapsack Problem, and the Set Cover Problem. Our analysis highlights the trade-offs between solution quality and computational efficiency, emphasizing the significance of the competitive ratio in evaluating algorithm performance. Additionally, we discuss the practical applications of online algorithms in dynamic environments, such as real-time systems and streaming data processing. Through a comprehensive review of existing literature and novel algorithmic designs, we aim to provide insights into the viability of online algorithms as a robust framework for addressing NP-hard problems in scenarios where immediate decision-making is crucial. The findings underscore the potential for future research to enhance these algorithms, making them increasingly applicable in complex, real-world contexts.

Leveraging SAP Analytics Cloud for Data-Driven Decision Making in Modern Enterprises

In today's fast-paced business environment, organizations are increasingly relying on data analytics to make informed decisions. SAP Analytics Cloud (SAC) has emerged as a leading solution for integrating data from various sources, visualizing trends, and driving data-driven decisions. This paper examines the functionalities of SAC, its impact on decision-making processes, and how enterprises use it to gain a competitive edge. Key features such as predictive analytics, machine learning, and real-time data processing are discussed. The paper also includes case studies that illustrate the practical application of SAC in enterprise environments.

The Future of Data Warehousing: Trends, Technologies, and Challenges in the Era of Big Data, Cloud Computing, and Artificial Intelligence

This article explores the future of data warehousing, discussing emerging trends, technologies, and challenges shaping the landscape of data management and analytics in the era of big data, cloud computing, and artificial intelligence. It delves into topics such as the rise of cloud data warehouses, the increasing adoption of artificial intelligence and machine learning in data warehousing for advanced analytics and automation, the growing importance of data governance, privacy, and security in the face of evolving regulations, and the need for real-time data processing and analytics to support agile decision-making. The article also discusses the challenges faced by organizations in adopting and implementing these new technologies, such as the need for skilled personnel, the complexity of data integration from diverse sources, the cost of infrastructure and migration, and the ethical considerations surrounding the use of AI and ML in data warehousing. It concludes by highlighting the potential of data warehousing to drive innovation, improve operational efficiency, and gain a competitive advantage in the digital age.

Review Paper for SOC Estimation Techniques: Challenges and Future Areas for Improvement

This paper explores the advancements and challenges in State of Charge (SOC) estimation techniques for lithium-ion batteries, particularly within the context of electric vehicles (EVs) and renewable energy systems. As the global demand for sustainable energy solutions grows, accurate SOC estimation becomes essential for optimizing battery performance, enhancing safety, and extending battery life. The paper categorizes various SOC estimation methods into three primary approaches: direct measurement techniques, model-based methods, and data-driven algorithms. Direct measurement techniques, such as Coulomb counting and Open Circuit Voltage (OCV), are straightforward but often lack precision under dynamic conditions. Model-based methods, including Equivalent Circuit Models (ECM) and electrochemical models, provide detailed insights into battery behavior but can be computationally intensive. In contrast, data-driven approaches utilizing machine learning algorithms exhibit promising adaptability and accuracy, albeit relying heavily on large datasets. Despite these advancements, several limitations persist. Current SOC estimation methods are hindered by their dependence on accurate battery models and quality data, which can degrade over time. Furthermore, hybrid methods, which combine strengths from various techniques, introduce complexity and demand substantial computational resources. The integration of SOC estimation techniques in EV applications poses additional challenges due to varying operational conditions, necessitating efficient processing of real-time data from multiple sensors. Emerging trends in Battery Management Systems (BMS) are also examined, highlighting the role of AI and machine learning in improving real-time SOC computations and predictive capabilities. Cloud-based BMS systems are identified as a significant development for remote monitoring and control, enhancing the overall reliability of battery systems. This paper aims to provide a comprehensive overview of SOC estimation techniques, identify ongoing challenges, and suggest future research directions to enhance the effectiveness of battery management strategies in the evolving landscape of energy systems. DOI: https://doi.org/10.52783/pst.906

Low carbon energy industry and network economy prediction based on sensors and real-time data processing

The widespread use of sensors provides a large amount of real-time data for enterprises and decision-makers, providing more accurate information support for the prediction and decision-making of the network economy. With the help of Internet of Things technology, the data collected by sensors is transmitted in real time to data centers or cloud platforms. Real time data processing technology is used to clean, denoise, and analyze the data in real time, ensuring the accuracy and timeliness of the data. Perform pattern recognition and trend analysis on historical data, discover hidden patterns and correlations in the data, construct predictive and decision-making models to predict future economic trends and make reasonable decisions, continuously optimize and adjust the model to adapt to real-time data changes and dynamic changes in the economic environment, and improve the accuracy and efficiency of the model. The experimental results show that the network economy prediction and decision-making model based on sensor networks and Internet of Things technology can more accurately predict economic development trends, improve decision-making efficiency and accuracy. The large amount of data provided by sensor networks provides sufficient support for the construction and optimization of models.

Enhancing Energy Systems and Rural Communities through a System of Systems Approach: A Comprehensive Review

Today’s increasingly complex energy systems require innovative approaches to integrate and optimize different energy sources and technologies. In this paper, we explore the system of systems (SoS) approach, which provides a comprehensive framework for improving energy systems’ interoperability, efficiency, and resilience. By examining recent advances in various sectors, including photovoltaic systems, electric vehicles, energy storage, renewable energy, smart cities, and rural communities, this study highlights the essential role of SoSs in addressing the challenges of the energy transition. The principal areas of interest include the integration of advanced control algorithms and machine learning techniques and the development of robust communication networks to manage interactions between interconnected subsystems. This study also identifies significant challenges associated with large-scale SoS implementation, such as real-time data processing, decision-making complexity, and the need for harmonized regulatory frameworks. This study outlines future directions for improving the intelligence and autonomy of energy subsystems, which are essential for achieving a sustainable, resilient, and adaptive energy infrastructure.

Prototype for Multi-UAV Monitoring–Control System Using WebRTC

Most unmanned aerial vehicle (UAV) ground control station (GCS) solutions today are either web-based or native applications, primarily designed to support a single UAV. In this paper, our research aims to provide an open, universal framework intended for rapid prototyping, addressing these objectives by developing a Web Real-Time Communication (WebRTC)-based multi-UAV monitoring and control system for applications such as automated power line inspection (APOLI). The APOLI project focuses on identifying damage and faults in power line insulators through real-time image processing, video streaming, and flight data monitoring. The implementation is divided into three main parts. First, we configure UAVs for hardware-accelerated streaming using the GStreamer framework on the NVIDIA Jetson Nano companion board. Second, we develop the server-side application to receive hardware-encoded video feeds from the UAVs by utilizing a WebRTC media server. Lastly, we develop a web application that facilitates communication between clients and the server, allowing users with different authorization levels to access video feeds and control the UAVs. The system supports three user types: pilot/admin, inspector, and customer. Our research aims to leverage the WebRTC media server framework to develop a web-based GCS solution capable of managing multiple UAVs with low latency. The proposed solution enables real-time video streaming and flight data collection from multiple UAVs to a server, which is displayed in a web application interface hosted on the GCS. This approach ensures efficient inspection for applications like APOLI while prioritizing UAV safety during critical scenarios. Another advantage of the solution is its integration compatibility with platforms such as cloud services and native applications, as well as the modularity of the plugin-based architecture offered by the Janus WebRTC server for future development.