Cyber-physical Frameworks Research Articles

Review and Evaluation of Reinforcement Learning Frameworks on Smart Grid Applications

With the rise in electricity, gas and oil prices and the persistently high levels of carbon emissions, there is an increasing demand for effective energy management in energy systems, including electrical grids. Recent literature exhibits large potential for optimizing the behavior of such systems towards energy performance, reducing peak loads and exploiting environmentally friendly ways for energy production. However, the primary challenge relies on the optimization of such systems, which introduces significant complexities since they present quite dynamic behavior. Such cyberphysical frameworks usually integrate multiple interconnected components such as power plants, transmission lines, distribution networks and various types of energy-storage systems, while the behavior of these components is affected by various external factors such as user individual requirements, weather conditions, energy demand and market prices. Consequently, traditional optimal control approaches—such as Rule-Based Control (RBC)—prove inadequate to deal with the diverse dynamics which define the behavior of such complicated frameworks. Moreover, even sophisticated techniques—such as Model Predictive Control (MPC)—showcase model-related limitations that hinder the applicability of an optimal control scheme. To this end, AI model-free techniques such as Reinforcement Learning (RL) offer a fruitful potential for embedding efficient optimal control in cases of energy systems. Recent studies present promising results in various fields of engineering, indicating that RL frameworks may prove the key element for delivering efficient optimal control in smart buildings, electric vehicle charging and smart grid applications. The current paper provides a comprehensive review of RL implementations in energy systems frameworks—such as Renewable Energy Sources (RESs), Building Energy-Management Systems (BEMSs) and Electric Vehicle Charging Stations (EVCSs)—illustrating the benefits and the opportunities of such approaches. The work examines more than 80 highly cited papers focusing on recent RL research applications—between 2015 and 2023—and analyzes the model-free RL potential as regards the energy systems’ control optimization in the future.

A Self-Adaptive and Self-Learning Methodology for Wireless Intrusion Detection using Deep Neural Network

Cyber physical systems combine both the physical as well as the computation process. Embedded computers and systems monitor to control the physical forms with feedback loops which have an effect on computations and contrariwise. A vast number of failures and cyber-attacks are present in the cyber physical systems, which leads to a limited growth and accuracy in the intrusion detection system and thus implementing the suitable actions which may be taken to reduce the damage to the system. As Cyber-physical systems square measure but to be made public universally, the applying of the instruction detection mechanism remains open presently. As a result, the inconvenience is made to talk about the way to suitably apply the interruption location component to Cyber physical frameworks amid this paper. By analysing the unmistakable properties of Cyber-physical frameworks, it extraordinary to diagram the exact necessities 1st. At that point, the arranging characterize of the intrusion discovery component in Cyber-physical frameworks is introduced in terms of the layers of framework and particular location procedures. At long last, a few imperative investigation issues unit known for edifying the following considers.

Space–time multiple regression model for grid-based population estimation in urban areas

ABSTRACTWe can collect, store, and analyze a huge amount of information about human mobility and social interaction activities due to the emergence of information and communication technologies and location-enabled mobile devices under cyber physical system frameworks. The high spatial resolution of population data on a multi-temporal scale is required by transport planners, human geographers, social scientists, and emergency management teams. In this study, we build a space-time multiple regression model to estimate grid-based (500 m × 500 m) spatial resolution at multi-temporal scale (30-min intervals) population data based on the space-time relationship among geospatially enabled person trip (PT) survey data and incorporate both mobile call (MC) and geotagged Twitter (GT) data. Since using geospatially enabled PT survey data as dependent variables enables us to acquire actual population amounts, which strongly depend on MCs and social interaction activities. Although many grids have a strong correlation between PT and MC/GT, some show fewer correlation results, especially where the grids have factories, schools, and workshops in which fewer MCs are found but a large population is presented. Although GT data are sparser than MCs, people from amusement and tourist areas can be detected by GT data. The space-time multiple regression model can also estimate the different amounts of populations based on human travel behavior that changes over space and time. According to accuracy assessments, the night-time estimated results, especially between 00:00 and 06:30, strongly correlate with national census data except in places where the grids have railway and subway stations.