Detection Of Non-technical Losses Research Articles

Hybrid non-technical-loss detection in fog-enabled smart grids

Electricity theft is one of the major factors contributing to non-technical-losses (NTLs) in power distribution networks. NTL fraud includes frauds in which consumers profit unlawfully by manipulating smart meters (SMs), intruding networks, and so forth. This unlawful act not only undermines people’s efforts to conserve energy but also disrupts the regular billing cycle for power utilities, causing financial losses. In order to help utility companies solve the problems of inefficient electricity inspection and irregular power consumption, two NTL Detection schemes are proposed for NTL fraud prediction. Both schemes employed the auto-regressive integrated moving average (ARIMA) and the machine learning technique to predict the consumer behavior fraud pattern efficiently. Furthermore, extensive simulations are conducted on real-world electricity consumption data sets, which show that the proposed schemes outperformed state-of-the-art solutions and achieved an accuracy of 98%, a precision of 98.6%, a recall of 98.2%, an AUC of 97.9%, and an F1 score of 98.4%.

Detection of Non-Technical Losses on a Smart Distribution Grid Based on Artificial Intelligence Models

Non-technical losses (NTL) have been a growing problem over the years, causing significant financial losses for electric utilities. Among the methods for detecting this type of loss, those based on Artificial Intelligence (AI) have been the most popular. Many works use the electricity consumption profile as an input for AI models, which may not be sufficient to develop a model that achieves a high detection rate for various types of energy fraud that may occur. In this paper, using actual electricity consumption data, additional statistical and temporal features based on these data are used to improve the detection rate of various types of NTL. Furthermore, a model that combines both the electricity consumption data and these features is developed, achieving a better detection rate for all types of fraud considered.

Exploiting machine learning to tackle peculiar consumption of electricity in power grids: A step towards building green smart cities

AbstractThe increasing demand for electricity in daily life highlights the need for Smart Cities (SC) to use energy efficiently. Both technical and Non‐Technical Losses (NTL), particularly those resulting from electricity theft, present powerful obstacles; NTL alone can reach billions of dollars. Although Machine Learning (ML) based approaches for NTL detection have been embraced by numerous utilities, there is still a lack of thorough analysis of these methods. Limited research exists on NTL identification evaluation criteria and unbalanced data management in the context of SC. This research compares ML algorithms and data balancing methods to optimize electricity consumption detection. The given research applied the 15 ML techniques of Logistic regression, Bernoulli naive Bayes, Gaussian naive Bayes, K‐Nearest Neighbour, perceptron, passive‐aggressive classifier, quadratic discriminant analysis, SGD classifier, ridge classifier, linear discriminant analysis, decision tree, nearest centroid classifier, multi‐nomial naive Bayes, complement naive Bayes and dummy classifier. While SMOTE, AdaSyn, NRAS, and CCR are considered for data balancing. AUC, F1‐score, and seven relevant performance metrics were used for comparison. We have also implemented SHapely Additive exPlanations (SHAP) for feature importance and model interpretation. Results show varying classifier performance with different balancing methods, emphasizing data preprocessing's role in NTL detection for smart grid security.

A novel and effective method based deep learning model for detecting non-technical electricity losses

<p>This study focused on non-technical electricity loss detection. As mentioned, non-technical losses (NTLs) affect utilities and economies financially. Electricity theft, fraud, and metering issues can create NTLs. NTL generate most distribution losses in electrical power networks, costing utilities a lot. NTL detection approaches are data-focused, network-oriented, or hybrid. Data-oriented writing dominated this analysis. After data collection and cleaning and labeling the unlabeled dataset with a target, a methodology was supplied that used four machine learning techniques random forest, decision tree, KNN, and logistic regression and four neural network models-DNN, CNN, CNN-LSTM, and CNN-GRU. The CNN and DNN model have the best accuracy, stability, fast learning, and training time.</p>

Predictive Fraud Detection: An Intelligent Method for Internet of Smart Grid Things Systems

Today, grid resilience as a feature has become non-negotiable, significantly when power interruptions can impact the economy. The widespread popularity of Intelligent Electronic Devices (IED) operating as smart meters enables an immense amount of fine-grained electricity consumption data to be collected. However, risk can still exist in the Smart Grid (SG), as valuable data are exchanged among SG systems; theft or alteration of this data could violate consumer privacy. The Internet of Things for Smart Grid (IoSGT) is a promising ecosystem of different technologies that coordinate with each other to pave the way for new SG applications and services. As a use case of IoSGT for future SG applications and services, fraud detection, ıNon-technical losses (NTL), emerges as an important application for Smart Grid (SG) scenarios. A substantial amount of electrical energy is lost throughout the distribution system, and these losses are divided into two types: technical and non-technical. Non-technical losses (NTL) are any electrical energy consumed and not invoiced. They may occur due to illegal connections, issues with energy meters such as delay in the installation or reading errors, contaminated, defective, or non-adapted measuring equipment, very low valid consumption estimates, faulty connections, and disregarded customers. Non-technical losses are the primary cause of revenue loss in the SG. According to a recent study, electrical utilities lose $89.3 Billion per year due to non-technical losses. This article proposes ensemble predictor-based time series classifiers for NTL detection. The proposed predictor ministers the user’s energy consumption as a data input for classification, from splitting the data to executing the classifier.It encompasses the temporal aspects of energy consumption data during preprocessing, training, testing, and validation stages. The suggested predictor is Time Series (TS) oriented, from data splitting to the classifier’s performance. Overall, our best results have been recorded in the fraud detection-based time series classifiers (TSC) model scoring an improvement in the empirical performance metrics by 10% or more over the other developed models.

Detection of Non-Technical Losses in Irrigant Consumers through Artificial Intelligence: A Pilot Study

Non-technical losses (NTLs) verified in the power distribution grids cause great financial losses to power utilities. In rural distribution grids, fraudulent consumers contribute to technical problems. The Southern region in Brazil contains more than 70% of the total rice production and power irrigation systems. These systems operate seasonally in distribution grids with high NTL conditions. This work aimed to present an artificial intelligence-based system to help power distribution companies detect potential consumers causing NTLs. This minimizes the challenge of maintaining compliance with current regulations and ensuring the quality of services and products. In the proposed methodology, historical energy consumption information, meteorological data, satellite images, and data from energy suppliers are processed by artificial intelligence, indicating the suspicious consumer units of NTL. This work presents every step developed in the proposed methodology and the tool application in a pilot area. We detected a high number of consumers responsible for NTLs, with an accuracy of 63% and an average reduction of 78% in the search area. These results corroborated the effectiveness of the tool and instigated the research team to expand the application to other rice production areas.

Data-oriented ensemble predictor based on time series classifiers for fraud detection

Non-Technical Losses (NTL) remain a challenge because electricity theft is prevalent in traditional meters and smart metering systems and structures. They cause financial losses that affect the security of supply and lead to a cooperative burden because NTL are incorporated in the expense tariff and are paid by all customers in countries such as India, China, Brazil, Tunisia, Uruguay, and others. A significant number of methods have been proposed to detect NTL, but they cannot precisely recognize this type of fraud, which enables companies to better identify the fraud’s origin and evaluate its financial impact. In addition, it is important to combine several Time-Series Classification (TSC) algorithms which consider the time-dependent nature of energy consumption data. We propose a data-oriented heterogeneous ensemble predictor based on time series classifiers for NTL detection, called DETECT. It classifies energy consumption samples either as honest or as fraudulent and further categorizes the type of fraud which might have been committed based on the analysis of the consumption patterns of each sample. DETECT is a fraud detection algorithm that has the ability to analyze and classify NTL frauds effectively regardless of the dataset. Using our proposed approach, we obtained a performance improvement with a Detection Rate (DR) value equal to 93.45% and a False Positive Rate (FPR) value equal to 1.61%. DETECT focuses on time-series data, which enables the development of a method that better interprets real-world scenarios and it is more error-resistant.

HyMOTree: Automatic Hyperparameters Tuning for Non-Technical Loss Detection Based on Multi-Objective and Tree-Based Algorithms

The most common methods to detect non-technical losses involve Deep Learning-based classifiers and samples of consumption remotely collected several times a day through Smart Meters (SMs) and Advanced Metering Infrastructure (AMI). This approach requires a huge amount of data, and training is computationally expensive. However, most energy meters in emerging countries such as Brazil are technologically limited. These devices can measure only the accumulated energy consumption monthly. This work focuses on detecting energy theft in scenarios without AMI and SM. We propose a strategy called HyMOTree intended for the hyperparameter tuning of tree-based algorithms using different multiobjective optimization strategies. Our main contributions are associating different multiobjective optimization strategies to improve the classifier performance and analyzing the model’s performance given different probability cutoff operations. HyMOTree combines NSGA-II and GDE-3 with Decision Tree, Random Forest, and XGboost. A dataset provided by a Brazilian power distribution company CPFL ENERGIA™ was used, and the SMOTE technique was applied to balance the data. The results show that HyMOTree performed better than the random search method, and then, the combination between Random Forest and NSGA-II achieved 0.95 and 0.93 for Precision and F1-Score, respectively. Field studies showed that inspections guided by HyMOTree achieved an accuracy of 76%.

Non-technical losses detection with Gramian angular field and deep residual network

Non-technical losses (NTL) refer to unrecorded power consumption generated by dishonest customers, which is a substantial issue affecting the power system stability and economic efficiency of the power grid. The detection of dishonest customers is hindered by the complexity of NTL such as data feature selection, retention time feature, and power consumption pattern judgment. This work addresses these issues using meter recording data, proposing an NTL detection approach with Gram’s angle field (GAF) and deep residual network (ResNet). Principal component analysis (PCA) method is applied to compress multiple electricity detection indexes, which aims to obtain multi-dimensional power consumption data characteristics without changing its timing characteristics. The GAF method is used to convert the time-series power features of individual users into a two-dimensional image, achieving the purpose of maintaining the user’s time-series features and user-based units. The images generated by the GAF method, which contain information about the electricity consumption characteristics of many customers, are classified by ResNet to highlight customers with NTL. The claimed algorithm was tested on a dataset consisting of both fraudulent and non-fraudulent subscriber data. The results demonstrated that the NTL detection method based on GAF and ResNet is superior to the traditional NTL detection method and has high accuracy.

A case study of improving a non-technical losses detection system through explainability

AbstractDetecting and reacting to non-technical losses (NTL) is a fundamental activity that energy providers need to face in their daily routines. This is known to be challenging since the phenomenon of NTL is multi-factored, dynamic and extremely contextual, which makes artificial intelligence (AI) and, in particular, machine learning, natural areas to bring effective and tailored solutions. If the human factor is disregarded in the process of detecting NTL, there is a high risk of performance degradation since typical problems like dataset shift and biases cannot be easily identified by an algorithm. This paper presents a case study on incorporating explainable AI (XAI) in a mature NTL detection system that has been in production in the last years both in electricity and gas. The experience shows that incorporating this capability brings interesting improvements to the initial system and especially serves as a common ground where domain experts, data scientists, and business analysts can meet.

ELECTRICITY THEFT DETECTION USING MACHINE LEARNING

Non-technical losses (NTL) in electric power grids arise through electricity theft, broken electric meters or billing errors. They can harm the power supplier as well as the whole economy of a country through losses of up to 40% of the total power distribution. For NTL detection, researchers use artificial intelligence to analyse data. This work is about improving the extraction of more meaningful features from a data set. With these features, the prediction quality will increase.

Non-technical losses detection employing adversarial domain adaptation

Non-technical losses (NTL) in power grid not only cause significant financial loss but also reduce the quality of supply for the distribution network operators (DNOs). In recent years, the frequency of power theft activities related to NTL have been increased rapidly. The data-based detection approach for NTLs has been studied by researchers from all over the world thoroughly, but the region domain shift issues and the lack of labelled data limited its applicability. In this paper, an adversarial learning-based approach is proposed to alleviate the domain shift problem, named Cross-Regional Adaptive Network (CAN). First of all, a multilayer Convolutional Neural Networks (CNN) feature extractor maps the training and application scenario data into the same feature space. After that the feature extractor and the domain classifier are trained against each other by inversing extractor’s gradients. Finally, the training and application scenario data are indistinguishable for the domain classifier, and the feature extractor can extract domain invariant features. Experiments are conducted on two sets of electricity consumption data captured by utility company to verify the effectiveness of the proposed method.

Non-Hardware-Based Non-Technical Losses Detection Methods: A Review

Non-Technical Losses (NTL) represent a serious concern for electric companies. These losses are responsible for revenue losses, as well as reduced system reliability. Part of the revenue loss is charged to legal consumers, thus, causing social imbalance. NTL methods have been developed in order to reduce the impact in physical distribution systems and legal consumers. These methods can be classified as hardware-based and non-hardware-based. Hardware-based methods need an entirely new system infrastructure to be implemented, resulting in high investment and increased cost for energy companies, thus hampering implementation in poorer nations. With this in mind, this paper performs a review of non-hardware-based NTL detection methods. These methods use distribution systems and consumers’ data to detect abnormal energy consumption. They can be classified as network-based, which use network technical parameters to search for energy losses, data-based methods, which use data science and machine learning, and hybrid methods, which combine both. This paper focuses on reviewing non-hardware-based NTL detection methods, presenting a NTL detection methods overview and a literature search and analysis.

Detecting Nontechnical Losses in Smart Meters Using a MLP-GRU Deep Model and Augmenting Data via Theft Attacks

The current study uses a data-driven method for Nontechnical Loss (NTL) detection using smart meter data. Data augmentation is performed using six distinct theft attacks on benign users’ samples to balance the data from honest and theft samples. The theft attacks help to generate synthetic patterns that mimic real-world electricity theft patterns. Moreover, we propose a hybrid model including the Multi-Layer Perceptron and Gated Recurrent Unit (MLP-GRU) networks for detecting electricity theft. In the model, the MLP network examines the auxiliary data to analyze nonmalicious factors in daily consumption data, whereas the GRU network uses smart meter data acquired from the Pakistan Residential Electricity Consumption (PRECON) dataset as the input. Additionally, a random search algorithm is used for tuning the hyperparameters of the proposed deep learning model. In the simulations, the proposed model is compared with the MLP-Long Term Short Memory (LSTM) scheme and other traditional schemes. The results show that the proposed model has scores of 0.93 and 0.96 for the area under the precision–recall curve and the area under the receiver operating characteristic curve, respectively. The precision–recall curve and the area under the receiver operating characteristic curve scores for the MLP-LSTM are 0.93 and 0.89, respectively.

The detection of non-technical losses and electricity theft by smart meter data and Artificial Intelligence in the context of electric distribution utilities: A comprehensive review

The detection of non-technical losses and electricity theft by smart meter data and Artificial Intelligence in the context of electric distribution utilities: A comprehensive review

Artificial intelligence for energy fraud detection: a review

Energy fraud in the distribution sector of electric utility includes electricity theft, meter tampering, or billing error. This fraud causing non-technical loss has led to an economic loss of the company. In order to detect and minimize fraud, different technologies have been used. From conventional methods to development in the field of artificial intelligence (AI), effective and reliable fraud detection methods have been proposed. This paper first provides an overview of different proposed methods for non-technical loss detection and evaluate the advantage and limitation of using those methods. Furthermore, several supervised and unsupervised machine learning methods for detecting electricity theft are discussed in summary along with their metrics and attributes used. Finally, these methods are classified based on the overall operation and the parameters used. This paper provides comparisons of several fraud detection methods using AI along with their weak and strong points and this information is very useful for the researchers who are working in the field of AI method for detecting fraud.

Electricity theft detection using big data and genetic algorithm in electric power systems

Non-technical losses (NTLs) are one of the major causes of revenue losses for electric utilities. In the literature, various machine learning (ML)/deep learning (DL) approaches are employed to detect NTLs. The existing studies are mostly concerned with tuning the hyperparameters of ML/DL methods for efficient detection of NTL, i.e., electricity theft detection. Some of them focus on the selection of prominent features from data to improve the performance of electricity theft detection. However, the curse of dimensionality affects the generalization ability of ML/DL classifiers and leads to computational, storage, and overfitting problems. Therefore, to deal with the above-mentioned issues, this study proposes a system based on metaheuristic techniques (artificial bee colony and genetic algorithm) and denoising autoencoder for electricity theft detection using big data in electric power systems. The former (metaheuristics) are used to select prominent features, while the latter is utilized to extract high variance features from electricity consumption data. Firstly, 11 new features are synthesized using statistical and electrical parameters from the user’s consumption history. Then, the synthesized features are used as input to metaheuristic techniques to find a subset of optimal features. Finally, the optimal features are fed as input to the denoising autoencoder to extract features with high variance. The ability of both metaheuristic and autoencoder techniques to select and extract features is measured using a support vector machine. The proposed system reduces the overfitting, storage, and computational overhead of ML classifiers. Moreover, we perform several experiments to verify the effectiveness of our proposed system and results reveal that the proposed system has better performance than its counterparts.

Non-Technical Loss Detection Using Deep Reinforcement Learning for Feature Cost Efficiency and Imbalanced Dataset

One of the problems of the electricity grid system is electricity loss due to energy theft, which is known as non-technical loss (NTL). The sustainability and stability of the grid system are threatened by the unexpected electricity losses. Energy theft detection based on data analysis is one of the solutions to alleviate the drawbacks of NTL. The main problem of data-based NTL detection is that collected electricity usage dataset is imbalanced. In this paper, we approach the NTL detection problem using deep reinforcement learning (DRL) to solve the data imbalanced problem of NTL. The advantage of the proposed method is that the classification method is adopted to use the partial input features without pre-processing method for input feature selection. Moreover, extra pre-processing steps to balance the dataset are unnecessary to detect NTL compared to the conventional NTL detection algorithms. From the simulation results, the proposed method provides better performances compared to the conventional algorithms under various simulation environments.

Non-technical losses detection in power system

The digitization of distribution networks enables the collection of big data from which it is necessary to draw conclusions and detect anomalies among electricity consumers. This paper explains methodologies to detect non-technical losses, commercial losses, and electricity theft. Based on monthly electricity consumption measurements, possible and prevalent cases of anomalies and theft among consumers are identified. Indicators that can detect anomalies have been proposed for such types of load diagrams. The sensitivity of the indicators to different types of consumers was analyzed. The applicability of this methodology was examined for a set of real measurements, and its advantages were pointed out. This concept represents a good recommendation, as it is possible to observe and detect irregularities in electricity consumption.

Non-Technical Losses Detection Using Autoencoder and Bidirectional Gated Recurrent Unit to Secure Smart Grids

Electricity theft is considered one of the most significant reasons of the non technical losses (NTL). It negatively influences the utilities in terms of the power supply quality, grid’s safety, and economic loss. Therefore, it is necessary to effectively deal with the electricity theft problem. For detecting electricity theft in smart grids (SGs), an efficient and state-of-the-art approach is designed in the underlying work based on autoencoder and bidirectional gated recurrent unit (AE-BiGRU). The proposed approach consists of six components: (1) data collection, (2) data preparation, (3) data balancing, (4) feature extraction, (5) classification and (6) performance evaluation. Moreover, bidirectional gated recurrent unit (BiGRU) is used for the identification of the anomalies in electricity consumption (EC) patterns caused due to factors like family formation changes, holidays, parties, and so on, which are referred as non-theft factors. The proposed autoencoder-bidirectional gated recurrent unit (AE-BiGRU) model employs the EC data acquired from state grid corporation of China (SGCC) for simulations. Furthermore, it is visualized from the simulation results that 90.1% accuracy and 10.2% false positive rate (FPR) are obtained by the proposed model. The results are better than different existing classifiers, i.e., logistic regression (LR), decision tree (DT), extreme gradient boosting (XGBoost), gated recurrent unit (GRU), etc.