Ensemble Of Deep Neural Networks Research Articles

Fuzzified deep neural network ensemble approach for estimating cycle time range

Because of the high uncertainty associated with predicting the cycle time of a job in a complex manufacturing system, this task is a challenge for production planners. To replace an inaccurate cycle time forecast, the range of cycle time is estimated. To estimate the cycle time range of a job as precisely as possible, a fuzzified deep neural network (FDNN) ensemble approach is proposed in this paper. This approach involves the following steps. First, a deep neural network (DNN) is constructed to predict the cycle time of a job. The parameters of the DNN are then fuzzified to generate a fuzzy cycle time forecast that contains the actual cycle time. In contrast to existing methods that involve fuzzifying multiple parameters simultaneously, which is computationally intensive, the proposed methodology involves fuzzifying parameters independently to facilitate problem-solving. Subsequently, the cycle time ranges estimated by fuzzifying various parameters are aggregated through fuzzy intersection. The proposed FDNN ensemble approach was applied to a real case to validate its effectiveness. The experimental results indicated that the precision of cycle time range estimation was up to 38% higher with the FDNN ensemble approach than with the fuzzy backpropagation network approach.

Defining a deep neural network ensemble for identifying fabric colors

Colors characterize each object around us. For this reason, the study of colors has played a key role in Artificial Intelligence (think, for instance, of image classification, object recognition and segmentation). However, there are some topics about colors still little explored. One of them concerns fabric colors. This is a particular topic since fabrics have some characteristics, such as specific textures, that are not found in other contexts. In this paper, we want to propose a new Convolutional Neural Network (CNN) based model for identifying fabric colors. After introducing this model, we consider three different versions of it and create an ensemble of the corresponding CNNs to get better results. Finally, through a series of experiments, we show that our ensemble is able to improve the state-of-the-art on the identification of fabric colors.

DPProm: A Two-Layer Predictor for Identifying Promoters and Their Types on Phage Genome Using Deep Learning.

With the number of phage genomes increasing, it is urgent to develop new bioinformatics methods for phage genome annotation. Promoter, a DNA region, is important for gene transcriptional regulation. In the era of post-genomics, the availability of data makes it possible to establish computational models for promoter identification with robustness. In this work, we introduce DPProm, a two-layer model composed of DPProm-1L and DPProm-2L, to predict promoters and their types for phages. On the first layer, as a dual-channel deep neural network ensemble method fusing multi-view features (sequence feature and handcrafted feature), the model DPProm-1L is proposed to identify whether a DNA sequence is a promoter or non-promoter. The sequence feature is extracted with convolutional neural network (CNN). And the handcrafted feature is the combination of free energy, GC content, cumulative skew, and Z curve features. On the second layer, DPProm-2L based on CNN is trained to predict the promoters' types (host or phage). For the realization of prediction on the whole genomes, the model DPProm, combines with a novel sequence data processing workflow, which contains sliding window and merging sequences modules. Experimental results show that DPProm outperforms the state-of-the-art methods, and decreases the false positive rate effectively on whole genome prediction. Furthermore, we provide a user-friendly web at http://bioinfo.ahu.edu.cn/DPProm. We expect that DPProm can serve as a useful tool for identification of promoters and their types.

Predicting Vehicle Behavior Using Multi-task Ensemble Learning

Vehicle utilization analysis is an essential tool for manufacturers to understand customer needs, improve equipment uptime, and to collect information for future vehicle and service development. Typically today, this behavioral modeling is done on high-resolution time-resolved data with features such as GPS position and fuel consumption. However, high-resolution data is costly to transfer and sensitive from a privacy perspective. Therefore, such data is typically only collected when the customer pays for extra services relying on that data. This motivated us to develop a multi-task ensemble approach to transfer knowledge from the high-resolution data and enable vehicle behavior prediction from low-resolution but high dimensional data that is aggregated over time in the vehicles.This study proposes a multi-task snapshot-stacked ensemble (MTSSE) deep neural network for vehicle behavior prediction by considering vehicles’ low-resolution operational life records. The multi-task ensemble approach utilizes the measurements to map the low-frequency vehicle usage to the vehicle behaviors defined from the high-resolution time-resolved data. Two data sources are integrated and used: high-resolution data called Dynafleet, and low-resolution so-called Logged Vehicle Data (LVD). The experimental results demonstrate the proposed approach’s effectiveness in predicting the vehicle behavior from low frequency data. With the suggested multi-task snapshot-stacked ensemble deep network, it is shown how low-resolution sensor data can highly contribute to predicting multiple vehicle behaviors simultaneously while using only one single training process.

A Deep Neural Network Ensemble Classifier with Focal Loss for Automatic Arrhythmia Classification.

Automated electrocardiogram classification techniques play an important role in assisting physicians in diagnosing arrhythmia. Among these, the automatic classification of single-lead heartbeats has received wider attention due to the urgent need for portable ECG monitoring devices. Although many heartbeat classification studies performed well in intrapatient assessment, they do not perform as well in interpatient assessment. In particular, for supraventricular ectopic heartbeats (S), most models do not classify them well. To solve these challenges, this article provides an automated arrhythmia classification algorithm. There are three key components of the algorithm. First, a new heartbeat segmentation method is used, which improves the algorithm's capacity to classify S substantially. Second, to overcome the problems created by data imbalance, a combination of traditional sampling and focal loss is applied. Finally, using the interpatient evaluation paradigm, a deep convolutional neural network ensemble classifier is built to perform classification validation. The experimental results show that the overall accuracy of the method is 91.89%, the sensitivity is 85.37%, the positive productivity is 59.51%, and the specificity is 93.15%. In particular, for the supraventricular ectopic heartbeat(s), the method achieved a sensitivity of 80.23%, a positivity of 49.40%, and a specificity of 96.85%, exceeding most existing studies. Even without any manually extracted features or heartbeat preprocessing, the technique achieved high classification performance in the interpatient assessment paradigm.

An ensemble 3D deep-learning model to predict protein metal-binding site

Predicting metal-binding sites in proteins is critical for understanding the protein’s biological function. Here, we develop an ensemble deep convolutional neural network (CNN) method for predicting metal-binding sites based on their three-dimensional (3D) structure. We build multi-channel 3D voxels based on biophysical characteristics obtained from raw atom coordinates of each protein-binding pocket. Then, we use these 3D voxels as the input of an ensemble 3D CNN model. We train and evaluate the model using a curated dataset of 3D protein structures. Our proposed model shows high performance in predicting metal-binding sites for Zn, Fe, Mg, Mn, Ca, and Na. Our approach offers a framework to use 3D spatial features to train 3D-CNN, which may be used to predict complicated metal-binding sites directly from their biophysical characteristics. The source code and webserver of the model are publicly available.

DeepFusionDTA: Drug-Target Binding Affinity Prediction With Information Fusion and Hybrid Deep-Learning Ensemble Model

Identification of drug-target interaction (DTI) is the most important issue in the broad field of drug discovery. Using purely biological experiments to verify drug-target binding profiles takes lots of time and effort, so computational technologies for this task obviously have great benefits in reducing the drug search space. Most of computational methods to predict DTI are proposed to solve a binary classification problem, which ignore the influence of binding strength. Therefore, drug-target binding affinity prediction is still a challenging issue. Currently, lots of studies only extract sequence information that lacks feature-rich representation, but we consider more spatial features in order to merge various data in drug and target spaces. In this study, we propose a two-stage deep neural network ensemble model for detecting drug-target binding affinity, called DeepFusionDTA, via various information analysis modules. First stage is to utilize sequence and structure information to generate fusion feature map of candidate protein and drug pair through various analysis modules based deep learning. Second stage is to apply bagging-based ensemble learning strategy for regression prediction, and we obtain outstanding results by combining the advantages of various algorithms in efficient feature abstraction and regression calculation. Importantly, we evaluate our novel method, DeepFusionDTA, which delivers 1.5 percent CI increase on KIBA dataset and 1.0 percent increase on Davis dataset, by comparing with existing prediction tools, DeepDTA. Furthermore, the ideas we have offered can be applied to in-silico screening of the interaction space, to provide novel DTIs which can be experimentally pursued. The codes and data are available from https://github.com/guofei-tju/DeepFusionDTA.

Automated fatigue crack detection in steel box girder of bridges based on ensemble deep neural network

This paper constructs a novel ensemble deep neural network to improve identification accuracy of bridge cracks in complex backgrounds. In the three sub-networks of the ensemble network, the detection classifier distinguishes cracks and distractors at the scale of image patches, and then the segmentation sub-network obtains pixel-level crack details. Meanwhile, an innovative crack inference sub-network is constructed based on the prior knowledge of crack morphology. The inference sub-network can predict the probability of cracks existence using the learned image correlation between adjacent regions, and feedback to the detection and segmentation sub-networks. Then, the prediction probabilities coming from the image feature and morphological reasoning are fused to judge and correct the crack repeatedly. Therefore, the presented ensemble deep neural network can well simulate human multi-scale observation, reasoning and decision-making processes. The identification results show that the proposed algorithm can effectively reduce the misjudgment and provide more accurate crack segmentation.

Ensemble of Deep Neural Networks based on Condorcet’s Jury Theorem for screening Covid-19 and Pneumonia from radiograph images

COVID-19 detection using Artificial Intelligence and Computer-Aided Diagnosis has been the subject of several studies. Deep Neural Networks with hundreds or even millions of parameters (weights) are referred to as ”black boxes” because their behavior is difficult to comprehend, even when the model’s structure and weights are visible. On the same dataset, different Deep Convolutional Neural Networks perform differently. So, we do not necessarily have to rely on just one model; instead, we can evaluate our final score by combining multiple models. While including multiple models in the voter pool, it is not always true that the accuracy will improve. So, In this regard, the authors proposed a novel approach to determine the voting ensemble score of individual classifiers based on Condorcet’s Jury Theorem (CJT). The authors demonstrated that the theorem holds while ensembling the N number of classifiers in Neural Networks. With the help of CJT, the authors proved that a model’s presence in the voter pool would improve the likelihood that the majority vote will be accurate if it is more accurate than the other models. Besides this, the authors also proposed a Domain Extended Transfer Learning (DETL) ensemble model as a soft voting ensemble method and compared it with CJT based ensemble method. Furthermore, as deep learning models typically fail in real-world testing, a novel dataset has been used with no duplicate images. Duplicates in the dataset are quite problematic since they might affect the training process. Therefore, having a dataset devoid of duplicate images is considered to prevent data leakage problems that might impede the thorough assessment of the trained models. The authors also employed an algorithm for faster training to save computational efforts. Our proposed method and experimental results outperformed the state-of-the-art with the DETL-based ensemble model showing an accuracy of 97.26%, COVID-19, sensitivity of 98.37%, and specificity of 100%. CJT-based ensemble model showed an accuracy of 98.22%, COVID-19, sensitivity of 98.37%, and specificity of 99.79%.

Ensemble of deep capsule neural networks: an application to pediatric pneumonia prediction.

Pneumonia disease accounts for 15% of all deaths in children under the age of five and early detection of the disease significantly improves survival chances. In this work, we introduce a novel deep neural network model for evaluating pediatric pneumonia from chest radio-graph images. The proposed network is an ensemble of multiple candidate networks, each with interleaved convolutional and capsule layers. Individual networks are stitched together with dense layers and trained as a single model to minimize joint loss. The proposed approach is validated through extensive experimentation on the benchmark pneumonia dataset, and the results demonstrate that the model captures higher level abstractions as well as hidden low-level features from the input radio-graphic images. Our comparison studies reveal that the proposed model produces more generic predictions than existing approaches, with an accuracy of 94.84%. The proposed model produces better scores than the existing models and is extremely useful in assisting clinicians in pneumonia diagnosis.

Hybrid Features and Deep Learning Model for Facial Expression Recognition From Videos

Facial expression recognition plays a crucial function in the advancement of technologies that can be used in detecting mental illness, sensors, and a wide variety of applications. Facial expression recognition is an interesting as well as strenuous task in digital field due to the complexity of the varying individuals. The intention of this work is to establish a face recognition model relying upon the modified GWO-based ensemble deep convolutional neural network (DCNN), which effectively recognizes the expressions. The substance of the research anticipates on the proposed modified GWO optimization which helps in maintaining the storage capacity with simple structures and provides high convergence. Enabling the optimization in the ensemble DCNN helps in tuning the internal parameters present in the classifier as well as helps in attaining best solution. The accomplishment of the proposed expression recognition model is evaluated utilizing the parameter metrics accuracy, precision, and recall that attained the values of 94.114%, 92.003%, and 95.734% which is more efficient.

A fault identification method based on an ensemble deep neural network and a correlation coefficient

An intelligent fault identification algorithm based on ensemble deep neural networks and correlation coefficients is proposed for rotating machinery fault detection. In this algorithm, three deep neural networks (DNNs) are arranged to initially identify faults in the frequency domain, wavelet domain and envelope spectrum angle, respectively. Then, correlation coefficients are adopted to evaluate the recognition results of the DNNs. The reliabilities of the DNNs’ recognition results are divided into 6 levels according to the outputs of the DNNs and the correlation coefficients. Finally, the evaluation results of the three DNNs are put through fusion processing to generate more reliable recognition results. This algorithm identifies fault signals from multiple angles and combines the correlation coefficients to make a comprehensive judgment, which is beneficial for fault identification. Tests on some public bearing data sets show that the proposed algorithm can improve the reliability of fault identification.

Toward Crowdsourced Transportation Mode Identification: A Semisupervised Federated Learning Approach

Privacy-preserving transportation mode identification (TMI) is among the key challenges toward future intelligent transportation systems. With recent developments in federated learning (FL), crowdsourcing has emerged as a promising cost-effective data source for training powerful TMI classifiers without compromising users’ data privacy. However, existing TMI approaches have relied heavily on the availability of transportation mode labels, which is often limited in real-world applications. While recent semisupervised studies have partially addressed this issue by assigning pseudolabels to unlabeled data, such practice often degrades classification performance as more unlabeled data are incorporated. In response to this issue, we present a semisupervised FL scheme for TMI termed mean teacher semisupervised FL (MTSSFL). MTSSFL trains a deep neural network ensemble under a novel semisupervised FL framework, achieving highly accurate and privacy-protected crowdsourced TMI without depending on the availability of massive labeled data. MTSSFL introduces <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">consistency updating</i> to insert the global model in the gradient updates of the local models that only have unlabeled data to improve their training. We also devise <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">mean-teacher-averaging</i> , a secure parameter aggregation mechanism that further boosts the global model’s TMI performance without requiring additional training. Our extensive case studies on a real-world data set demonstrate that MTSSFL’s classification accuracy is merely 1.1% lower than the state-of-the-art semisupervised TMI approach while being the only one to satisfy FL’s privacy-preserving constraints. In addition, MTSSFL can achieve high accuracy with less training overhead due to the proposed semisupervised learning design.

On-line transfer learning for multi-fidelity data fusion with ensemble of deep neural networks

Deep Neural Network (DNN) is widely used in engineering applications for its ability to handle problems with almost any nonlinearities. However, it is generally difficult to obtain sufficient high-fidelity (HF) sample points for expensive optimization tasks, which may affect the generalization performance of DNN and result in inaccurate predictions. To solve this problem and improve the prediction accuracy of DNN, this paper proposes an on-line transfer learning based multi-fidelity data fusion (OTL-MFDF) method including two parts. In the first part, the ensemble of DNNs is established. Firstly, a large number of low-fidelity sample points and a few HF sample points are generated, which are used as the source dataset and target dataset, respectively. Then, the Bayesian Optimization (BO) is utilized to obtain several groups of hyperparameters, based on which DNNs are pre-trained using the source dataset. Next, these pre-trained DNNs are re-trained by fine-tuning on the target dataset, and the ensemble of DNNs is established by assigning different weights to each pre-trained DNN. In the second part, the on-line learning system is developed for adaptive updating of the ensemble of DNNs. To evaluate the uncertainty error of the predicted values of DNN and determine the location of the updated HF sample point, the query-by-committee strategy based on the ensemble of DNNs is developed. The Covariance Matrix Adaptation Evolutionary Strategies is employed as the optimizer to find out the location where the maximal disagreement is achieved by the ensemble of DNNs. The design space is partitioned by the Voronoi diagram method, and then the selected point is moved to its nearest Voronoi cell boundary to avoid clustering between the updated point and the existing sample points. Three different types of test problems and an engineering example are adopted to illustrate the effectiveness of the OTL-MFDF method. Results verify the outstanding efficiency, global prediction accuracy and applicability of the OTL-MFDF method.

Ensemble of diverse deep neural networks with pseudo-labels for repayment prediction in social lending.

In peer-to-peer (P2P) social lending, it is important to predict the repayment of borrowers. P2P lending data are generated in real-time, but most of them are pending to decide the repayment because the deadline is not yet expired. Adding the unexpired data with appropriate labels into the training set could improve the performance of a prediction model, but the pseudo-labels cannot be certainly precise. In this paper, we propose an ensemble classifier composed of diverse convolutional neural networks (CNNs) of GoogLeNet, ResNet and DenseNet for the repayment prediction in social lending with the pseudo-labels approximated by an uncertainty handling scheme. The additional data labeled by Dempster-Shafer fusion of two semi-supervised learning methods boost up training of various models of CNNs, which are combined by weighted voting. A diversity measure is applied to constructing a pool of different models of CNNs that extract the effective features in the social lending data with labeling noise and predict the borrower's loan status. The experiment with the real dataset of 855,502 cases from Lending Club confirms that the diverse ensemble combined with weighted voting achieves the highest performance and outperforms conventional methods.

Deep neural network and ANN ensemble for slope stability prediction

Application of deep neural networks (DNN) and ensemble of ANN with bagging for estimating of factor of safety (FOS) of soil stability with a comparative performance analysis done for all techniques. 1000 cases with different geotechnical and similar Geometrical properties were collected and analysed using the Limit Equilibrium based Morgenstern-Price Method with input variables as the strength parameters of the soil layers, i.e., Su (Upper Clay), Su (Lower Clay), Su (Peat), angle of internal friction (φ), Su (Embankment) with the factor of safety (FOS) as output. The evaluation and comparison of the performance of predicted models with cross-validation having ten folds were made based on correlation-coefficient (CC), Nash-Sutcliffe-model efficiency-coefficient (NSE), root-mean-square-error (RMSE), mean-absolute-error (MAE) and scattering-index (S.I.). Sensitivity analysis was conducted for the effects of input variables on FOS of soil stability based on their importance. The results showed that these techniques have great capability and reflect that the proposed model by DNN can enhance performance of the model, surpassing ensemble in prediction. The Sensitivity analysis outcome demonstrated that Su (Lower Clay) significantly affected the factor of safety (FOS), trailed by Su (Peat). This paper sets sight on use of deep neural network (DNN) and ensemble of ANN with bagging for estimating of factor of safety (FOS) of soil stability. The current approach helps to understand the tangled relationship of various inputs to estimate the factor of safety of soil stability using DNN and ensemble of ANN with bagging. A dependable prediction tool is provided, which suggests that model can help scientists and engineers optimise FOS of soil stability. Recently, DNN and ensemble of ANN with bagging have been used in various civil engineering problems as reported by several studies and has also been observed to be outperforming the current prevalent modelling techniques. DNN can signify extremely changing and intricate high-dimensional functions in correlation to conventional neural networks. But on a detailed literature review, the application of these techniques to estimate factor of safety of soil stability has not been observed.

Non-Newtonian Fluid Flow Modeling in the Inertial Viscometer with a Computer Vision System

Purpose of research. Development of theoretical premises for the new inertial viscometer, as well as the development of an approximate model of the viscosity fluid flow using convolutional neural networks and laser speckle contrast imaging data.Methods. The study consists of two parts. The first is devoted to a theoretical study of viscosity fluid flow in the toroidal channel of еру new inertial viscometer. The mathematical model of the flow includes the dimensionless equations of Navier-Stokes and convective heat conduction, the analysis of which made it possible to estimate the conditions for the uniformity of pressure and temperature fields. The numerical solution of the simplified Navier-Stokes equation was obtained by the control volume method. The computational experiment made it possible to identify additional operating conditions for the viscometer. The second part of the research is aimed at solving the problem of predicting the values of the shear strain rate on the tour surface and the flow rate. The approximate flow model is based on an ensemble of convolutional neural networks trained on data from laser speckle-contrast visualization of a fluid flow in a transparent tube.Results. The recommendations on the operating parameters of the inertial viscometer for the studied types of liquids in a given viscosity range are obtained. An approximate model has been developed in the form of an ensemble of deep neural networks, which makes it possible to determine the volumetric flow rate and the shear strain rate on the flow surface based on fluid flow images.Conclusion. The approximate Navier-Stokes equation obtained as a result of theoretical analysis for the flow of a viscous fluid in a toroidal channel can be used to numerical determination the kinematic viscosity. So, the necessary flow characteristics, such as volumetric flow rate and shear strain rate on the flow surface, can be found using the developed and pretrained convolutional neural network based on laser speck contrast imaging data. The test fluid can be any non-Newtonian fluid capable of reflecting coherent radiation. In particular, it can be physiological fluids, including blood.

Intelligent tuberculosis activity assessment system based on an ensemble of neural networks

This article proposes a novel approach to assess the degree of activity of pulmonary tuberculosis by active tuberculoma foci. It includes the development of a new method for processing lung CT images using an ensemble of deep convolutional neural networks using such special algorithms: an optimized algorithm for preliminary segmentation and selection of informative scans, a new algorithm for refining segmented masks to improve the final accuracy, an efficient fuzzy inference system for more weighted activity assessment. The approach also includes the use of medical classification of disease activity based on densitometric measures of tuberculomas. The selection and markup of the training sample images were performed manually by qualified pulmonologists from a base of approximately 9,000 CT lung scans of patients who had been enrolled in the dispensary for 15 years.The first basic step of the proposed approach is the developed algorithm for preprocessing CT lung scans. It consists in segmentation of intrapulmonary regions, which contain vessels, bronchi, lung walls to detect complex cases of ingrown tuberculomas.To minimize computational cost, the proposed approach includes a new method for selecting informative lung scans, i.e., those that potentially contain tuberculomas.The main processing step is binary segmentation of tuberculomas, which is proposed to be performed optimally by a certain ensemble of neural networks. Optimization of the ensemble size and its composition is achieved by using an algorithm for calculating individual contributions. A modification of this algorithm using new effective heuristic metrics has been proposed which improves the performance of the algorithm for this problem.A special algorithm was developed for post-processing of tuberculoma masks obtained during the segmentation step. The goal of this step is to refine the calculated mask for the physical placement of the tuberculoma. The algorithm consists in cleaning the mask from noisy formations on the scan, as well as expanding the mask area to maximize the capture of the tuberculoma location area.A simplified fuzzy inference system was developed to provide a more accurate final calculation of the degree of disease activity, which reflects data from current medical studies.The accuracy of the system was also tested on a test sample of independent patients, showing more than 96% correct calculations of disease activity, confirming the effectiveness and feasibility of introducing the system into clinical practice.

Pneumonia Detection on Chest X-ray Images Using Ensemble of Deep Convolutional Neural Networks

Pneumonia is a life-threatening lung infection resulting from several different viral infections. Identifying and treating pneumonia on chest X-ray images can be difficult due to its similarity to other pulmonary diseases. Thus, the existing methods for predicting pneumonia cannot attain substantial levels of accuracy. This paper presents a computer-aided classification of pneumonia, coined Ensemble Learning (EL), to simplify the diagnosis process on chest X-ray images. Our proposal is based on Convolutional Neural Network (CNN) models, which are pretrained CNN models that have been recently employed to enhance the performance of many medical tasks instead of training CNN models from scratch. We propose to use three well-known CNNs (DenseNet169, MobileNetV2, and Vision Transformer) pretrained using the ImageNet database. These models are trained on the chest X-ray data set using fine-tuning. Finally, the results are obtained by combining the extracted features from these three models during the experimental phase. The proposed EL approach outperforms other existing state-of-the-art methods and obtains an accuracy of 93.91% and a F1-score of 93.88% on the testing phase.

Carbon Emissions Estimation and Spatiotemporal Analysis of China at City Level Based on Multi-Dimensional Data and Machine Learning

Carbon emissions caused by the massive consumption of energy have brought enormous pressure on the Chinese government. Accurately and rapidly characterizing the spatiotemporal characteristics of Chinese city-level carbon emissions is crucial for policy decision making. Based on multi-dimensional data, including nighttime light (NTL) data, land use (LU) data, land surface temperature (LST) data, and added-value secondary industry (AVSI) data, a deep neural network ensemble (DNNE) model was built to analyze the nonlinear relationship between multi-dimensional data and province-level carbon emission statistics (CES) data. The city-level carbon emissions data were estimated, and the spatiotemporal characteristics were analyzed. As compared to the energy statistics released by partial cities, the results showed that the DNNE model based on multi-dimensional data could well estimate city-level carbon emissions data. In addition, according to a linear trend analysis and standard deviational ellipse (SDE) analysis of China from 2001 to 2019, we concluded that the spatiotemporal changes in carbon emissions at the city level were in accordance with the development of China’s economy. Furthermore, the results can provide a useful reference for the scientific formulation, implementation, and evaluation of carbon emissions reduction policies.