Architecture Proposal for Data Extraction of Chart Images Using Convolutional Neural Network

Abstract

Different information visualization techniques can be found in the literature due to the quantity and variety of data stored in computational systems. In this context, the classification of chart images becomes important because it allows various types of graphs to be detected automatically in different contexts, allowing a more specific processing for each type of visualization, for example, data extraction. Several techniques of image classification can be used, where the most common are based on the extraction of features of the images, and a later classification using these features. However, one technique that has been gaining prominence in the context of image classification is the Convolutional Neural Network (CNN). This technique is based on deep learning and, in a way, encapsulates the feature extraction process. In this way, the proposal of this article is to use an architecture of a client-server based model to do the chart image classification and later data extraction from this image. The main advantage is doing the CNN processing on the server side, so the application does not rely on client device limitations. For this, an image dataset was generated from the web, and it has ten classes of graphs. From the experiments done, it was seen that the use of this technique was feasible, and modifications in the architecture can be made as a proposal to improve the accuracy of the model.