Deep Learning-Based Model Using DensNet201 for Mobile User Interface Evaluation

Abstract

Human-centered AI plays a vital role in ensuring that human capabilities and ideas are tailored to meet efficiently the data requirements. The main idea is focusing on making machines learn from human behavior in many fields including e-learning, mobile computing, e-health. In this context, sales of mobile devices are rising every day and Mobile User Interfaces (MUI) for smartphones and tablets are attracting greater attention. In this way, there are widely development tools of new mobile services. Moreover, there are useful mobile apps that help users in their daily living such as health, entertainment, games, social networking, weather, e-learning, logistics and transport. The mobile user interfaces have become a necessity for the user’s satisfaction. In this context, the evaluation of Mobile User Interfaces (MUI) is a fundamental dimension in the success of mobile apps. Generally, there are two main classes of user interface evaluation methods: manual and automatic. The first category is conducted by users or experts to evaluate the visual design quality of MUIs. Nevertheless, it is more time-consuming task. The second category used an automatic tool, that require preconfiguration in the source code. However, this configuration is a difficult task for non-programmer evaluators. To address this issue, we propose an evaluation method based on the analysis of graphical MUI as screenshot without using the source code and user participation. The proposed method combines the Densnet201 architecture and K-Nearest Neighbours (KNN) classifier to assess the MUIs. First, we apply the Borderline-SMOTE method to obtain a balanced dataset. Then, the GoogleNet is used to extract automatically the features of MUI. Finally, we apply the KNN classifier to classify the MUIs as good or bad. We evaluate this approach based on publicly available large-scale datasets. The obtained results are very promising and shows the efficiency of the proposed model with an average of 93% of accuracy. This model implemented for the mobile application designers and it aims for improving the quality of MUIs. In fact, the MUIs evaluation can decrease the misunderstanding of the user needs and improve the design and usability in order to reach the user satisfaction.