Abstract

In the last decade, mobile learning applications have attracted a significant amount of attention. Huge investments have been made to develop educational applications that can be implemented on mobile devices. However, mobile learning applications have some limitations, such as storage space and battery life. Cloud computing provides a new idea to solve some limitations of mobile learning applications. However, there are other limitations, like scalability, that must be solved before mobile cloud learning can become completely operational. There are two main problems with scalability. The first occurs when the application server’s performance declines due to an increase in the number of requests, which affects usability. The second is that a decrease in the number of requests makes most application servers idle and therefore wastes money. These two problems can be avoided or minimized by provisioning auto-scaling techniques that permit the acquisition and release of resources dynamically to accommodate demand. In this paper, we propose an intelligent neuro-fuzzy reinforcement learning approach to solve the scalability problem in mobile cloud learning applications, and evaluate the proposed approach against some of the existing approaches via MATLAB. The large state space and long training time required to find the optimal policy are the main problems of reinforcement learning. We use fuzzy Q-learning to solve the large state space problem by grouping similar variables in the same state; there is then no need to use large look-up tables. The use of parallel learning agents reduces the training time needed to determine optimal policies. The experimental results prove that the proposed approach is able to increase learning speed and reduce the training time needed to determine optimal policies.

Highlights

  • Cloud computing is a computing business paradigm where services such as servers, storage, and applications are delivered to end users through the internet

  • Our proposed method combines fuzzy Q-learning [30] with a proposed parallel agents technique in order to solve the two main problems of reinforcement learning (RL): large state space and long training time

  • Fuzzy Qlearning is used to solve the large state space problem, in which a similar group of variables belongs to the same state rather than using large look up tables

Read more

Summary

INTRODUCTION

Cloud computing is a computing business paradigm where services such as servers, storage, and applications are delivered to end users through the internet. To solve some of these limitations, mobile cloud learning (MCL) applications have been proposed. MCL integrates the advantages of mobile learning and cloud computing. The main advantages of MCL are solving the data storage limitation in mobile learning by storing data in the cloud rather than in the device, increasing the ease of sharing knowledge, easing accessibility as access is through a browser rather than a mobile operating system, and low costs for set-up and maintenance. Horizontal cloud scalability (scaling out): adding more servers that perform the same work, and. Vertical cloud scalability (scaling up): increasing capacity by adding more resources, such as adding processing power to a server to make it faster.

RELATED WORK
THE PROPOSED APPROACH
Fuzzy Q-learning
7: Calculate the error signal:
Parallel Agent
Combine Fuzzy Q-learning with the Proposed Parallel Agent Technique
Dataset
5: All agents work in parallel and follow steps 6 through 13: 6
11: Calculate the error signal:
Experiment Setup
Experimental Results
CONCLUSION
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call