Abstract

The development of information technology has added many conveniences to our lives. On the other hand, however, we have to deal with various kinds of information, which can be a difficult task for elderly people or those who are not familiar with information devices. A technology to recognize each person’s activity and providing appropriate support based on that activity could be useful for such people. In this paper, we propose a novel fine-grained activity recognition method for user support systems that focuses on identifying the text at which a user is gazing, based on the idea that the content of the text is related to the activity of the user. It is necessary to keep in mind that the meaning of the text depends on its location. To tackle this problem, we propose the simultaneous use of a wearable device and fixed camera. To obtain the global location of the text, we perform image matching using the local features of the images obtained by these two devices. Then, we generate a feature vector based on this information and the content of the text. To show the effectiveness of the proposed approach, we performed activity recognition experiments with six subjects in a laboratory environment.

Highlights

  • Advanced information technology and various information devices have made the environment where we live remarkably convenient

  • We propose a novel fine-grained activity recognition method for user support systems that focuses on identifying the text at which a user is gazing

  • We proposed a fine-grained activity recognition method that uses a wearable eye tracker and fixed fisheye camera

Read more

Summary

Introduction

Advanced information technology and various information devices have made the environment where we live remarkably convenient. Society is becoming more complicated because we have to deal with various kinds of information It might be difficult for elderly people or those who are not familiar with information devices to enjoy the merits of the advanced informationization of modern society. It is necessary to find the ticket gate where you catch the train This procedure will continue until you arrive at your destination. Such necessary information can be provided by information devices. If it was possible to recognize each person’s fine-grained activity and provide appropriate support based on that activity, this could be a useful technology for smart cities, where all people, including the elderly, can enjoy the benefits of advanced information technology

Methods
Results
Discussion
Conclusion
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call