Abstract

Tactile perception of the material properties in real-time using tiny embedded systems is a challenging task and of grave importance for dexterous object manipulation such as robotics, prosthetics and augmented reality. As the psychophysical dimensions of the material properties cover a wide range of percepts, embedded tactile perception systems require efficient signal feature extraction and classification techniques to process signals collected by tactile sensors in real-time. For this purpose, we developed two embedded systems, one that served as a vibrotactile stimulator system and one that recorded and classified the vibrotactile signals collected by its sensors. The quality of the collected data was first verified offline using Fourier transform for feature extraction and then applying powerful machine learning classifiers such as support vector machines and neural networks. We implemented the proposed memory-less signal feature extraction method in order to achieve real-time processing as the data is being collected. The experimental results have shown that the proposed method significantly reduces the computational complexity of feature extraction and still has led to high classification accuracy even when fed to the less complex classifiers such as random forests that can be easily implemented on embedded systems. Finally, we have also shown that low-cost, highly accurate, and real-time tactile texture classification can be achieved using the proposed approach with an ensemble of sensors.

Highlights

  • With the recent advances in hardware design and VLSI technology, mobile embedded systems such as IoT and Edge devices have started to offer artificial intelligence (AI) services [1], [2]

  • We have implemented and tested various classifiers on the texture classification task using both the proposed cumulative multi-bandpower (CMB) features and the Fast Fourier Transform (FFT) features for comparison

  • In this study, we developed an intelligent embedded system equipped with vibrotactile sensors to populate a tactile dataset and to classify tactile signals as they are collected in real-time

Read more

Summary

INTRODUCTION

With the recent advances in hardware design and VLSI technology, mobile embedded systems such as IoT and Edge devices have started to offer artificial intelligence (AI) services [1], [2]. As tactile intelligence requires real-time processing of information collected by an array of various types of sensors with dense spatial arrangement for operating multiple points of contact [23], [24], in this paper, to process our experimental tactile dataset obtained via single contact point with the textured surface, the proposed feature extraction algorithm was designed to fit on a lowcost tiny embedded device Such methods codesigned under the resource constraints of the embedded and Edge/IoT devices are expected to serve better for more advanced tactile information processing tasks, such as classifying the aforementioned wider variety of texture classes and tactile experiences. In order to achieve real-time processing on tiny embedded systems, we can exploit the trade-offs between the descriptiveness of the representation and its computational complexity by performing the computations of the feature extraction in the time domain, instead of the frequency domain These simpler features can be characterized as lossy and lower resolution approximations to the frequency/power spectrum of the signal [19], [35].

BACKGROUND
EXPERIMENTAL RESULTS
CONCLUSIONS
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call