Machine learning-coupled tactile recognition with high spatiotemporal resolution based on cross-striped nanocarbon piezoresistive sensor array

Abstract

Flexible pressure sensor arrays have been playing important roles in various applications of human–machine interface, including robotic tactile sensing, electronic skin, prosthetics, and human–machine interaction. However, it remains challenging to simultaneously achieve high spatial and temporal resolution in developing pressure sensor arrays for tactile sensing with robust function to achieve precise signal recognition. This work presents the development of a flexible high spatiotemporal piezoresistive sensor array (PRSA) by coupling with machine learning algorithms to enhance tactile recognition. The sensor employs cross-striped nanocarbon-polymer composite as an active layer, though screen printing manufacture processes. A miniaturized signal readout circuit and transmission board is developed to achieve high-speed acquisition of distributed pressure signals from the PRSA. Test results indicate that the developed PRSA platform simultaneously possesses the characteristics of high spatial resolution up to 1.5 mm, fast temporal resolution of about 5 ms, and long-term durability with a variation of less than 2%. The PRSA platform also exhibits excellent performance in real-time visualization of multi-point touch, mapping embossed shapes, and tracking motion trajectory. To test the performance of PRSA in recognizing different shapes, we acquired pressure images by pressing the finger-type device coated with PRSA film on different embossed shapes and implementing the T-distributed Stochastic Neighbor Embedding model to visualize the distinction between images of different shapes. Then we adopted a one-layer neural network to quantify the discernibility between images of different shapes. The analysis results show that the PRSA could capture the embossed shapes clearly by one contact with high discernibility up to 98.9%. Collectively, the PRSA as a promising platform demonstrates its promising potential for robotic tactile sensing.