Incremental Slow Feature Analysis Research Articles

A dual fast and slow feature interaction in biologically inspired visual recognition of human action

Computational neuroscience studies have examined the human visual system through functional magnetic resonance imaging (fMRI) and identified a model where the mammalian brain pursues two independent pathways for recognizing biological movement tasks. On the one hand, the dorsal stream analyzes the motion information by applying optical flow, which considers the fast features. On the other hand, the ventral stream analyzes the form information with slow features. The proposed approach suggests that the motion perception of the human visual system comprises fast and slow feature interactions to identify biological movements. The form features in the visual system follow the application of the active basis model (ABM) with incremental slow feature analysis (IncSFA). Episodic observation is required to extract the slowest features, whereas the fast features update the processing of motion information in every frame. Applying IncSFA provides an opportunity to abstract human actions and use action prototypes. However, the fast features are obtained from the optical flow division, which gives an opportunity to interact with the system as the final recognition is performed through a combination of the optical flow and ABM-IncSFA information and through the application of kernel extreme learning machine. Applying IncSFA into the ventral stream and involving slow and fast features in the recognition mechanism are the major contributions of this research. The two human action datasets for benchmarking (KTH and Weizmann) and the results highlight the promising performance of this approach in model modification.

State Identification of Smart Devices Using Acoustic Fingerprinting

The widespread use of smart phones has brought the security and privacy problems. In the past research, fingerprinting of physical device can be used in authenticating system. However, using the fingerprinting to identify and track the user is useful in many legitimate scenes. In this paper, we propose a novel acoustic fingerprinting approach that uses the microphones and speakers of devices to assess the state of target device. While a person is walking or running with a smart phone, a certain amount of vibration is generated, which can be investigated as the basis of state identification. For mining the subtle vibration variations, firstly, a special high-frequency control simulation to speakers is introduced. Then an unsupervised learning method called Incremental Slow Feature Analysis (IncSFA) is applied to construct the state fingerprinting to represent the slow variation triggered by external driving. At last, two alternate approaches as support vector machine (SVM) and Bayes classifier are used to classify the different states from different smart phones.

Optimal Curiosity-Driven Modular Incremental Slow Feature Analysis.

Consider a self-motivated artificial agent who is exploring a complex environment. Part of the complexity is due to the raw high-dimensional sensory input streams, which the agent needs to make sense of. Such inputs can be compactly encoded through a variety of means; one of these is slow feature analysis (SFA). Slow features encode spatiotemporal regularities, which are information-rich explanatory factors (latent variables) underlying the high-dimensional input streams. In our previous work, we have shown how slow features can be learned incrementally, while the agent explores its world, and modularly, such that different sets of features are learned for different parts of the environment (since a single set of regularities does not explain everything). In what order should the agent explore the different parts of the environment? Following Schmidhuber's theory of artificial curiosity, the agent should always concentrate on the area where it can learn the easiest-to-learn set of features that it has not already learned. We formalize this learning problem and theoretically show that, using our model, called curiosity-driven modular incremental slow feature analysis, the agent on average will learn slow feature representations in order of increasing learning difficulty, under certain mild conditions. We provide experimental results to support the theoretical analysis.

Video anomaly detection using deep incremental slow feature analysis network

Existing anomaly detection (AD) approaches rely on various hand‐crafted representations to represent video data and can be costly. The choice or designing of hand‐crafted representation can be difficult when faced with a new dataset without prior knowledge. Motivated by feature learning, e.g. deep leaning and the ability to directly learn useful representations and model high‐level abstraction from raw data, the authors investigate the possibility of using a universal approach. The objective is learning data‐driven high‐level representation for the task of video AD without relying on hand‐crafted representation. A deep incremental slow feature analysis (D‐IncSFA) network is constructed and applied to directly learning progressively abstract and global high‐level representations from raw data sequence. The D‐IncSFA network has the functionalities of both feature extractor and anomaly detector that make AD completion in one step. The proposed approach can precisely detect global anomaly such as crowd panic. To detect local anomaly, a set of anomaly maps, produced from the network at different scales, is used. The proposed approach is universal and convenient, working well in different types of scenarios with little human intervention and low memory and computational requirements. The advantages are validated by conducting extensive experiments on different challenge datasets.

Continual curiosity-driven skill acquisition from high-dimensional video inputs for humanoid robots

In the absence of external guidance, how can a robot learn to map the many raw pixels of high-dimensional visual inputs to useful action sequences? We propose here Continual Curiosity driven Skill Acquisition (CCSA). CCSA makes robots intrinsically motivated to acquire, store and reuse skills. Previous curiosity-based agents acquired skills by associating intrinsic rewards with world model improvements, and used reinforcement learning to learn how to get these intrinsic rewards. CCSA also does this, but unlike previous implementations, the world model is a set of compact low-dimensional representations of the streams of high-dimensional visual information, which are learned through incremental slow feature analysis. These representations augment the robot's state space with new information about the environment. We show how this information can have a higher-level (compared to pixels) and useful interpretation, for example, if the robot has grasped a cup in its field of view or not. After learning a representation, large intrinsic rewards are given to the robot for performing actions that greatly change the feature output, which has the tendency otherwise to change slowly in time. We show empirically what these actions are (e.g., grasping the cup) and how they can be useful as skills. An acquired skill includes both the learned actions and the learned slow feature representation. Skills are stored and reused to generate new observations, enabling continual acquisition of complex skills. We present results of experiments with an iCub humanoid robot that uses CCSA to incrementally acquire skills to topple, grasp and pick-place a cup, driven by its intrinsic motivation from raw pixel vision.

Value and reward based learning in neurorobots

Value and reward based learning in neurorobots

An intrinsic value system for developing multiple invariant representations with incremental slowness learning

Curiosity Driven Modular Incremental Slow Feature Analysis (CD-MISFA;) is a recently introduced model of intrinsically-motivated invariance learning. Artificial curiosity enables the orderly formation of multiple stable sensory representations to simplify the agent's complex sensory input. We discuss computational properties of the CD-MISFA model itself as well as neurophysiological analogs fulfilling similar functional roles. CD-MISFA combines 1. unsupervised representation learning through the slowness principle, 2. generation of an intrinsic reward signal through learning progress of the developing features, and 3. balancing of exploration and exploitation to maximize learning progress and quickly learn multiple feature sets for perceptual simplification. Experimental results on synthetic observations and on the iCub robot show that the intrinsic value system is essential for representation learning. Representations are typically explored and learned in order from least to most costly, as predicted by the theory of curiosity.

Incremental Slow Feature Analysis: Adaptive Low-Complexity Slow Feature Updating from High-Dimensional Input Streams

We introduce here an incremental version of slow feature analysis (IncSFA), combining candid covariance-free incremental principal components analysis (CCIPCA) and covariance-free incremental minor components analysis (CIMCA). IncSFA's feature updating complexity is linear with respect to the input dimensionality, while batch SFA's (BSFA) updating complexity is cubic. IncSFA does not need to store, or even compute, any covariance matrices. The drawback to IncSFA is data efficiency: it does not use each data point as effectively as BSFA. But IncSFA allows SFA to be tractably applied, with just a few parameters, directly on high-dimensional input streams (e.g., visual input of an autonomous agent), while BSFA has to resort to hierarchical receptive-field-based architectures when the input dimension is too high. Further, IncSFA's updates have simple Hebbian and anti-Hebbian forms, extending the biological plausibility of SFA. Experimental results show IncSFA learns the same set of features as BSFA and can handle a few cases where BSFA fails.

1A1-P04 Sparse F-IncSFA for Action Recognition(Communication Robot)

High dimensional input streams and unsupervised learning are two important factors in the area of humanoids and processes of the actions and movements of human. Our Fast Incremental Slow Feature Analysis (F-IncSFA) can learn and extract the few significant features of the complex sensory input sequences regarding high-level spatio-temporal conceptions. In this paper, the application of the F-IncSFA and some of its structure to make a hierarchical compound network made of F-IncSFA has been described. Also the techniques developed by adding efficient sparse coding as an encoder and a preprocessing step before an application of the F-IncSFA. The efficient sparse coding can dramatically reduces the dimension of extracted features and outcome of the efficient sparse coding are quite small as compared with the size of high-dimension video obtained by humanoid or human action. It has revealed excellent and promising dimension reduction by this preprocessor.