Model Of Human Memory Research Articles

Memristive Bionic Memory Circuit Implementation and Its Application in Multisensory Mutual Associative Learning Networks.

Memory is vital and indispensable for organisms and brain-inspired intelligence to gain complete sensation and cognition of the environment. In this work, a memristive bionic memory circuit inspired by human memory model is proposed, which includes 1) receptor and sensory neuron (SN), 2) short-term memory (STM) module, and 3) long-term memory (LTM) module. By leveraging the in-memory computing characteristic of memristors, various functions such as sensation, learning, forgetting, recall, consolidation, reconsolidation, retrieval, and reset are realized. Besides, a multisensory mutual associative learning network is constructed with several bionic memory units to memorize and associate sensory information of different modalities bidirectionally. Except for association establishment, enhancement, and extinction, we also mimicked multisensory integration to manifest the synthetic process of information from different sensory channels. According to the simulation results in PSPICE, the proposed circuit performs high robustness, low area overhead, and low power consumption. Combining associative memory with human memory model, this work provides a possible idea for further research in associative learning networks.

Vector Symbolic Finite State Machines in Attractor Neural Networks.

Hopfield attractor networks are robust distributed models of human memory, but they lack a general mechanism for effecting state-dependent attractor transitions in response to input. We propose construction rules such that an attractor network may implement an arbitrary finite state machine (FSM), where states and stimuli are represented by high-dimensional random vectors and all state transitions are enacted by the attractor network's dynamics. Numerical simulations show the capacity of the model, in terms of the maximum size of implementable FSM, to be linear in the size of the attractor network for dense bipolar state vectors and approximately quadratic for sparse binary state vectors. We show that the model is robust to imprecise and noisy weights, and so a prime candidate for implementation with high-density but unreliable devices. By endowing attractor networks with the ability to emulate arbitrary FSMs, we propose a plausible path by which FSMs could exist as a distributed computational primitive in biological neural networks.

The environmental basis of memory.

Memory should make more available things that are more likely to be needed. Across multiple environmental domains, it has been shown that such a system would match qualitatively the memory effects involving repetition, delay, and spacing (Schooler & Anderson, 2017). To obtain data of sufficient size to study how detailed patterns of past appearance predict probability of being needed again, we examined the patterns with which words appear in large two data sets: tweets from popular sources and comments on popular subreddits. The two data sets show remarkably similar statistics, which are also consistent with earlier, smaller studies of environmental statistics. None of a candidate set of mathematical models of memory do well at predicting the observed patterns in these environments. A new model of human memory based on the environmental model proposed by Anderson and Milson (1989) did better at predicting the environmental data and a wide range of behavioral studies that measure memory availability by probability of recall and speed of retrieval. A critical variable in this model was range, the span of time over which an item occurs, which was discovered in mining the environmental data. These results suggest that theories of memory can be guided by mining of the statistical structure of the environment. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Building integrated representations through interleaved learning.

Inferring relationships that go beyond our direct experience is essential for understanding our environment. This capacity requires either building representations that directly reflect structure across experiences as we encounter them or deriving the indirect relationships across experiences as the need arises. Building structure directly into overlapping representations allows for powerful learning and generalization in neural network models, but building these so-called distributed representations requires inputs to be encountered in interleaved order. We test whether interleaving similarly facilitates the formation of representations that directly integrate related experiences in humans and what advantages such integration may confer for behavior. In a series of behavioral experiments, we present evidence that interleaved learning indeed promotes the formation of representations that directly link across related experiences. As in neural network models, interleaved learning gives rise to fast and automatic recognition of item relatedness, affords efficient generalization, and is especially critical for inference when learning requires statistical integration of noisy information over time. We use the data to adjudicate between several existing computational models of human memory and inference. The results demonstrate the power of interleaved learning and implicate the formation of integrated, distributed representations that support generalization in humans. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Towards hypergraph cognitive networks as feature-rich models of knowledge

Conceptual associations influence how human memory is structured: Cognitive research indicates that similar concepts tend to be recalled one after another. Semantic network accounts provide a useful tool to understand how related concepts are retrieved from memory. However, most current network approaches use pairwise links to represent memory recall patterns (e.g. reading “airplane” makes one think of “air” and “pollution”, and this is represented by links “airplane”-“air” and “airplane”-“pollution”). Pairwise connections neglect higher-order associations, i.e. relationships between more than two concepts at a time. These higher-order interactions might covariate with (and thus contain information about) how similar concepts are along psycholinguistic dimensions like arousal, valence, familiarity, gender and others. We overcome these limits by introducing feature-rich cognitive hypergraphs as quantitative models of human memory where: (i) concepts recalled together can all engage in hyperlinks involving also more than two concepts at once (cognitive hypergraph aspect), and (ii) each concept is endowed with a vector of psycholinguistic features (feature-rich aspect). We build hypergraphs from word association data and use evaluation methods from machine learning features to predict concept concreteness. Since concepts with similar concreteness tend to cluster together in human memory, we expect to be able to leverage this structure. Using word association data from the Small World of Words dataset, we compared a pairwise network and a hypergraph with N= 3586 concepts/nodes. Interpretable artificial intelligence models trained on (1) psycholinguistic features only, (2) pairwise-based feature aggregations, and on (3) hypergraph-based aggregations show significant differences between pairwise and hypergraph links. Specifically, our results show that higher-order and feature-rich hypergraph models contain richer information than pairwise networks leading to improved prediction of word concreteness. The relation with previous studies about conceptual clustering and compartmentalisation in associative knowledge and human memory are discussed.

Instance theory predicts categorization decisions in the absence of categorical structure: A computational analysis of artificial grammar learning without a grammar.

Theories of categorization have historically focused on the stimulus characteristics to which people are sensitive. Artificial grammar learning (AGL) provides a clear example of this phenomenon, with theorists debating between knowledge of rules, fragments, whole strings, and so on as the basis of categorization decisions (i.e., stimulus-driven explanations). We argue that this focus loses sight of the more important question of how participants make categorization decisions on a mechanistic level (i.e., process-driven explanations). To address the problem, we derived predictions from an instance-based model of human memory in a pseudo-AGL task in which all study and test strings were generated randomly, a task that stimulus-driven explanations of AGL would have difficulty accommodating. We conducted a standard AGL experiment with human participants using the same strings. The model's predictions corresponded to participants' decisions well, even in the absence of any experimenter-generated structure and regardless of whether test stimuli contained any incidental structure. We argue that theories of categorization ought to continue shifting towards the goal of modeling categorization at the level of cognitive processes rather than primarily attempting to identify the stimulus characteristics to which participants are drawn.

Hypergraph models of the mental lexicon capture greater information than pairwise networks for predicting language learning

Human memory is a complex system that works in associative ways: Reading a cue word can lead to the recollection of associated concepts. The network structure of memory recall patterns has been shown to contain insights about a wide variety of cognitive phenomena, including language acquisition. However, most current network approaches use pairwise connections, i.e. links between only two words at a time. This ignores the possibility that more than two concept representations might be simultaneously associated in memory. We overcome this modelling limitation by introducing cognitive hypergraphs as models of human memory. We model memory recall patterns through word associations from the Small World of Words project for N=6003 concepts (Study 1) and for N=497 concepts (Study 2). In each study we represent word associations as either a pairwise network or a hypergraph. By combining psycholinguistic norms and network centrality measures with machine learning, we quantitatively investigate whether there is any benefit to using the hypergraph model over a pairwise network in predicting test-based age of acquisition norms in children up to age 9 years (Study 1) or normative learning in toddlers up to age 30 months (Study 2, based on CHILDES data). We show that cognitive hypergraphs capture more information than pairwise networks from the same data: Cognitive hypergraphs are considerably more powerful than pairwise networks at predicting age of acquisition trends in toddlers, children and teenagers. Our studies showcase how novel approaches merging artificial intelligence and higher-order interactions can help us understand cognitive development.

Controlled Optoelectronic Response in van der Waals Heterostructures for In‐Sensor Computing

AbstractIn‐sensor computing with visual information, which can integrate photo‐sensing, data storage, and computation functions within the same physical element, has promised a fundamentally different architecture for future machine vision technology with extreme energy and time efficiency. The elementary devices required to fulfil the goal of such a new sensory computation scheme would demand a bold functional variation to the existing sensor and data processing hardware. Here, a van der Waals (vdW) heterostructure‐based optoelectronic transistor that can act as an integrated photoreceptor, memory, and computation unit by exploiting its own physical attributes is demonstrated. It is found that diverse photoelectric control of device conductance can lead to versatile photoresponse characteristics, including memristive behaviors, retention‐, polarity‐ and strength‐tunable photoconductance, photoelectric‐coupling effect, etc. Exploiting the photoelectric‐coupling effect, reconfigurable and nonvolatile optoelectronic logic functions are realized in this device, featuring a logic‐in‐sensor unit. With the same device, both short‐ and long‐term synaptic plasticity can be faithfully emulated, rendering it an optoelectronic synaptic transistor. Moreover, a psychologic human memory model is implemented with the device, showing the emulation of memorization and learning processes. This prototypical demonstration provides a promising hardware system for visual information in‐sensor computing capable of addressing complex computation tasks.

Predicting visual memory across images and within individuals

We only remember a fraction of what we see—including images that are highly memorable and those that we encounter during highly attentive states. However, most models of human memory disregard both an image's memorability and an individual's fluctuating attentional states. Here, we build the first model of memory synthesizing these two disparate factors to predict subsequent image recognition. We combine memorability scores of 1100 images (Experiment 1, n = 706) and attentional state indexed by response time on a continuous performance task (Experiments 2 and 3, n = 57 total). Image memorability and sustained attentional state explained significant variance in image memory, and a joint model of memory including both factors outperformed models including either factor alone. Furthermore, models including both factors successfully predicted memory in an out-of-sample group. Thus, building models based on individual- and image-specific factors allows for directed forecasting of our memories. Significance statementAlthough memory is a fundamental cognitive process, much of the time memory failures cannot be predicted until it is too late. However, in this study, we show that much of memory is surprisingly pre-determined ahead of time, by factors shared across the population and highly specific to each individual. Specifically, we build a new multidimensional model that predicts memory based just on the images a person sees and when they see them. This research synthesizes findings from disparate domains ranging from computer vision, attention, and memory into a predictive model. These findings have resounding implications for domains such as education, business, and marketing, where it is a top priority to predict (and even manipulate) what information people will remember.

Mathematical models of human memory

Human memory is an incredibly complex system of vast capacity but often unreliable. Measuring memory for realistic material, such as narratives, is quantitatively challenging as people rarely remember narratives verbatim. Cognitive psychologists developed experimental paradigms involving randomly collected lists of items that make possible quantitative measures of performance in memory tasks, such as recall and recognition. Here, we describe a set of mathematical models designed to predict the results of these experiments. The models are based on simple underlying assumptions and surprisingly agree with experimental results quite well, in addition to that they exhibit quite interesting mathematical behavior that can partially be understood analytically.

Dissociable oscillatory theta signatures of memory formation in the developing brain

Understanding complex human brain functions is critically informed by studying such functions during development. Here, we addressed a major gap in models of human memory by leveraging rare direct electrophysiological recordings from children and adolescents. Specifically, memory relies on interactions between the medial temporal lobe (MTL) and prefrontal cortex (PFC), and the maturation of these interactions is posited to play a key role in supporting memory development. To understand the nature of MTL-PFC interactions, we examined subdural recordings from MTL and PFC in 21 neurosurgical patients aged 5.9-20.5 years as they performed an established scene memory task. We determined signatures of memory formation by comparing the study of subsequently recognized to forgotten scenes in single trials. Results establish that MTL and PFC interact via two distinct theta mechanisms, an ∼3-Hz oscillation that supports amplitude coupling and slows down with age and an ∼7-Hz oscillation that supports phase coupling and speeds up with age. Slow and fast theta interactions immediately preceding scene onset further explained age-related differences in recognition performance. Last, with additional diffusion imaging data, we linked both functional mechanisms to the structural maturation of the cingulum tract. Our findings establish system-level dynamics of memory formation and suggest that MTL and PFC interact via increasingly dissociable mechanisms as memory improves across development.

Regulating Ruminative Web Browsing Based on the Counterbalance Modeling Approach.

Even though the web environment facilitates our daily life, emotional problems caused by its incompatibility with human cognition are becoming increasingly serious. To alleviate negative emotions during web use, we developed a browser extension that presents memorized product images to users in the form of web advertisements. This system utilizes the cognitive architecture Adaptive Control of Thought-Rational (ACT-R) as a model of human memory and emotion. A heart rate sensor attached to the user modulates the ACT-R model parameters, and the emotional states represented by the model are synchronized (following the chameleon effect) or counterbalanced (following the homeostasis regulation) with the physiological state of the user. An experiment demonstrates that the counterbalanced model suppresses negative ruminative web browsing. The authors claim that this approach, utilizing a cognitive model, is advantageous in terms of explainability.

GrapHD: Graph-Based Hyperdimensional Memorization for Brain-Like Cognitive Learning.

Memorization is an essential functionality that enables today's machine learning algorithms to provide a high quality of learning and reasoning for each prediction. Memorization gives algorithms prior knowledge to keep the context and define confidence for their decision. Unfortunately, the existing deep learning algorithms have a weak and nontransparent notion of memorization. Brain-inspired HyperDimensional Computing (HDC) is introduced as a model of human memory. Therefore, it mimics several important functionalities of the brain memory by operating with a vector that is computationally tractable and mathematically rigorous in describing human cognition. In this manuscript, we introduce a brain-inspired system that represents HDC memorization capability over a graph of relations. We propose GrapHD, hyperdimensional memorization that represents graph-based information in high-dimensional space. GrapHD defines an encoding method representing complex graph structure while supporting both weighted and unweighted graphs. Our encoder spreads the information of all nodes and edges across into a full holistic representation so that no component is more responsible for storing any piece of information than another. Then, GrapHD defines several important cognitive functionalities over the encoded memory graph. These operations include memory reconstruction, information retrieval, graph matching, and shortest path. Our extensive evaluation shows that GrapHD: (1) significantly enhances learning capability by giving the notion of short/long term memorization to learning algorithms, (2) enables cognitive computing and reasoning over memorization graph, and (3) enables holographic brain-like computation with substantial robustness to noise and failure.

Reducing catastrophic forgetting problem in streaming data by Hybrid Shark Smell with Jaya Optimization-based Deep Neural Networks

Catastrophic forgetting is a well-known characteristic of diverse parameterized supervised learning models. Artificial Neural Networks (ANN) face severe catastrophic forgetting or catastrophic interference in the sequential learning of information that is intolerable to both engineering applications and the human memory model. This problem can be solved through the machine learning community. The main intent of this paper is to implement a novel continuous learning model that could overcome the problem of catastrophic forgetting. The stream data from diverse benchmark sources are used for experimenting. The proposed model adopts the Deep Neural Network (DNN) with testing weight updates. When new data are given, the hybrid meta-heuristic algorithm helps to update the weight that manages to prevent the learning from catastrophic forgetting. The weight update strategy for solving the catastrophic forgetting is done by the hybridization of Shark Smell Optimization (SSO) and Jaya Algorithm (JA) that is named as Hybrid Shark Smell with Jaya Optimization (HSS-JO). A multi-objective function concerning the parameters associated with catastrophic forgetting like accuracy and remembering is used for framing the proposed continuous learning. The proof of the proposed model over conventional models on three publicly available datasets is given for final validation. From the analysis, in Table 3, the accuracy of the proposed HSS-JO-DNN is 38%, 0.5%, 0.55%, 0.14%, 0.98%, and 0.5% superior to DT, NB, KNN, SVM, NN, and RNN, respectively. For dataset 2, the FNR of the proposed HSS-JO-DNN is 90% superior to DT, 89% improved than NB, KNN, and NN, 94% improved than SVM, and 24% improved than RNN. Similarly, the proposed HSS-JO performance is higher in all the results. Thus, the proposed HSS-JO performs better than all the other traditional methods.

Information Integration and Information Storage in Retinotopic and Non-Retinotopic Sensory Memory

The first stage of the Atkinson–Shiffrin model of human memory is a sensory memory (SM). The visual component of the SM was shown to operate within a retinotopic reference frame. However, a retinotopic SM (rSM) is unable to account for vision under natural viewing conditions because, for example, motion information needs to be analyzed across space and time. For this reason, the SM store of the Atkinson–Shiffrin model has been extended to include a non-retinotopic component (nrSM). In this paper, we analyze findings from two experimental paradigms and show drastically different properties of rSM and nrSM. We show that nrSM involves complex processes such as motion-based reference frames and Gestalt grouping, which establish object identities across space and time. We also describe a quantitative model for nrSM and show drastic differences between the spatio-temporal properties of rSM and nrSM. Since the reference-frame of the latter is non-retinotopic and motion-stream based, we suggest that the spatiotemporal properties of the nrSM are in accordance with the spatiotemporal properties of the motion system. Overall, these findings indicate that, unlike the traditional rSM, which is a relatively passive store, nrSM exhibits sophisticated processing properties to manage the complexities of ecological perception.

CSR and casino hotel branding: The joint moderation of CSR misfit and corporate awareness

Drawing on the Human Associative Memory (HAM) model, this paper aims to examine consumers' responses to casino hotels' corporate social responsibility (CSR) efforts. The study focuses on how CSR misfit hinders positive spillovers from CSR to corporate brand image, and whether corporate awareness can remedy this inherent handicap. Data were collected from the guests of 35 casino hotels in Macao. Hierarchical regression was adopted to test the main, moderating, and joint moderating effects. The findings indicate that company–CSR misfit jeopardizes the positive effect of casino hotels’ CSR efforts in building a favorable corporate image, while corporate awareness can reduce such negative moderating effects. This research echoes calls to examine CSR spillover effects in controversial industry sectors and fills the gap to investigate the joint effects of the under-researched firm characteristics. Understanding firm-level handicaps and remedies in CSR implementation is of great value for academia and the industry.

Cognition-Enhanced Machine Learning for Better Predictions with Limited Data.

The fields of machine learning (ML) and cognitive science have developed complementary approaches to computationally modeling human behavior. ML's primary concern is maximizing prediction accuracy; cognitive science's primary concern is explaining the underlying mechanisms. Cross-talk between these disciplines is limited, likely because the tasks and goals usually differ. The domain of e-learning and knowledge acquisition constitutes a fruitful intersection for the two fields' methodologies to be integrated because accurately tracking learning and forgetting over time and predicting future performance based on learning histories are central to developing effective, personalized learning tools. Here, we show how a state-of-the-art ML model can be enhanced by incorporating insights from a cognitive model of human memory. This was done by exploiting the predictive performance equation's (PPE) narrow but highly specialized domain knowledge with regard to the temporal dynamics of learning and forgetting. Specifically, the PPE was used to engineer timing-related input features for a gradient-boosted decision trees (GBDT) model. The resulting PPE-enhanced GBDT outperformed the default GBDT, especially under conditions in which limited data were available for training. Results suggest that integrating cognitive and ML models could be particularly productive if the available data are too high-dimensional to be explained by a cognitive model but not sufficiently large to effectively train a modern ML algorithm. Here, the cognitive model's insights pertaining to only one aspect of the data were enough to jump-start the ML model's ability to make predictions-a finding that holds promise for future explorations.

Predicting University Students’ Exam Performance Using a Model-Based Adaptive Fact-Learning System

Modern educational technology has the potential to support students to use their study time more effectively. Learning analytics can indicate relevant individual differences between learners, which adaptive learning systems can use to tailor the learning experience to individual learners. For fact learning, cognitive models of human memory are well suited to tracing learners’ acquisition and forgetting of knowledge over time. Such models have shown great promise in controlled laboratory studies. To work in realistic educational settings, however, they need to be easy to deploy and their adaptive components should be based on individual differences relevant to the educational context and outcomes. Here, we focus on predicting university students’ exam performance using a model-based adaptive fact-learning system. The data presented here indicate that the system provides tangible benefits to students in naturalistic settings. The model’s estimate of a learner’s rate of forgetting predicts overall grades and performance on individual exam questions. This encouraging case study highlights the value of model-based adaptive fact-learning systems in classrooms.

JWSAN: Japanese word similarity and association norm

We present a new Japanese dataset, Japanese Word Similarity and Association Norm (JWSAN), comprising human rating scores of similarity and association for 2145 word pairs, with a clear distinction between word similarity and word association. Computational models of human semantic memory or mental lexicon, such as distributed semantic models, must predict not only association but also similarity. People can distinguish between word similarity and association. However, although the SimLex-999 dataset is publicly available for English, there is no Japanese similarity dataset with a clear distinction between the two types of word relatedness. JWSAN is the first large Japanese dataset with similarity and association ratings, containing noun, verb, and adjective word pairs. It is also characterized by data collection from a sufficient number of age- and-gender-controlled assessors, with similarity and association ratings obtained via a web-based survey conducted of 6450 native speakers of Japanese. In addition, the effects of the gender and age of the raters were also examined; these factors were only given scant consideration in the past. This dataset can act as a benchmark for improving distributed semantic models in Japanese.

Unformalized tasks and methodology of their solution

The article deals with the methodology of solving non-formalized problems. The first methodology represents the traditional approach to the description of the problem domain model (MPO) and it is characterized by a significant operational semantics. The second description methodology represents a new direction in computer science − artificial intelligence. Any problem for which the solution algorithm is unknown, a priori refers to artificial intelligence. An algorithm is understood as the entire sequence of specified actions that are well defined and can be performed on a computer. The knowledge model is a means of describing the logic and data of the problem being solved. Since the knowledge about the subject area may be inaccurate, incomplete, or unclear, and the subject areas are different, the logic used in the description may also be different. The problem to be solved is presented in the form of rules (statements) and a request, the validity of which should be established or refuted. The solution of the problem is reduced to finding out the logical sequence (derivability) of the target formula from a given set of rules. The most popular knowledge models for creating ES are production models. The frame model, or the model of knowledge representation, based on the frame theory, is a psychological model of human memory and consciousness systematized in the form of a single theory The semantic network model is a knowledge representation model based on the semantic network method. The described models are only a small part of the applied methods for solving unformalized problems.