Theory Of Pavlovian Conditioning Research Articles

Distributional learning is error-driven: the role of surprise in the acquisition of phonetic categories

Abstract Much previous research on distributional learning and phonetic categorization assumes that categories are either faithful reproductions or parametric summaries of experienced frequency distributions, acquired through a Hebbian learning process in which every experience contributes equally to the category representation. We suggest that category representations may instead be formed via error-driven predictive learning. Rather than passively storing tagged category exemplars or updating parametric summaries of token counts, learners actively anticipate upcoming events and update their beliefs in proportion to how surprising/unexpected these events turn out to be. As a result, rare category members exert a disproportionate influence on the category representation. We present evidence for this hypothesis from a distributional learning experiment on acquiring a novel phonetic category, and show that the results are well described by a classic error-driven learning model (Rescorla, R. A. & A. R. Wagner. 1972. A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement. In A. H. Black & W. F. Prokasy (eds.), Classical conditioning II: Current research and theory, 64–99. New York, NY: Appleton-Century-Crofts).

Pavlovian reward learning elicits attentional capture by reward-associated stimuli.

Feature-reward association elicits value-driven attentional capture (VDAC) regardless of the task relevance of associated features. What are the necessary conditions for feature-reward associations in VDAC? Recent studies claim that VDAC is based on Pavlovian conditioning. In this study, we manipulated the temporal relationships among feature, response, and reward in reward learning to elucidate the necessary components of VDAC. We presented reward-associated features in a variety of locations in a flanker task to form a color-reward association (training phase) and then tested VDAC in a subsequent visual search task (test phase). In Experiment 1, we showed reward-associated features in a task display requiring response selection and observed VDAC, consistent with most previous studies. In Experiment 2, features presented at a fixation display before a task display also induced VDAC. Moreover, in Experiment 3, we reduced the time interval between features and rewards so that features appeared after a task display and we obtained marginally significant VDAC. However, no VDAC was observed when features and rewards were simultaneously presented in a feedback display in Experiments 4 and 5, suggesting that a direct association between feature and reward is not sufficient for VDAC. These results are in favor of the idea that response selection does not mediate feature-reward association in VDAC. Moreover, the evidence suggests that the time interval of feature and reward is flexible with some restriction in the learning of feature-reward association. The present study supports the hypothesis that theories of Pavlovian conditioning can account for feature-reward association in VDAC.

Relapse of anxiety:Views from basic research and theories of Pavlovian conditioning

Relapse of anxiety:Views from basic research and theories of Pavlovian conditioning

Temporal properties of fear extinction—Does time matter?

Fear extinction can be defined as the weakening of the expression of a conditioned response (CR) by extended experience of nonreinforcement. Conceptually, two distinct models have been invoked to account for extinction. R. A. Rescorla and A. R. Wagner (1972, A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement, in A. H. B. W. F. Prokasy (Ed.), Classical conditioning: II. Current research and theory, pp. 64-99, New York, NY, Appleton-Century-Crofts) postulated that the number of exposure trials is the primary determinant of CR decrement, whereas C. R. Gallistel and J. Gibbon (2000, Time, rate, and conditioning, Psychological Review, Vol. 107, pp. 289-344) proposed that the decisive event is the cumulated exposure time to the nonreinforced conditioned stimulus (CS) elapsed after the last CS reinforcement. We evaluated these two accounts in a human differential fear conditioning study in which CR was measured with the fear-potentiated startle response. Cumulated duration of nonreinforcement fails to explain our findings, whereas the number of trials appeared critical. In fact, many CS trials with a duration shorter than the acquisition CS duration facilitated within-session extinction, but this effect did not predict the recovery of fear.

Multiple Timescales of Memory in Lateral Habenula and Dopamine Neurons

Midbrain dopamine neurons are thought to signal predictions about future rewards based on the memory of past rewarding experience. Little is known about the source of their reward memory and the factors that control its timescale. Here we recorded from dopamine neurons, as well as one of their sources of input, the lateral habenula, while animals predicted upcoming rewards based on the past reward history. We found that lateral habenula and dopamine neurons accessed two distinct reward memories: a short-timescale memory expressed at the start of the task and a near-optimal long-timescale memory expressed when a future reward outcome was revealed. The short- and long-timescale memories were expressed in different forms of reward-oriented eye movements. Our data show that the habenula-dopamine pathway contains multiple timescales of memory and provide evidence for their role in motivated behavior.

Second-order conditioning during a compound extinction treatment

Two conditioned taste aversion experiments with rats were conducted to establish if a target taste that had received a prior pairing with illness could be subject to second-order conditioning during extinction treatment in compound with a flavor that also received prior conditioning. In these experiments, the occurrence of second-order conditioning was indicated by protection from extinction of the aversion elicited by the target taste. This possibility, although intuitive, deserves attention because current associative models [e.g., Rescorla, R. A., & Wagner, A. R. (1972). A theory of Pavlovian conditioning: variations in the effectiveness of reinforcement and nonreinforcement. In A. H. Black & W. F. Prokasy (Eds.), Classical conditioning II: Current research and theory (pp. 64–99). New York: Appleton-Century-Crofts.] predict exactly the opposite outcome, namely, that compound extinction of two CSs should result in enhanced extinction.

Of Shape Shifters and Theories

Hanson, S. J., & Burr, D. J. (1990). What connectionist models learn: Learning and representation in connectionist networks. Behavioral and Brain Sciences, 13, 529-576. Hintzman, D. L. (in press). 25 years of learning and memory: Was the cognitive revolution a mistake? In D. E. Myers & S. Kornblum (Eds.), Attention and performance XIV. Hillsdale, NJ: Lawrence Erlbaum Associates, Inc. Jones, E. E. (1985). Major developments in social psychology during the past five decades. In G. Lindzey & E. Aronson (Eds.), The handbook of social psychology (3rd ed., pp. 47-107). New York: Random House. Kamin, L. J. (1968). Attention-like processes in classical conditioning. In M. R. Jones (Ed.), Miami Symposium on the Prediction of Behavior: Aversive stimulation (pp. 9-33). Miami: University of Miami Press. Lieberman, D. A. (1990). Learning, behavior, and cognition. Belmont, CA: Wadsworth. Lord, C. G. (1989). The disappearance of dissonance in an age of relativism. Personality and Social Psychology Bulletin, 15, 513-518. Lord, C. G., Ross, L., & Lepper, M. R. (1979). Biased assimilation and attitude polarization: The effects of prior theories on subsequently considered evidence. Journal of Personality and Social Psychology, 37, 2098-2109. McLaren, P. L., Kaye, H., & Macintosh, N. J. (1990). An associative theory of the representation of stimuli: Applications to perceptual learning and latent inhibition. In R. G. M. Morris (Ed.), Parallel distributed processing: Implications for psychology and neurobiology (pp. 102-130). New York: Oxford University Press. Rescorla, R. A., & Wagner, A. R. (1972). A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement. In A. H. Black & W. F. Prokasy (Eds.), Classical conditioning: II. Current research and theory (pp. 64-99). New York: Appleton-Century-Crofts. Rumelhart, D. E., & McClelland, J. L. (1986). Parallel distributed processing (Vol. 1). Cambridge, MA: MIT Press. Schlenker, B. R. (1982). Translating actions into attitudes: An identityanalytic approach to the explanation of social conduct. In L. Berkowitz (Ed.), Advances in experimental social psychology (Vol. 15, pp. 193247). New York; Academic. Shanks, D. R. (1990). Connectionism and the learning of probabilistic concepts. Quarterly Journal of Experimental Psychology, 42A, 209237. Zanna, M. P., & Cooper, J. (1974). Dissonance and the pill: An attributional approach to studying the arousal properties of dissonance. Journal of Personality and Social Psychology, 29, 703-709.

The role of background stimuli during Pavlovian conditioning.

An investigation was carried out into the part played by background stimuli during Pavlovian conditioning. Groups of rats were presented with tone CSs and unavoidable foot-shock USs. Both CS-US conditional probabilities and US intensity were manipulated across groups. Subsequently all animals were tested for their reactions to the environment in which they had previously been trained. During tests neither the CS nor the US was presented. It was found that the degree to which rats avoided the environment was inversely related to the probability of the CS being followed by a US and directly related to the level of US intensity to which they had been exposed during training. The results largely supported Rescorla and Wagner's (1972) theory of Pavlovian conditioning.