Abstract

A commonly used approach to parameter estimation in computational models is the so-called grid search procedure: the entire parameter space is searched in small steps to determine the parameter value that provides the best fit to the observed data. This approach has several disadvantages: first, it can be computationally very expensive; second, one optimal point value of the parameter is reported as the best fit value; we cannot quantify our uncertainty about the parameter estimate. In the main journal article that this methods article accompanies (Jäger et al., 2020, Interference patterns in subject-verb agreement and reflexives revisited: A large-sample study, Journal of Memory and Language), we carried out parameter estimation using Approximate Bayesian Computation (ABC), which is a Bayesian approach that allows us to quantify our uncertainty about the parameter's values given data. This customization has the further advantage that it allows us to generate both prior and posterior predictive distributions of reading times from the cue-based retrieval model of Lewis and Vasishth, 2005.•Instead of the conventional method of using grid search, we use Approximate Bayesian Computation (ABC) for parameter estimation in the [4] model.•The ABC method of parameter estimation has the advantage that the uncertainty of the parameter can be quantified.

Highlights

  • This paper is a companion to Jäger, Mertzen, Van Dyke, and Vasishth [1], and shows how we estimate the latency factor parameter in the cue-based retrieval model of Engelmann, Jäger, and Vasishth [2], when evaluating the model’s predictions to the observed data from Dillon, Mishler, Sloggett, and Phillips [3] and our larger-sample replication attempt [1]

  • The Engelmann et al model of sentence processing is a simplified version of the Lisp-based model described in Lewis and Vasishth [4]

  • Each iteration of the algorithm consists of drawing a single random sample from a prior distribution for the parameter (here, Beta(2, 6)), and generating the predicted mean effect from the model using that sampled parameter value

Read more

Summary

Method Article

University of Potsdam, Germany abstractA commonly used approach to parameter estimation in computational models is the so-called grid search procedure: the entire parameter space is searched in small steps to determine the parameter value that provides the best fit to the observed data. In the main journal article that this methods article accompanies (Jäger et al, 2020, Interference patterns in subject-verb agreement and reflexives revisited: A large-sample study, Journal of Memory and Language), we carried out parameter estimation using Approximate Bayesian Computation (ABC), which is a Bayesian approach that allows us to quantify our uncertainty about the parameter’s values given data. This customization has the further advantage that it allows us to generate both prior and posterior predictive distributions of reading times from the cue-based retrieval model of Lewis and Vasishth, 2005.

Method details
Concluding remarks
Declaration of Competing Interest
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call