Short-answer Test Research Articles

Domain familiarity as a cue for judgments of learning

Students differ in how much they already know about topics within and across their courses. Few studies, however, have examined the relationship between participants' levels of knowledge across topics (i.e., their "domain familiarity") and their learning of information from those topics, their study choices related to those topics, and their subjective self-assessments of their learning about the topics. As such, in two studies we had participants (Study 1, college students; Study 2, Mturk workers) rank their domain familiarity for several to-be-studied domains (e.g., chemistry, history), rate their efficacy and interest in those domains, study and make judgments of learning (JOLs) for facts from each domain, and finally complete a short-answer test over those facts. Participants' efficacy and interest ratings for the topics were linearly related to their topic rankings, as were their recall of and JOLs for facts from those domains. Although the JOLs were consistently overconfident, they were more overconfident for better-known than for lesser-known topics. Participants' study times were not related to their topic rankings (Studies 1 and 2), but participants did use domain familiarity to strategically decide which domains to restudy before the test (Study 2). Participants typically chose to restudy their least-familiar topics, but chose to restudy their best-known topic under extremely limited restudy conditions. As a whole, the results suggest that participants effectively use their domain familiarity as a basis for their JOLs and restudy choices, but to some extent overuse this factor to assess their learning, and underuse it to guide initial study.

Effects of Pre-Reading Activities on EFL Reading Comprehension by Moroccan College Students

This study investigated the effects of two pre-reading activities (class discussion and vocabulary definitions) and a control condition on the reading comprehension of 57 Moroccan college freshmen. It also investigated the differential facilitative effect of the two pre-reading activities on the students’ comprehension. Each student read an expository text under one of the three conditions and immediately afterwards answered a 9-item short-answer test designed to measure comprehension of the text. A one-way ANOVA and a post-hoc comparison test were applied to the results. This revealed that the two pre-reading activities produced significantly higher comprehension scores than the control condition. Vocabulary definitions activity resulted in increased comprehension compared with the control condition, but was significantly less effective than the class discussion activity. Results of the study were interpreted in relation to the schema-theoretic view of the reading process, and to their implications for EFL reading instruction. Key words: Pre-reading activities; Activating background knowledge; Reading comprehension

Explanation feedback is better than correct answer feedback for promoting transfer of learning.

Among the many factors that influence the efficacy of feedback on learning, the information contained in the feedback message is arguably the most important. One common assumption is that there is a benefit to increasing the complexity of the feedback message beyond providing the correct answer. Surprisingly, studies that have manipulated the content of the feedback message in order to isolate the unique effect of greater complexity have failed to support this assumption. However, the final test in most of these studies consisted of a repetition of the same questions from the initial test. The present research investigated whether feedback that provides an explanation of the correct answer promotes superior transfer of learning to new questions. In 2 experiments, subjects studied prose passages and then took an initial short-answer test on concepts from the text. After each question, they received correct answer feedback, explanation feedback, or no feedback (Experiment 1 only). Two days later, subjects returned for a final test that consisted of both repeated questions and new inference questions. The results showed that correct answer feedback and explanation feedback led to equivalent performance on the repeated questions, but explanation feedback produced superior performance on the new inference questions.

The relative effectiveness of computer‐based and traditional resources for education in anatomy

There is increasing use of computer-based resources to teach anatomy, although no study has compared computer-based learning to traditional. In this study, we examine the effectiveness of three formats of anatomy learning: (1) a virtual reality (VR) computer-based module, (2) a static computer-based module providing Key Views (KV), (3) a plastic model. We conducted a controlled trial in which 60 undergraduate students had ten minutes to study the names of 20 different pelvic structures. The outcome measure was a 25 item short answer test consisting of 15 nominal and 10 functional questions, based on a cadaveric pelvis. All subjects also took a brief mental rotations test (MRT) as a measure of spatial ability, used as a covariate in the analysis. Data were analyzed with repeated measures ANOVA. The group learning from the model performed significantly better than the other two groups on the nominal questions (Model 67%; KV 40%; VR 41%, Effect size 1.19 and 1.29, respectively). There was no difference between the KV and VR groups. There was no difference between the groups on the functional questions (Model 28%; KV, 23%, VR 25%). Computer-based learning resources appear to have significant disadvantages compared to traditional specimens in learning nominal anatomy. Consistent with previous research, virtual reality shows no advantage over static presentation of key views.

Student Preferences Comparing Three Different Teaching Methods for an Orthodontic Teaching Module

Objectives: Evaluate student preferences for three different teaching methods in orthodontics. Method: 38 final year dental from an UK Dental Institute were instructed to undertake two orthodontic procedures using three different teaching methods: 1. Slideshow with verbal presentation (PP), 2. Video-based presentation (VBT) and 3. Hands on practical session (HCL). Preferences were investigated by questionnaire and focus group, allowing one or any combination of the above methods. The data were then analysed inductively to enable key themes to emerge. The students knowledge was tested using a multiple short answer test. Results: The combination of PP in combination with HCL was the most popular method preferred by 28.6% of the participants, followed by HCL alone (25.5%). VBT either as the sole method or in combination with other methods scored consistently lowest. Although there was a positive response towards the usefulness of VBT, it was the least preferred method when used in singularity. The main criticisms pointed to the length of the video, its slow pace and that no handouts could be produced from it. Conclusions: VBT in its current form was found only to be useful for delivering teaching of an orthodontic module when used as an adjunct to a lecture or a practical teaching session. Undergraduate preferred traditional HCL teaching, although the basic skills taught were transferable from other teaching modules of general dentistry. Recommendations for improvement included embedding parts of the video into the PP presentation; this suggests that prefer teaching material to be presented in a condensed multimedia format.

Knowledge presented in concept maps: correlations with conventional cognitive knowledge tests

Our study focuses on the correlation of concept map (CMap) structures and learning success tested with short answer tests, taking into particular account the complexity of the subject matter. Novice sixth grade students created CMaps about two subject matters of varying difficulty. The correlation of the complexity of CMaps with the post-test was small but highly significant in both subject matters. The complexity of the CMaps correlated with the long-term knowledge in the difficult subject matter but not in the context of the easy one. Furthermore, the high number of technical errors makes it close to impossible to estimate students’ knowledge. In summary, CMaps do not provide an adequate alternative to conventional short answer knowledge tests, but together with them they may offer a better comprehension of a student’s knowledge structure and aid in the preparation of further instruction tailored to individual needs.

Use of an Online Curriculum to Teach Delirium to Fourth‐Year Medical Students: A Comparison with Lecture Format

Web-based learning methods are being used increasingly to teach core curriculum in medical school clerkships, but few studies have compared the effectiveness of online methods with that of live lectures in teaching the same topics to students. Boston University School of Medicine has implemented an online, case-based, interactive curriculum using videos and text to teach delirium to fourth-year medical students during their required 1-month Geriatrics and Home Medical Care clerkship. A control group of 56 students who received a 1-hour live delirium lecture only was compared with 111 intervention group students who completed the online delirium curriculum only. Evaluation consisted of a short-answer test with two cases given as a pre- and posttest to both groups. The total possible maximum test score was 34 points, and the lowest possible score was -8 points. Mean pre- and posttest scores were 10.5 ± 4.0 and 12.7 ± 4.4, respectively, in the intervention group and 9.9 ± 3.5 and 11.2 ± 4.5, respectively, in the control group. The intervention group had statistically significant improvement between the pre- and posttest scores (2.21-point difference; P < .001), as did the control group (1.36-point difference; P = .03); the difference in test score improvement between the two groups was not statistically significant. An interactive case-based online curriculum in delirium is as effective as a live lecture in teaching delirium, although neither of these educational methods alone produces robust increases in knowledge.

Using verification feedback to correct errors made on a multiple-choice test

A key educational challenge is how to correct students’ errors and misconceptions so that they do not persist. Simply labelling an answer as correct or incorrect on a short-answer test (verification feedback) does not improve performance on later tests; error correction requires receiving answer feedback. We explored the generality of this conclusion and whether the effectiveness of verification feedback depends on the type of test with which it is paired. We argue that, unlike for short-answer tests, learning whether one's multiple-choice selection is correct or incorrect should help participants narrow down the possible answers and identify specific lures as false. To test this proposition we asked participants to answer a series of general knowledge multiple-choice questions. They received no feedback, answer feedback, or verification feedback, and then took a short-answer test immediately and two days later. Verification feedback was just as effective as answer feedback for maintaining correct answers. Importantly, verification feedback allowed learners to correct more of their errors than did no feedback, although it was not as effective as answer feedback. Overall, verification feedback conveyed information to the learner, which has both practical and theoretical implications.

An investigation of Jordanian EFL teachers’ assessment practices

The study aimed at investigating Jordanian EFL teachers’ assessment practices relating to the test construction through self-reported frequencies of using the procedures of preparing, correcting, analyzing, interpreting an achievement test, and discussing its results with students. To achieve this, a 31-item questionnaire was used. The questionnaire was administered to 118 basic stage EFL teachers after establishing its validity and reliability. The results showed that EFL teachers claimed to always or usually practice appropriate procedures of preparing the test, discussing the results with students and evaluating and assessing short-answer tests. However, they were found to sometimes practice appropriate procedures for analyzing test results and evaluating and assessing open-ended questions. In light of the findings, it is recommended that educational institutions should pay more attention to educating teachers to analyze and interpret test results, and evaluate and score open-answer questions.

Comparison of the effect of post-instruction multiple-choice and short-answer tests on delayed retention learning

People forget much of what they learn, therefore students could benefit from learning strategies that yield long-lasting knowledge. Yet surprisingly, little is known about how longterm retention is most efficiently mastered. We studied the value of teacher made in class tests as learning aids and compared two types of teacher-made tests (multiple choice and short-answer tests) with a no test (control) to determine their value as aids to retention learning. The study was conducted on two separate batches of medical undergraduate students. This study compared two types of tests [multiple choice questions (MCQs) and short answer questions (SAQs)] with a no test (control) group. The investigation involved initial testing at the end of the lecture (post instruction), followed by an unannounced delayed retention test on the same material three weeks later. The unannounced delayed test comprising of MCQs and SAQs on the same material was given three weeks later to all the three groups. In batch I, the MCQ group had a higher mean delayed retention score of 10.97, followed by the SAQ group (8.42) and the control group (6.71). Analysis of variance (ANOVA) test and least significance difference (LSD) post hoc test revealed statistically significant difference between the means of the three groups. Similar results were obtained for batch II CONCLUSION: Classroom testing has a positive effect on retention learning; both short-answer and multiple-choice tests being more effective than no test in promoting delayed retention learning, however, multiple-choice tests are better.

Test-enhanced learning in the classroom: Long-term improvements from quizzing.

Three experiments examined whether quizzing promotes learning and retention of material from a social studies course with sixth grade students from a suburban middle school. The material used in the experiments was the course material students were to learn and some of the dependent measures were the actual tests on which students received grades. In within-subject designs, students received three low-stakes multiple-choice quizzes in Experiments 1 and 2 and performance on quizzed items was compared to that on items that were presented twice (Experiment 2) or items that were not presented on the initial quizzes (Experiments 1 and 2). We found that students' performance on both chapter exams and semester exams improved following quizzing relative to either not being quizzed or relative to the twice-presented items. In Experiment 3, students were given one multiple-choice quiz in class and encouraged to quiz themselves outside of class using a Web-based system. The assessment in this experiment was a short answer test in which students had to produce answers, but we also used multiple-choice tests. Once again, we found that quizzing of material produced a positive effect on chapter and semester exams. These results show the robustness of retrieval practice via testing as a learning mechanism in a classroom setting using the subject matter of the course and (in most cases) the tests on which students received grades as the dependent measures. Our results add to a growing body of evidence that retrieval practice in the classroom can boost academic performance.

Assessing changes in performance and monitoring processes in individual and collaborative tests according to students' metacognitive skills

This study assessed students' test performances and metacognitive processes in real classroom settings. Psychology undergraduates were categorised according to their metacognitive skills (high vs. low) and had their test performances and monitoring processes in two different types of tests (multiple-choice and short-answer tests) compared in individual and collaborative test conditions. Students' test preparation practices, attributions, and regulatory processes during test-taking were also compared by using open-ended questions. In the collaborative tests, three types of metacognitive pairings were made (high/high vs. high/low vs. low/low). Results showed that: (1) in individual tests, high-metacognitive students presented better performance and higher confidence levels due to their more effective test preparation practices and regulatory skills; (2) Differences in performance and confidence levels due to metacognitive skills disappear when students take tests collaboratively; (3) Over time, collaborative testing had particular positive effects on the low/low metacognitive pairings. Results are discussed focusing on their educational implications.

A comparison of study strategies for passages: Rereading, answering questions, and generating questions.

Students are often encouraged to generate and answer their own questions on to-be-remembered material, because this interactive process is thought to enhance memory. But does this strategy actually work? In three experiments, all participants read the same passage, answered questions, and took a test to get accustomed to the materials in a practice phase. They then read three passages and did one of three tasks on each passage: reread the passage, answered questions set by the experimenter, or generated and answered their own questions. Passages were 575-word (Experiments 1 and 2) or 350-word (Experiment 3) texts on topics such as Venice, the Taj Mahal, and the singer Cesaria Evora. After each task, participants predicted their performance on a later test, which followed the same format as the practice phase test (a short-answer test in Experiments 1 and 2, and a free recall test in Experiment 3). In all experiments, best performance was predicted after generating and answering questions. We show, however, that generating questions led to no improvement over answering comprehension questions, but that both of these tasks were more beneficial than rereading. This was the case on an immediate short-answer test (Experiment 1), a short-answer test taken 2 days after study (Experiment 2), and an immediate free recall test (Experiment 3). Generating questions took at least twice as long as answering questions in all three experiments, so although it is a viable alternative to answering questions in the absence of materials, it is less time-efficient.

Effects of Review on Medical Students’ Recall of Different Types of Neuroanatomical Content

Review of previously learned content is central to formal medical education and continuing lifelong learning; however, little is known about the review process itself. This study examined ways in which structured review impacted students' recall and use of different types of neuroanatomical information, categorized as general constructs, fundamental content, and advanced content. Seven months after completing first-year neuroscience, medical students were given equivalent short-answer tests requiring description of pathways and localization of lesions both before and after a review of clinically related neuroanatomy. Scores that reflected the three different types of information were compared. Prereview, students recalled General Constructs of neuroanatomy, with little additional Fundamental or Advanced Content. Postreview, Fundamental Content and Advanced Content scores both increased significantly. Reviews appear to enhance recall of related content, not only isolated facts. The review process may thus have unrealized potential as an educational strategy in medical training.

Exploring the Effects of Digital Note Taking on Student Comprehension of Science Texts

This study investigated the effects of text notes and voice notes on the comprehension of science texts by fifth grade students. The study was conducted to determine whether digital note taking was an effective reading strategy, and whether one form of digital note taking was more effective than the other. Results revealed that general education students made statistically significant gains for both science texts: Cells, and Heredity. For Cells, the voice notes group outperformed their text note peers at a level that was statistically significant. Special education students also made greater test gains using voice notes rather than text notes, and this difference was statistically significant for short-answer tests on Heredity. Additional analyses revealed diverse note taking strategies, which appeared consistent across media.

The Dreaded Essay Exam

Surveys in 2 undergraduate psychology classes (N = 86) found that students felt less comfortable taking all-essay tests than taking multiple-choice or short-answer tests. The dominant examination format for students in university and in high school had been multiple-choice tests. We describe measures to encourage essay writing in large classes.

Confidence judgments in real classroom settings: Monitoring performance in different types of tests

During testing, students have a valuable opportunity to exercise and improve their self-regulatory skills. However, the extent to which they profit from those experiences may vary according to some personal, test-related, and environmental factors. This study investigated the effects of metacognitive skills and test types on students' test performances, confidence judgments, and on the accuracy of those judgments. A sample of 129 psychology undergraduate students (50 men and 79 women, mean age = 18.9 years) were categorized according to their metacognitive skills (high vs average vs low) and had their test performances and monitoring processes in two different types of tests (i.e., multiple-choice and short-answer tests) compared throughout one academic term. Their test preparation practices, along with their attributional and regulatory processes during test-taking, were also compared by using open-ended questions. The results showed that: (1) high-metacognitive students presented more effective test preparation practices, better test performances, and superior attributional, regulatory, and monitoring processes than their counterparts; (2) differences in performance and judgment accuracy were significantly larger in the short-answer tests than in the multiple-choice tests; and (3) over time, students' performances and confidence levels varied in specific patterns according to the type of test being taken. The results are discussed, focusing on the educational implications of the interactions observed and on how they may determine what students can learn from test-taking experiences. In addition, based on the results obtained, specific suggestions on how to increase the metacognitive awareness of university students through instruction and on how to improve their academic assessment are provided.

Test-enhanced learning in medical education

In education, tests are primarily used for assessment, thus permitting teachers to assess the efficacy of their curriculum and to assign grades. However, research in cognitive psychology has shown that tests can also directly affect learning by promoting better retention of information, a phenomenon known as the testing effect. Cognitive psychology laboratory studies show that repeated testing of information produces superior retention relative to repeated study, especially when testing is spaced out over time. Tests that require effortful retrieval of information, such as short-answer tests, promote better retention than tests that require recognition, such as multiple-choice tests. The mnemonic benefits of testing are further enhanced by feedback, which helps students to correct errors and confirm correct answers. Medical educational research has focused extensively on assessment issues. Such assessment research permits the conclusion that clinical expertise is founded on a broad fund of knowledge and effective memory networks that allow easy access to that knowledge. Test-enhanced learning can potentially strengthen clinical knowledge that will lead to improved expertise. Tests should be given often and spaced out in time to promote better retention of information. Questions that require effortful recall produce the greatest gains in memory. Feedback is crucial to learning from tests. Test-enhanced learning may be an effective tool for medical educators to use in promoting retention of clinical knowledge.

Effects of Test Expectation on Multiple-Choice Performance and Subjective Ratings

Undergraduates studied the definitions of 16 psychology terms, expecting either a multiple-choice ( n = 132) or short-answer ( n = 122) test. All students then received the same multiple-choice test, requiring them to recognize the definitions as well as novel examples of the terms. Compared to students expecting a multiple-choice test, those expecting a short-answer test performed similarly on example questions but significantly better on definition questions. Students in these 2 test-expectation conditions also differed in several subjective ratings of their study and test taking. The results suggest that students do not typically study in an optimal way for multiple-choice tests.

Test format and corrective feedback modify the effect of testing on long-term retention

We investigated the effects of format of an initial test and whether or not students received corrective feedback on that test on a final test of retention 3 days later. In Experiment 1, subjects studied four short journal papers. Immediately after reading each paper, they received either a multiple choice (MC) test, a short answer (SA) test, a list of statements to read, or a filler task. The MC test, SA test, and list of statements tapped identical facts from the studied material. No feedback was provided during the initial tests. On a final test 3 days later (consisting of MC and SA questions), having had an intervening MC test led to better performance than an intervening SA test, but the intervening MC condition did not differ significantly from the read statements condition. To better equate exposure to test-relevant information, corrective feedback during the initial tests was introduced in Experiment 2. With feedback provided, having had an intervening SA test led to the best performance on the final test, suggesting that the more demanding the retrieval processes engendered by the intervening test, the greater the benefit to final retention. The practical application of these findings is that regular SA quizzes with feedback may be more effective in enhancing student learning than repeated presentation of target facts or taking an MC quiz.