Expert-novice Differences Research Articles

Characterizing Expert-Novice Differences on a Repeating Pattern Task

Patterning is often considered important for cognitive development because it offers opportunities for detecting rules and structure. However, it is not clear what distinguishes experts and novices in this domain. In this study, 95 adults (Mage = 19.5 years) and 90 children (Mage = 5.4 years) completed a repeating pattern abstraction task and explained their response after each item. We hypothesized that two strategies present in their speech and gesture—Unit Identification and Mapping—were reliable indicators of expertise. Multiple metrics supported this hypothesis: Adults used these strategies more than children; expert children used some of these strategies more than novice children; frequency of using these strategies predicted task accuracy; and success rates were high when these strategies were aligned in speech and gesture. Findings have important implications for characterizing expertise in patterning and for the precise operationalization of attention to structure.

Breaking the silence: understanding teachers’ use of silence in classrooms

ABSTRACT Silence in classrooms is an undervalued and understudied phenomenon. There is limited research on how teachers behave and think during teachers’ silence in lessons. There are also methodological constraints due to the lack of teacher’s talk during silence. This study used eye-tracking technology to visualize the noticing patterns of two science teachers during silence lasting more than three seconds. Using video data recorded from cameras and eye trackers, we examined each silent event and interpreted teachers’ perceptions and interpretations with consideration of eye fixations, actions of students and teachers during the silence, and teachers’ actions immediately after they broke the silence. We further examined expert-novice differences in teachers’ use of silence. Four categories of teachers’ silence were identified: silence for (1) preparing the classroom for learning; (2) teaching, questioning, and facilitating learning; (3) reflecting and thinking, and (4) behavioural management. Expert-novice differences were identified, especially in the teachers’ use of silence for approaches to teaching, reflection, and behavioural management. The novel contribution of this paper lies in the characterization of silences as observed in actual classroom settings as well as the methodological innovation in using eye trackers and video to overcome the constraints of lack of talk data during silence.

The effects of task difficulty on gaze behaviour during landing with visual flight rules in low-time pilots.

Eye movements have been used to examine the cognitive function of pilots and understand how information processing abilities impact performance. Traditional and advanced measures of gaze behaviour effectively reflect changes in cognitive load, situational awareness, and expert-novice differences. However, the extent to which gaze behaviour changes during the early stages of skill development has yet to be addressed. The current study investigated the impact of task difficulty on gaze behaviour in low-time pilots (N=18) while they completed simulated landing scenarios. An increase in task difficulty resulted in longer fixation of the runway, and a reduction in the stationary gaze entropy (gaze dispersion) and gaze transition entropy (sequence complexity). These findings suggest that pilots' gaze became less complex and more focused on fewer areas of interest when task difficulty increased. Additionally, a novel approach to identify and track instances when pilots restrict their attention outside the cockpit (i.e., gaze tunneling) was explored and shown to be sensitive to changes in task difficulty. Altogether, the gaze-related metrics used in the present study provide valuable information for assessing pilots gaze behaviour and help further understand how gaze contributes to better performance in low-time pilots.

Using eye tracking to examine expert-novice differences during simulated surgical training: A case study

Eye tracking data can serve as a unique metric for comparing expert-novice differences by providing insights into attentional processes, which can lead to timely intervention and better instruction. In this study, we used eye tracking technology to record and analyze the eye movements of experts and novices conducting a surgical procedure in a simulation environment. Specifically, we compared the differences in the eye movement parameters (i.e., average fixation, saccade, and blink durations), the distribution of visual attention, and the shift of visual focus between experts and novices across three task phases. We found that experts had longer fixation durations, shorter saccade durations, and more gaze points on task-relevant areas. The visual attention of novices was more diffuse than experts. Moreover, task complexity was found to moderate the size of expert-novice differences in their eye movements. Findings from this study inform the assessment of professional competency in the medicine domain. This study also helps to advance the use of eye tracking as a methodology for educational research.

Visual strategies of young soccer players during a passing test - A pilot study.

In sports, studies on visual behavior have mostly focused on expert-novice differences during decision making tasks and during aiming tasks. How visual behavior changes during the early stages of skill acquisition however, has hardly been documented. The current study investigated gaze behavior of young soccer players during the execution of a soccer passing task. Gaze behavior of eleven 8- to 10-year-old soccer players was recorded while they performed the Loughborough Soccer Passing Test. Based on their score, participants were then divided into a high performance group (N=5), and a low performance group (N=6). Results showed that the low performance group tended to look more at the ball while they were handling it. These findings suggest that gaze strategies develop alongside technical skills. More insights in the interplay between technical skills and gaze strategies during skill acquisition could lead to improved training methods for young soccer players.

Nonlinear refinement of functional brain connectivity in golf players of different skill levels

Different functional connectivities in the brain, specifically in the frontoparietal and motor cortex–sensorimotor circuits, have been associated with superior performance in athletes. However, previous electroencephalogram (EEG) studies have only focused on the frontoparietal circuit and have not provided a comprehensive understanding of the cognitive–motor processes underlying superior performance. We used EEG coherence analysis to examine the motor cortex–sensorimotor circuit in golfers of different skill levels. Twenty experts, 18 amateurs, and 21 novices performed 60 putts at individual putting distances (40–60% success rate). The imaginary inter-site phase coherence (imISPC) was used to compute 8–13 Hz coherence that can be used to distinguish expert-novice and expert-amateur differences during motor preparation. We assessed the 8–13 Hz imISPC between the Cz and F3, F4, C3, C4, T3, T4, P3, P4, O1, and O2 regions. (1) Amateurs had lower 8–13 Hz imISPC in the central regions (Cz–C3 and C4) than novices and experts, but experts had lower 8–13 Hz imISPC than novices. (2) Skilled golfers (experts and amateurs) had lower 8–13 Hz imISPC in the central–parietal regions (Cz–P3 and P4) than novices. (3) Experts had lower 8–13 Hz imISPC in the central–left temporal regions (Cz–T7) than amateurs and novices. Our study revealed that refinement of the motor cortex–sensorimotor circuit follows a U-shaped coherence pattern based on the stage of learning. The early learning stage (i.e., novice to amateur) is characterized by lower connectivity between the regions associated with motor control and visuospatial processes, whereas the late learning stage (i.e., amateur to expert) is characterized by lower connectivity in the regions associated with verbal-analytic and motor control processes.

Keeping track of expert teachers: Comparing the affordances of think-aloud elicited by two different video perspectives

Verbal data from think-aloud is uniquely unobtrusive and non-reactive. It can therefore generate real-time insight into how expert teachers think. Our paper analyses data from two video-stimulated retrospective think-aloud approaches. The first approach used videos of others' teaching as stimuli for participating teachers' think-aloud. The second approach involved the teachers' own-perspective videos, overlaid with the teachers' own gaze patterns that were simultaneously recorded. In all, the study sets out to investigate how these two approaches differ with regard to their respective potential for uncovering expert teacher cognition. Others' videos elicited more think-aloud responses than gaze-cued own-perspective videos, especially the operational aspects of classroom teaching. Interaction analysis revealed expert–novice differences to vanish when only think-aloud responses to gaze-cued own-perspective videos were considered. Classroom relationships might be integral for any teacher's navigation of classroom instruction, regardless of expertise.

Does Prosocial Impact Reduce Performance Data Gaming? The Role of Data Visualizations and Expert-Novice Differences

While research has documented the framing effects of performance data on decision-making, little is known about the impact of data visualizations on performance gaming. We propose that performance information portraying prosocial impact reduces gaming if the information is episodic and visualizes benefits for clients in need. We also theorize about expert-novice differences and suggest that performance information is less influential among experts. We conduct an experiment with samples of citizens (novices) and school leaders (experts) in which subjects must decide whether they are willing to omit poorly performing students when calculating school-wide performance scores. We find that school leaders game less than citizens, and that the former are less responsive to episodic information cues than the latter. However, information becomes more influential if it can capture school leaders’ attention and if leaders have little work experience. More broadly, our findings suggest being cautious with generalizations across groups of data users.

Review: The Quiet Eye in Sports Performance-Is the Quiet Eye the Ultimate Explanation or Only the Beginning?

The quiet eye is a gaze behavior that seems to differentiate both expert-novice performance and successful and unsuccessful performance in experts; however, the quiet eye may only represent one aspect of the perceptual-cognitive expertise differences that exist between athletes and nonathletes.Research suggests that expert-novice differences in vision and visual-motor coordination skills exist between athletes and nonathletes, although the underlying mechanisms driving these differences are not well understood. The quiet eye is the final fixation or tracking gaze made before the initiation of the action of importance in a motor coordination task and is quite possibly the most well-studied vision strategy variable in sport. The quiet eye has been shown to be a key component of both expert ability and successful performance. However, the quiet eye is not without its criticisms, and the perceptual mechanisms underlying this unique gaze behavior are not yet well understood. The question that remains to be answered is whether the differences in vision and visual-motor coordination skills that exist between athletes and nonathletes can be explained by the quiet eye alone or if the explanation is more complicated.

Creating a Scoring System with an Armband Wearable Device for Table Tennis Forehand Loop Training: Combined Use of the Principal Component Analysis and Artificial Neural Network.

Background: This study presents an intelligent table tennis e-training system based on a neural network (NN) model that recognizes data from sensors built into an armband device, with the component values (performances scores) estimated through principal component analysis (PCA). Methods: Six expert male table tennis players on the National Youth Team (mean age 17.8 ± 1.2 years) and seven novice male players (mean age 20.5 ± 1.5 years) with less than 1 year of experience were recruited into the study. Three-axis peak forearm angular velocity, acceleration, and eight-channel integrated electromyographic data were used to classify both player level and stroke phase. Data were preprocessed through PCA extraction from forehand loop signals. The model was trained using 160 datasets from five experts and five novices and validated using 48 new datasets from one expert and two novices. Results: The overall model’s recognition accuracy was 89.84%, and its prediction accuracies for testing and new data were 93.75% and 85.42%, respectively. Principal components corresponding to the skills “explosive force of the forearm” and “wrist muscle control” were extracted, and their factor scores were standardized (0–100) to score the skills of the players. Assessment results indicated that expert scores generally fell between 60 and 100, whereas novice scores were less than 70. Conclusion: The developed system can provide useful information to quantify expert-novice differences in fore-hand loop skills.

The effect of expertise, target usefulness and image structure on visual search

Experts outperform novices on many cognitive and perceptual tasks. Extensive training has tuned experts to the most relevant information in their specific domain, allowing them to make decisions quickly and accurately. We compared a group of fingerprint examiners to a group of novices on their ability to search for information in fingerprints across two experiments—one where participants searched for target features within a single fingerprint and another where they searched for points of difference between two fingerprints. In both experiments, we also varied how useful the target feature was and whether participants searched for these targets in a typical fingerprint or one that had been scrambled. Experts more efficiently located targets when searching for them in intact but not scrambled fingerprints. In Experiment 1, we also found that experts more efficiently located target features classified as more useful compared to novices, but this expert-novice difference was not present when the target feature was classified as less useful. The usefulness of the target may therefore have influenced the search strategies that participants used, and the visual search advantages that experts display appear to depend on their vast experience with visual regularity in fingerprints. These results align with a domain-specific account of expertise and suggest that perceptual training ought to involve learning to attend to task-critical features.

A COGNITIVE MODEL TO ANALYSE PHYSICS AND CHEMISTRY PROBLEM-SOLVING SKILLS: MENTAL REPRESENTATIONS IMPLIED IN SOLVING ACTIONS

In physics and chemistry, the development of problem-solving skills is necessary to become an expert. A simple cognitive model to analyse such development is proposed and tested. An exploratory research was conducted with expert professors and students in initial and advanced years. A think aloud procedure was used to obtain relevant data while the participants tried to solve undefined, open problems. Solving these problems required a particular skill representative of expertise: modelling reality using science. More than 1350 solving actions were collected and related to the mental representations elaborated, developed and inter-related by solvers. The proposed model was able to account for expert-novice differences in terms of the respective distributions of solving actions among the mental representations. Large differences appeared in the mental representation of Conceptual scientific Model. In addition, advanced and initial students showed similar and significant averages of unproductive actions, while experts took very few. Experts showed high convergence in their distributions of actions among the mental representations. If the outcomes were replicated with higher external validity, the model could help researchers to analyse the cognitive mechanisms in problem-solving, and teachers to better focus their efforts on specific students’ lacks. Keywords: cognitive model, expert-novice differences, mental representations, problem-solving skills, solving actions

Are Creative People Better than Others at Recognizing Creative Work?

It is often assumed that people with high ability in a domain will be excellent raters of quality within that same domain. This assumption is an underlying principle of using raters for creativity tasks, as in the Consensual Assessment Technique. While several prior studies have examined expert-novice differences in ratings, none have examined whether experts’ ability to identify the quality of a creative product is being driven more by their ability to identify high quality work, low quality work, or both. To address this question, a sample of 142 participants completed individual difference measures and rated the quality of several sets of creative captions. Unbeknownst to the participants, the captions had been identified a prior by expert raters as being of particularly high or low quality. Hierarchical regression analyses revealed that after controlling for participants’ background and personality, those who scored significantly higher on any of three external measures of creativity also rated low-quality captions significantly lower than their peers; however, they did not rate the high-quality captions significantly higher. These findings support research in other domains suggesting that ratings of quality may be driven more by the lower end of the quality spectrum than the high end.

An expert–novice comparison of feature choice

SummaryPerceptual experts have learned to rapidly and accurately perceive the structural regularities that define categories and identities within a domain. They extract important features and their relations more efficiently than novices. We used fingerprint examination to investigate expert–novice differences in feature choice. On each fingerprint within our set, experts and novices selected one feature they thought was most useful for distinguishing a particular print and one feature they thought was least useful. We found that experts and novices often differed in the features they chose, and experts tended to agree more with each other. However, any such expert–novice difference appeared to depend on the image at hand typically emerging when salient or more conspicuous features of a fingerprint were unclear. We suggest that perceptual training ought to direct attention to useful features with the understanding that what is useful may change depending on the clarity of the stimuli.

An investigation of expertise in cycling: Eye tracking, Think Aloud and the influence of a competitor

ObjectivesTwo studies investigated expert-novice differences in information-seeking behaviour, cognitions and performance during cycling time trials (TT). Study 1 examined trained and novice cyclist’s cognitions whilst performing a TT, using a Think Aloud (TA) protocol and eye-tracking techniques. Study 2 investigated expertise differences during alone and competitive TTs. Methodsin Study 1, six trained and seven novice cyclists performed a 16.1 km TT. In Study 2, eight trained and ten novice cyclists performed three 16.1 km TT; a baseline TT, an alone TT and a trial against a virtual competitor. In both studies, participants were asked to TA and in Study 1 they also wore mobile gaze-tracking glasses. Performance feedback and a simulated TT course were visually displayed during all trials, as was a virtual avatar during the competitor trial. Verbalisations were coded into primary and secondary themes. Cognitions and pacing strategies were compared between groups and across the duration of the TTs. In Study 1, eye-tracking data for total dwell time and gaze frequency were calculated for each area of interest (Time Elapsed, Power, Heart Rate, Cadence, Distance Covered, Speed and Course Scenery). ResultsIn Study 1, no significant differences were found in information-seeking behaviour between groups, however there were expertise differences in the cognitive strategies used. Trained cyclists’ verbalisations were more performance-relevant (i.e., power output), whereas the untrained group were more focused on task completion (i.e., distance and time) and irrelevant information. Both groups talked more about distance and motivational thoughts in the later stages of the trial, and dwell time on distance feedback also increased in this final 4 km. In Study 2, the trained group performed faster than the untrained group but there were no significant differences in pace or performance between alone and competitive TTs for either group. Differences in cognitions were found between groups and across the TT duration. ConclusionBoth studies demonstrate that cognitive processes differ as a function of expertise during self-paced cycling time trials. There were no differences in information-seeking behaviour between trained and untrained cyclists and there was no effect of an opponent on pace or performance.

A protocol analysis of use of forward and backward reasoning during valuation problem solving

PurposeBehavioural studies of valuers have suggested that valuers rely on a number of cognitive strategies involving reasoning and intuition when undertaking a valuation task. However, there are few studies of the actual reasoning mechanisms in valuation. In other fields, much attention has been paid to forward and backward reasoning, as this shows the choices and decisions that are made in undertaking a complex task. This paper studied this during a valuation task. The purpose of this paper is twofold: first, to develop a methodological approach for empirical research on valuers’ reasoning, and, second, to report expert-novice differences on valuers’ use of forward and backward reasoning during a valuation problem solving.Design/methodology/approachThe study utilised a verbal protocol analysis (VPA) to elicit think-aloud data from a purposive sample of a group of valuers of different levels of expertise undertaking a commercial-valuation task. Through a content analysis interpretive strategy, the transcripts were analysed into different cognitive segments identifying the forward and backward reasoning strategies.FindingsThe findings showed that valuers accomplished the valuation task by dividing the overall problem into sub-problems. These sub-problems are thereafter solved by integrating available data with existing knowledge by relying more on forward reasoning than backward reasoning. However, there were effects associated with the level of expertise in the way the processes of forward and backward reasoning are used, with the expert and intermediate valuers being more thorough and comprehensive in their reasoning process than the novices.Research limitations/implicationsThis study explores the possibility that forward and backward reasoning play an important role in commercial valuation problem solving using a limited sample of valuers. Given this, data cannot be generalised to all valuation practice settings but may motivate future research that examines the effectiveness of forward and backward reasoning in diverse valuation practice settings and develops a holistic model of valuation reasoning.Practical implicationsThe findings of this study are applicable to valuation practice. Future training efforts need to evaluate the usefulness of teaching problem solving and explicitly recognise forward and backward reasoning, along with other problem-solving strategies uncovered in this study, as standard training strategies for influencing the quality of valuation decisions.Originality/valueBy adopting VPA, this study employs an insightful and rich dataset which allows an interpretation of thoughts of valuers into cognitive reasoning strategies that provide a deeper level of understanding of how valuers solve valuation problem; this has not been possible in previous related valuation studies.

How well is each learner learning? Validity investigation of a learning curve-based assessment approach for ECG interpretation.

Learning curves can support a competency-based approach to assessment for learning. When interpreting repeated assessment data displayed as learning curves, a key assessment question is: "How well is each learner learning?" We outline the validity argument and investigation relevant to this question, for a computer-based repeated assessment of competence in electrocardiogram (ECG) interpretation. We developed an on-line ECG learning program based on 292 anonymized ECGs collected from an electronic patient database. After diagnosing each ECG, participants received feedback includingthe computer interpretation, cardiologist's annotation, and correct diagnosis.In 2015, participants from a single institution, across a range of ECG skill levels,diagnosed at least 60 ECGs. We planned, collected and evaluated validity evidence under each inference of Kane's validity framework. For Scoring, three cardiologists' kappa for agreement on correct diagnosis was 0.92. There was a range of ECG difficulty across and within each diagnostic category. For Generalization, appropriate sampling was reflected in the inclusion of a typical clinical base rate of 39% normal ECGs. Applying generalizability theory presented unique challenges. Under the Extrapolation inference, group learning curves demonstrated expert-novice differences, performance increased with practice and the incremental phase of the learning curve reflected ongoing, effortful learning. A minority of learners had atypical learning curves. We did not collect Implications evidence. Our results support a preliminary validity argument for a learning curve assessment approach for repeated ECG interpretation with deliberate and mixed practice. This approach holds promise for providing educators and researchers, in collaboration with their learners, with deeper insights into how well each learner is learning.

Fixation Differences in Visual Search of Accident Scenes by Novices and Expert Emergency Responders.

We sought to investigate whether expert-novice differences in visual search behavior found in other domains also apply to accident scenes and the emergency response domain. Emergency service professionals typically arrive at accidents only after being dispatched when a civilian witness has called an emergency dispatch number. Differences in visual search behavior between the civilian witness (usually a novice in terms of emergency response) and the professional first responders (experts at emergency response) could thus result in the experts being given insufficient or erroneous information, which would lead them to arrive unprepared for the actual situation. A between-subjects, controlled eye-tracking experiment with 20 novices and 17 experts (rescue and ambulance service personnel) was conducted to explore expert-novice differences in visual search of accident and control images. The results showed that the experts spent more time looking at task-relevant areas of the accident images than novices did, as predicted by the information reduction hypothesis. The longer time was due to longer fixation durations rather than a larger fixation count. Expert-novice differences in visual search are present in the emergency domain. Given that this domain is essential to saving lives and also relies heavily on novices as the first link in the chain of response, such differences deserve further exploration. Visual search behavior from experts can be used for training purposes. Eye-tracking studies of novices can be used to inform the design of emergency dispatch interviews.

Assessing ocular activity during performance of motor skills using electrooculography.

Eye‐tracking research has revealed that, compared to novices, experts make longer ocular fixations on the target of an action when performing motor skills; that is, they have a longer quiet eye. Remarkably, the reason why a longer quiet eye aids movement has yet to be established. There is a need for interdisciplinary research and new measures to accelerate progress on the mechanistic understanding of the phenomenon. With the aim to provide researchers with new tools, we assessed the utility of electrooculography (EOG) to examine ocular activity while 10 experts and 10 novices putted golf balls. We measured quiet eye durations, distinguishing its pre‐ and postmovement initiation components, and developed a novel time‐varying index of ocular activity, eye quietness, computed as the variability of the EOG in short time intervals: lower values correspond with greater quietness. Finally, we measured movement durations using a combination of infrared and sound sensors. Experts had longer postmovement initiation quiet eye compared to novices; however, total and premovement quiet eye durations did not differ between groups. Eye quietness was inversely correlated with quiet eye duration, and was greatest immediately after movement initiation. Importantly, movement duration correlated positively with postmovement initiation quiet eye and negatively with eye quietness shortly after movement initiation. This study demonstrates the utility of assessing ocular activity during performance of motor skills using EOG. Additionally, these findings provide evidence that expert–novice differences in ocular activity may reflect differences in the kinematics (e.g., movement duration) of how experts and novices execute motor skills.

Scanpath analysis of expertise and culture in teacher gaze in real-world classrooms

Humans are born to learn by understanding where adults look. This is likely to extend into the classroom, making teacher gaze an important topic for study. Expert teacher gaze has mainly been investigated in the laboratory, and has focused mostly on one cognitive process: teacher attentional (i.e., information-seeking) gaze. No known research has made direct cultural comparisons of teacher gaze or successfully found expert–novice differences outside Western settings. Accordingly, we conducted a real-world study of expert teacher gaze across two cultural settings, exploring communicative (i.e., information-giving) as well as attentional gaze. Forty secondary school teachers wore eye-tracking glasses, with 20 teachers (10 expert; 10 novice) from the UK and 20 teachers (10 expert; 10 novice) from Hong Kong. We used a novel eye-tracking scanpath analysis to ascertain the importance of expertise and culture, individually and as a combination. Attentional teacher scanpaths were significantly more similar within than across expertise and expertise + culture sub-groups; communicative scanpaths were significantly more similar within than across expertise and culture. Detailed analysis suggests that (1) expert teachers refer back to students constantly through focused gaze during both attentional and communicative gaze and that (2) expert teachers in Hong Kong scan students more than experts do in the UK.