Source Of Feedback Research Articles

Doing More With Written Feedback: Improving Learner Satisfaction and Reflection With the LEAF (Learner-Engaged Analysis of Feedback) Method.

Written feedback is often overly positive, nonspecific, and difficult to interpret. Learner satisfaction with written feedback is low and obtaining written feedback that encourages self-reflection is challenging. Improving feedback quality is laborious and only modestly effective. The authors developed the LEAF (Learner-Engaged Analysis of Feedback) method to improve learner satisfaction with, and reflection on, existing written feedback. The method pairs a learner and coach to methodically identify themes in the learner's written feedback. Themes occurring more frequently or less frequently than typical offer areas for reflection, as they may identify learners' relative strengths or weaknesses. The method was introduced at the Massachusetts General Hospital in 2017 during program director (PD) meetings with anesthesiology residents. In 2018, resident satisfaction was measured (1 to 5 Likert-type questions, 1 = "not at all satisfied," 5 = "extremely satisfied") for 4 feedback sources, 2 related to the LEAF method (PD meetings, written feedback) and 2 unrelated (verbal feedback, mentor feedback). Residents' comments were qualitatively assessed to explore the impact on self-reflection. Residents who had participated in a LEAF session (n = 54), compared with those who had not (n = 11), reported higher satisfaction with written feedback (mean 3.1 versus 2.5, d = 0.53, P = .03) and PD meeting feedback (mean 3.8 versus 2.8, d = 0.80, P = .03). There were no significant differences between groups for satisfaction with feedback unrelated to the LEAF method. Qualitative analysis of comments suggested that residents found the method useful for providing holistic self-assessment, facilitating goal setting, uncovering blind spots, and improving feedback interpretation. Next steps should include studies determining if the association between increased learner satisfaction with written feedback and the LEAF method is causal, and whether this feedback process changes learners' subsequent behaviors.

The types and effects of feedback received by emergency ambulance staff: a systematic mixed studies review with narrative synthesis.

Aims:The phenomenon of feedback is well-researched within the wider healthcare context, where it is suggested that feedback can improve patient care and patient safety by enhancing clinical performance and staff mental health (Ivers et al., 2012). Within a pre-hospital context, systematic reviews have been conducted for automated feedback from defibrillators and debrief after simulation, but not on the wider concept of feedback. The aim of this systematic review was to identify, describe and synthesise the published literature on the types and effects of feedback received by emergency ambulance staff.Methods:This study is a systematic mixed studies review including empirical primary research of qualitative, quantitative and mixed-methods methodology published in peer-reviewed journals in English. Studies were included if they explored the concept of feedback as defined in this review, i.e. the systematised provision of information to emergency ambulance staff regarding their performance within pre-hospital practice and/or patient outcomes. The search strategy consisted of three facets: ambulance staff synonyms, feedback synonyms and feedback content. Databases searched on 11 June 2020 from inception were MEDLINE, EMBASE, AMED, PsycInfo, HMIC, CINAHL and Web of Science. Study quality was appraised using the Mixed Methods Appraisal Tool (Hong et al., 2018), and data were analysed using narrative synthesis guided by Popay et al. (2006) following a parallel-results convergent synthesis design.Results:The search strategy yielded 2424 articles, excluding duplicates. Seventy-eight studies met the inclusion criteria after full-text review, of which 37 only mentioned feedback as a solution to improving specific circumstances (e.g. decision-making, burnout). The remaining 41 studies consisted of: 34 interventional pre-hospital feedback studies; four non-interventional feedback studies; and three preparatory studies. The source, content and mode of pre-hospital feedback represented in the studies varied greatly and encompassed feedback on behaviour and/or feedback on outcomes of behaviour (Michie et al., 2013). The main outcome measure of included studies was quality of care (e.g. quality of CPR, adherence to guidelines) but softer measures such as staff wellbeing, professional development and clinical decision-making were also represented.Conclusion:It is anticipated that the review findings will be useful to guide the development of future pre-hospital feedback interventions, for which there is growing interest in the national and international pre-hospital setting. Further empirical research is required to explore whether the published literature reflects current pre-hospital practice.

Dashboards and report cards: Using staff performance to drive outcomes.

Dashboards and report cards: Using staff performance to drive outcomes.

An inter-comparison between ENDF/B-VIII.0-NECP-Atlas and ENDF/B-VIII.0-NJOY results for criticality safety benchmarks and benchmarks on the reactivity temperature coefficient

Since the nuclear data forms a vital component in reactor physics computations, the nuclear community needs processing codes as tools for translating the Evaluated Nuclear Data Files (ENDF) to simulate nuclear-related problems such as an ACE format that is used for MCNP. Errors, inaccuracies or discrepancies in library processing may lead to a calculation that disagrees with the experimentally measured benchmark. This paper provides an overview of the processing and preparation of ENDF/B-VIII.0 incident neutron data with NECP-Atlas and NJOY codes for implementation in the MCNP code. The resulting libraries are statistically inter-compared and tested by conducting benchmark calculations, as the mutual-comparison is a source of strong feedback for further improvements in processing procedures. The database of the benchmark experiments is based on a selection taken from the International Handbook of Evaluated Criticality Safety Benchmark Experiments (ICSBEP handbook) and those proposed by Russell D. Mosteller. In general, there is quite good agreement between the NECP-Atlas1.2 and NJOY21(1.0.0.json) results with no substantial differences, if the correct input parameters are used.

Discriminability of multiple cutaneous and proprioceptive hand percepts evoked by intraneural stimulation with Utah slanted electrode arrays in human amputees

BackgroundElectrical stimulation of residual afferent nerve fibers can evoke sensations from a missing limb after amputation, and bionic arms endowed with artificial sensory feedback have been shown to confer functional and psychological benefits. Here we explore the extent to which artificial sensations can be discriminated based on location, quality, and intensity.MethodsWe implanted Utah Slanted Electrode Arrays (USEAs) in the arm nerves of three transradial amputees and delivered electrical stimulation via different electrodes and frequencies to produce sensations on the missing hand with various locations, qualities, and intensities. Participants performed blind discrimination trials to discriminate among these artificial sensations.ResultsParticipants successfully discriminated cutaneous and proprioceptive sensations ranging in location, quality and intensity. Performance was significantly greater than chance for all discrimination tasks, including discrimination among up to ten different cutaneous location-intensity combinations (15/30 successes, p < 0.0001) and seven different proprioceptive location-intensity combinations (21/40 successes, p < 0.0001). Variations in the site of stimulation within the nerve, via electrode selection, enabled discrimination among up to five locations and qualities (35/35 successes, p < 0.0001). Variations in the stimulation frequency enabled discrimination among four different intensities at the same location (13/20 successes, p < 0.0005). One participant also discriminated among individual stimulation of two different USEA electrodes, simultaneous stimulation on both electrodes, and interleaved stimulation on both electrodes (20/24 successes, p < 0.0001).ConclusionElectrode location, stimulation frequency, and stimulation pattern can be modulated to evoke functionally discriminable sensations with a range of locations, qualities, and intensities. This rich source of artificial sensory feedback may enhance functional performance and embodiment of bionic arms endowed with a sense of touch.

Medical managers’ financial accountability: The effects of feedback on work outcome and managerial performance

AbstractThis paper contributes to the limited empirical enquiries into the role of accounting in affecting medical professionals’ financial accountability perceptions and related outcomes and performance. It examines the associations among formal and informal feedback processes, managers’ financial accountability, work attitudes, and performance. Results of our survey to a sample of 115 senior medical managers in an Italian hospital reveal that the association between performance feedback sources and managerial performance depends on managers’ felt accountability and commitment. Further, we find that commitment bridges the link between accountability and managerial performance. Our findings provide two useful insights for healthcare management. First, healthcare managers should improve the technical features of the formal performance feedback practices to update medical managers on their goals in a timely and useful manner. Second, healthcare managers should encourage unplanned, spontaneous, and voluntary social interactions to enhance the positive effects of informal feedback. To sum up, our research adds to the limited knowledge of the accountability and performance literature using data from the actual setting and subjects of concern.

\u2018My Point of Departure for Analytics is Extreme Skepticism\u2019: Implications Derived from An Investigation of University Teachers\u2019 Learning Analytics Perspectives and Design Practices

The literature until 2020 has forecasted a significant uptake of learning analytics (LA) to support learning design in higher education. However, there remain only a few investigations into teachers’ course design practices and their perspectives on LA as a tool to support their design practices. This paper presents findings from an examination of 16 university teachers’ design practices and perspectives on LA at two Norwegian universities (The University of Oslo and Oslo Metropolitan University). On one hand, findings identified situational factors, feedback sources and teachers’ intuition as key influencers of teachers’ course design decisions. On the other hand, guided by principles of the technology acceptance model, this study identified mixed reactions amongst teachers regarding the awareness, understanding and potential use of LA to support course design practices. In particular, most teachers appreciated the formative and normative value of LA to provide more objective evidence about students’ learning patterns and to shape learning trajectories, but some were skeptical about the evaluative role where LA is used to evaluate teachers’ and students’ performance based on unnuanced data (e.g. no theory guidance) with limited depth in observation. This article contributes to the understanding of factors fundamental to linking LA to teachers’ course design practices by synthesizing findings to propose a ‘bi-directional LA-course design’ conceptual framework that clarifies key elements that influence teachers’ design practices and highlighting their implications for LA integration.

(Mis)alignment in Relation to Written Corrective Feedback: the Teachers’ Beliefs and Practices vs the Students’ Preferences in an EFL Context

This paper, which investigates written corrective feedback (WCF) in the context of English as a Foreign Language (EFL), will address two research questions: (a) to what extent are the teachers’ beliefs and practices regarding the provision of WCF on the students’ EFL writing aligned?; (b) to what extent do the students’ preferences match the teachers’ practices regarding WCF? The participants of the study were nine writing teachers and their 75 pre-intermediate and intermediate students in one General Foundation Programme (GFP) in Oman. Semi-structured interviews, classroom observation, student text analysis, and student focus groups were employed as the research instruments of the study to attempt to answer the research questions. The study revealed more areas of misalignment than alignment between the teachers’ beliefs and practices related to WCF. The areas of misalignment are related to the writing of praising comments, redrafting, the amount of feedback, the explicitness of feedback and the focus of feedback, whereas the areas of alignment are related to the identification and the correction of errors. In addition to that, the findings indicated that there were more areas of congruence than incongruence between the students' preferences and the teachers’ beliefs and practices regarding WCF. As for the areas of congruence, they are related to the explicitness of feedback, the amount of feedback, the source of feedback, and the correction of errors. The areas of incongruence, however, are related to the focus of the feedback and the writing of praising comments. The paper concluded by providing some implications for pedagogy related to WCF.

Study on Human Fingers Perception over Textured Surfaces for the Textural Applications in Haptics Technology

Haptics technology uses skin as a source for feedback and helps in the perception of the stimulus. There are various types of actuators or displays used in haptics perception, like electro-tactile, vibrotactile, thermal coil and physical pins. These actuators require larger neural density for being used as an application. Hairy and Non-Hairy skin, its neural density pattern must be observed for perception memory applications. The textural applications in haptics technology are one of the kinds which use skin and its perception levels. The paper discusses the behaviour of fingertips and fingertip’s skin behaviour pattern towards textural applications in tactile feedback. The experiment in the paper uses psychophysical assumptions and single-blinded method of perception over six human participants under three environmental condition, and 10 stimuli which are used in everyday activity. The experimental result focuses on the perception time and perception memory of human fingertips, which will a comparative data with real-time haptic feedback. The experimental methods discussed in the paper addresses low-cost perception experiment for a preliminary study of haptics textural applications.

Cortical Reorganization: Reallocated Responses without Rewiring

Summary Is the brain able to reorganise following loss of sensory input? New work on individuals with sight loss shows that, while brain areas normally allocated to vision respond to other sensory stimuli, those responses are unlikely to mean the brain has rewired.

The effect of feedback valence and source on perception and metacognition: An fMRI investigation

ABSTRACT Receiving feedback from our environment that informs us about the outcomes of our actions helps us assess our abilities (e.g., metacognition) and to flexibly adapt our behavior, consequently increasing our chances of success. However, a detailed examination of the effect of feedback on the brain activation during perceptual and confidence judgments as well as the interrelations between perceptual accuracy, prospective and retrospective confidence remains unclear. Here we used functional magnetic resonance imaging (fMRI) to examine the neural response to feedback valence and source in visual contrast discrimination together with prospective confidence judgments at the beginning of each block and retrospective confidence judgments after every decision. Positive feedback was associated with higher activation (or lower deactivation depending on the area) in areas previously involved in attention, performance monitoring and visual regions during the perceptual judgment than during the confidence judgment. Changes in prospective confidence were positively related to changes in perceptual accuracy as well as to the corresponding retrospective confidence. Thus, feedback information impacted multiple, qualitatively different brain processing states, and we also revealed the dynamic interplay between prospective, perceptual accuracy and retrospective self-assessment.

Family satisfaction in a neuro trauma ICU.

The purpose of this quality improvement initiative was to evaluate satisfaction of family members of patients in a neuro trauma ICU (NTICU). Adult patients (age 18+) admitted to the NTICU for at least 24 hours between June 2017 and November 2018 were identified. Near or at the time of discharge from the NTICU, the health unit coordinator or registered nurse identified the family member who was either the next-of-kin, surrogate decision-maker, or person who had been most frequently present at the patient's bedside. This person was provided a packet containing a letter of consent and the Critical Care Family Satisfaction Survey (CCFSS). Surveys were completed by 78 family members, the majority of whom were the wife of the patient (n=35, 44%), 60 years and older (n=48, 60.8%). Fifty-seven percent of patients (n=45) were in the ICU less than 3 days and 59% (n=47) of medical events were injury-related. Total CCFSS scores ranged from 69 to 100 (median 95). The item with the largest number of dissatisfied responses was "Noise level in the critical care unit" (n=4, 5.3% not satisfied). Open-ended question comments were primarily positive (n=60, 66%), with 32% (n=29) representing areas for improvement. Results of this satisfaction survey have been disseminated to leadership and have been taken into consideration in the planning of a new hospital building currently being built, including ICU patient rooms that allow for more privacy and reduced noise, and more comfortable family rooms. Family members are a very useful source of feedback for ICU care. Several concerns identified by family members in this study are likely to be relevant to other sites. These included: communication between health care providers and family about patient status, noise in the ICU, peaceful waiting areas for family, and slow transfers.

Realistic mock observations of the sizes and stellar mass surface densities of massive galaxies in FIRE-2 zoom-in simulations

ABSTRACT The galaxy size–stellar mass and central surface density–stellar mass relationships are fundamental observational constraints on galaxy formation models. However, inferring the physical size of a galaxy from observed stellar emission is non-trivial due to various observational effects, such as the mass-to-light ratio variations that can be caused by non-uniform stellar ages, metallicities, and dust attenuation. Consequently, forward-modelling light-based sizes from simulations is desirable. In this work, we use the skirt dust radiative transfer code to generate synthetic observations of massive galaxies ($M_{*}\sim 10^{11}\, \rm {M_{\odot }}$ at z = 2, hosted by haloes of mass $M_{\rm {halo}}\sim 10^{12.5}\, \rm {M_{\odot }}$) from high-resolution cosmological zoom-in simulations that form part of the Feedback In Realistic Environments project. The simulations used in this paper include explicit stellar feedback but no active galactic nucleus (AGN) feedback. From each mock observation, we infer the effective radius (Re), as well as the stellar mass surface density within this radius and within $1\, \rm {kpc}$ (Σe and Σ1, respectively). We first investigate how well the intrinsic half-mass radius and stellar mass surface density can be inferred from observables. The majority of predicted sizes and surface densities are within a factor of 2 of the intrinsic values. We then compare our predictions to the observed size–mass relationship and the Σ1−M⋆ and Σe−M⋆ relationships. At z ≳ 2, the simulated massive galaxies are in general agreement with observational scaling relations. At z ≲ 2, they evolve to become too compact but still star forming, in the stellar mass and redshift regime where many of them should be quenched. Our results suggest that some additional source of feedback, such as AGN-driven outflows, is necessary in order to decrease the central densities of the simulated massive galaxies to bring them into agreement with observations at z ≲ 2.

A Longitudinal Examination of the Accuracy of Perceived Physical Competence in Middle Childhood

Children who underestimate their physical abilities have lower motivation, higher anxiety, and lack of understanding as to why they may be succeeding or struggling in sports settings, which can result in withdrawal from physical activities. Theoretically, middle childhood is a time when perceptions of physical competence (PPC) become more accurate as children develop the cognitive capacity to interpret new sources of feedback and develop a realistic sense of their physical abilities. The purpose of this study was to investigate the extent to which accuracy of PPC changed from grade 2 to grade 4. Participants were 238 boys and girls (Mage = 7.8 yrs) from eight participating elementary schools in Victoria, British Columbia, Canada. The Test of Gross Motor Development–Second Edition was used to assess motor skills. PPC were assessed using the Pictorial Scale of Perceived Competence and Social Acceptance for Young Children (for grade 2) and the Self-Perception Profile for Children (for grades 3 and 4). Results revealed that participants who underestimated or overestimated their physical competence in grade 2 saw an improvement in accuracy, and, by grade 4, had similar accuracy scores to their peers who were considered ‘accurate’ estimators. These results reinforce theory that suggests PPC become more accurate in middle childhood.

Efficacy of an Arabic articulatory errors remediation software program in patients with velopharyngeal valve dysfunction: a quasi-experimental study

BackgroundVelopharyngeal dysfunction causes abnormal speech due to altered nasal resonance during the production of oral speech sounds. The development of computer-based speech therapy has been growing to make use of computer technology in providing an organized effective source for speech therapy and feedback. The development of a remediation software program that is specific for patients with velopharyngeal dysfunction in the Arabic language and testing its efficacy on patients’ speech was the aim of this study.ResultsThe study showed significant improvement in speech parameters after intervention with p value less than 0.05 for nasometer values and parameters of auditory perceptual assessment. The study proved a significant relation between nasometer values and auditory perceptual assessment.ConclusionThe designed software program proved to be a good therapeutic tool in improving speech in patients with velopharyngeal dysfunction. The application of the program on a larger number of patients and in comparison with traditional methods of speech therapy and biofeedback is recommended.Trial registrationThe study was retrospectively registered at www.clinicaltrials.govNCT04392817

Integral Field Spectroscopy of Fast Outflows in Dwarf Galaxies with AGNs

Abstract Feedback likely plays a vital role in the formation of dwarf galaxies. While stellar processes have long been considered the main source of feedback, recent studies have revealed tantalizing signs of active galactic nucleus (AGN) feedback in dwarf galaxies. In this paper, we report the results from an integral field spectroscopic study of a sample of eight dwarf galaxies with known AGNs and suspected outflows. Outflows are detected in seven of them. The outflows are fast, with 50th-percentile (median) velocity of up to ∼240 km s−1 and 80th-percentile line width reaching ∼1200 km s−1, in clear contrast with the more quiescent kinematics of the host gas and stellar components. The outflows are generally spatially extended on a scale of several hundred parsecs to a few kiloparsecs, although our data do not clearly resolve the outflows in three targets. The outflows appear to be primarily photoionized by the AGN rather than shocks or young, massive stars. The kinematics and energetics of these outflows suggest that they are primarily driven by the AGN, although the star formation activity in these objects may also contribute to the energy input. A small but nonnegligible portion of the outflowing material likely escapes the main body of the host galaxy and contributes to the enrichment of the circumgalactic medium. Overall, the impact of these outflows on their host galaxies is similar to those taking place in the more luminous AGNs in the low-redshift universe.

Interstellar anatomy of the TeV gamma-ray peak in the IC443 supernova remnant

Context.Supernova remnants (SNRs) represent a major feedback source from stars in the interstellar medium of galaxies. During the latest stage of supernova explosions, shock waves produced by the initial blast modify the chemistry of gas and dust, inject kinetic energy into the surroundings, and may alter star formation characteristics. Simultaneously,γ-ray emission is generated by the interaction between the ambient medium and cosmic rays (CRs), including those accelerated in the early stages of the explosion.Aims.We study the stellar and interstellar contents of IC443, an evolved shell-type SNR at a distance of 1.9 kpc with an estimated age of 30 kyr. We aim to measure the mass of the gas and characterize the nature of infrared point sources within the extended G region, which corresponds to the peak ofγ-ray emission detected by VERITAS andFermi.Methods.We performed 10′ × 10′ mapped observations of12CO,13COJ= 1–0,J= 2–1, andJ= 3–2 pure rotational lines, as well as C18OJ= 1–0 andJ= 2–1 obtained with the IRAM 30 m and APEX telescopes over the extent of theγ-ray peak to reveal the molecular structure of the region. We first compared our data with local thermodynamic equilibrium models. We estimated the optical depth of each line from the emission of the isotopologs13CO and C18O. We used the population diagram and large velocity gradient assumption to measure the column density, mass, and kinetic temperature of the gas using12CO and13CO lines. We used complementary data (stars, gas, and dust at multiple wavelengths) and infrared point source catalogs to search for protostar candidates.Results.Our observations reveal four molecular structures: a shocked molecular clump associated with emission lines extending between −31 and 16 km s−1, a quiescent, dark cloudlet associated with a line width of ~2 km s−1, a narrow ring-like structure associated with a line width of ~1.5 km s−1, and a shocked knot. We measured a total mass of ~230, ~90, ~210, and ~4M⊙, respectively, for the cloudlet, ring-like structure, shocked clump, and shocked knot. We measured a mass of ~1100M⊙throughout the rest of the field of observations where an ambient cloud is detected. We found 144 protostar candidates in the region.Conclusions.Our results emphasize how the mass associated with the ring-like structure and the cloudlet cannot be overlooked when quantifying the interaction of CRs with the dense local medium. Additionally, the presence of numerous possible protostars in the region might represent a fresh source of CRs, which must also be taken into account in the interpretation ofγ-ray observationsin this region.

Decay Results for a Viscoelastic Problem with Nonlinear Boundary Feedback and Logarithmic Source Term

The main goal of this work is to investigate the long-time behavior of a viscoelastic equation with a logarithmic source term and a nonlinear feedback localized on a part of the boundary. In the framework of potential well, we first show the global existence. Then, we discuss the asymptotic behavior of the problem with a very general assumption on the behavior of the relaxation function g, namely, $g^{\prime }(t)\le -\xi (t) G(g(t))$ . We establish explicit and general decay results from which we can recover the well-known exponential and polynomial rates when G(s) = sp and p covers the full admissible range [1,2). Our results are obtained without imposing any restrictive growth assumption on the boundary damping term. This work generalizes and improves many earlier results in the literature.

Auditory Feedback Effectiveness for Enabling Safe Sclera Force in Robot-Assisted Vitreoretinal Surgery: a Multi-User Study.

Robot-assisted retinal surgery has become increasingly prevalent in recent years in part due to the potential for robots to help surgeons improve the safety of an immensely delicate and difficult set of tasks. The integration of robots into retinal surgery has resulted in diminished surgeon perception of tool-to-tissue interaction forces due to robot's stiffness. The tactile perception of these interaction forces (sclera force) has long been a crucial source of feedback for surgeons who rely on them to guide surgical maneuvers and to prevent damaging forces from being applied to the eye. This problem is exacerbated when there are unfavorable sclera forces originating from patient movements (dynamic eyeball manipulation) during surgery which may cause the sclera forces to increase even drastically. In this study we aim at evaluating the efficacy of providing warning auditory feedback based on the level of sclera force measured by force sensing instruments. The intent is to enhance safety during dynamic eye manipulations in robot-assisted retinal surgery. The disturbances caused by lateral movement of patient's head are simulated using a piezo-actuated linear stage. The Johns Hopkins Steady-Hand Eye Robot (SHER), is then used in a multi-user experiment. Twelve participants are asked to perform a mock retinal surgery by following painted vessels inside an eye phantom using a force sensing instrument while auditory feedback is provided. The results indicate that the users are able to handle the eye motion disturbances while maintaining the sclera forces within safe boundaries when audio feedback is provided.

Feedback intervention perceptions: Development and validation of a measure

Reactions toward performance feedback have critical implications for organizations and are of great interest to practitioners. Current measurement of employee experiences with feedback intervention varies widely and the literature is flooded with untested, coarse measures that largely neglect the complexity of feedback intervention. A new scale was developed to evaluate the characteristics of five feedback intervention components (i.e., performance measurement, feedback content, feedback delivery, organizational system support, and feedback source). Confirmatory factor analysis supports a five-factor structure. Correlational analyses demonstrate strong, differential relationships with feedback reaction measures and job satisfaction. Regression analyses demonstrate direct effects on motivation and intent to use feedback, and organizational justice mediates the relationships. Results indicate that the measure has good psychometric properties and support the utility of the Feedback Intervention Perceptions Scale for both research and practice. The FIPS provides practitioners with an evidence-based tool for holistically auditing and diagnosing deficiencies in organizational feedback interventions. A short form of the FIPS and preliminary validity evidence is also presented.