Self-assessment Of Performance Research Articles

Co-Existing Vascular Surgery Integrated Residencies are Associated with Increased General Surgery Resident Proficiency and Autonomy in Vascular Cases

Integrated vascular surgery residency positions have doubled over the last decade. Studies have investigated the impact of co-existing subspecialty surgical training programs on case volume of general surgery residents (GSR). However, no studies have explored the impact of subspecialty training on GSR operative competency. The aim of this study is to understand the impact of integrated residencies on operative performance and autonomy of GSR performing vascular procedures. Autonomy and performance ratings of GSR participating in vascular surgery cases were collected from all institutions participating in the Society for Improving Medical Professional Learning (SIMPL) application database from 2015-2023. Faculty and self-assessments of autonomy and performance on vascular cases performed by GSR at programs with co-existing vascular integrated residents (VIR), fellows only (VSF), or no vascular trainees (VX) were compared using Fisher's exact tests with Bonferroni corrections across training levels and case complexity. 11,175 assessments (26% at institutions with VIR, 46% VSF, 28% VX) were submitted by 920 GSR and 343 faculty. Senior GSR at programs with VSF achieved lower autonomy than those with VIR (p = 0.049) or VX (p = 0.042) based on faculty assessment. GSR achieved a level of 'practice ready' at significantly higher rates when training at programs with VIR, and at the lowest rates with VSF (p < 0.001). However, self-perception of autonomy and performance was highest among GSR at programs with VX compared to VIR and VSF (p < 0.001). The presence of VIR was associated with higher achievement of 'practice ready' competency and higher levels of operative autonomy among senior GSR performing vascular procedures. Shared learning among peers and faculty expertise in teaching resident-level trainees may contribute to this finding.

Usefulness of low-cost simulation models to learning surgical techniques for placenta accreta spectrum: An observational educational study.

To evaluate the utility of low-cost simulation models to teach surgical techniques for placenta accreta spectrum (PAS), included in a multimodal education workshop for PAS. This was an observational, survey-based study. Participants were surveyed before and after the use of low-fidelity mannequins to simulate two surgical techniques for PAS (one-step conservative surgery [OSCS] and modified subtotal hysterectomy [MSTH]), within a multimodal educational workshop. The workshops included pre-course preparation, didactics, simulated practice of the techniques using low-cost models, and viewing live surgery. Six OSCS/MSTH training workshops occurred across six countries and a total of 270 participants were surveyed. The responses of 127 certified obstetricians and gynecologists (OB-GYNs) were analyzed. Participants expressed favorable impressions of all components of the simulated session. Perceived anatomical simulator fidelity, scenario realism, educational component effectiveness, and self-assessed performance improvement received ratings of 4-5 (positive end of the Likert scale) from over 90% of respondents. When asked about simulation's role in technique comprehension, comfort level in technique performance, and likelihood of recommending this workshop to others, more than 75% of participants rated these aspects with a score of 4-5 (positively) on the five-point scale. Low-cost simulation, within a multimodal education strategy, is a well-accepted intervention for teaching surgical techniques for PAS.

Documenting and analyzing pre-reflective self-consciousness underlying ongoing performance optimization in elite athletes: the theoretical and methodological approach of the course-of-experience framework.

Traditional theories of motor learning emphasize the automaticity of skillful actions. However, recent research has emphasized the role of pre-reflective self-consciousness accompanying skillful action execution. In the present paper, we present the course-of-experience framework as a means of studying elite athletes' pre-reflective self-consciousness in the unfolding activity of performance optimization. We carried out a synthetic presentation of the ontological and epistemological foundation of this framework. Then we illustrated the methodology by an in-depth analysis of two elite windsurfers' courses of experience. The analysis of global and local characteristics of the riders' courses of experience reveal (a) the meaningful activities accompanying the experience of ongoing performance optimization; (b) the multidimensionality of attentional foci and the normativity of performance self-assessment; and (c) a micro-scale phenomenological description of continuous improvement. These results highlight the fruitfulness of the course-of-experience framework to describe the experience of being absorbed in an activity of performance optimization.

Comorbid Attention Deficit Hyperactivity Disorder in Women with Premenstrual Dysphoric Disorder.

Background: This study evaluated the associations between inattention, impulsivity, and attention deficit hyperactivity disorder (ADHD) in women with premenstrual dysphoric disorder (PMDD) across the menstrual cycle. Methods: This study enrolled 58 women with PMDD and 50 controls. Symptoms were assessed using the Attention and Performance Self-Assessment Scale and the Dickman Impulsivity Inventory during the pre-ovulatory (PO), mid-luteal (ML), and late luteal (LL) phases of the menstrual cycle. Results: The chi-square analysis revealed a significant association between ADHD and PMDD. Women with PMDD experienced a greater increase in scores of prospective everyday memory problems and difficulties maintaining focused attention from the PO phase to LL phase than the controls; in addition, they had higher scores in dysfunctional impulsivity during the LL phase than the controls. Among women in the PMDD group, those with ADHD had higher scores in prospective everyday memory problems and dysfunctional impulsivity during the PO and ML phases than those without ADHD. Women in the PMDD group without ADHD had a greater increase in scores of prospective everyday memory problems, difficulties maintaining focused attention, and dysfunctional impulsivity from the PO phase to the LL phase than the controls. Conclusion: Our study demonstrated that women with PMDD were more likely to have comorbid ADHD and higher levels of inattention across the menstrual cycle. PMDD was associated with increased impulsivity during the LL phase, independent of ADHD, but it was not associated with a persistent elevation of impulsivity. Furthermore, PMDD women with comorbid ADHD experienced higher inattention and impulsivity during the PO and ML phases than those without it. Thus, ADHD comorbidity should be assessed when assessing or intervening in the symptoms of inattention and impulsivity in women with PMDD.

SISTEM PENDUKUNG KEPUTUSAN PENILAIAN KINERJA DOSEN DI UNIVERSITAS JABAL GHAFUR MENGGUNAKAN METODE 360 DEGREE BERBASIS WEB

One of Jabal Ghafur University's missions related to the quality of lecturers is to improve the quality of lecturers and other educational staff in carrying out various educational, research and community service programs according to development needs. A system or application is needed to support the selection of the best lecturers at Jabal Ghafur university, one method that is suitable to be applied is a decision support system by applying the 360 Degree method. This method provides an objective and accurate assessment of lecturer performance through various assessment sources consisting of superiors, subordinates, colleagues and self- assessments. Performance appraisal is done to compare the results of self-assessment performance with the assessment of others. The result of performance appraisal using the 360 degree method is a gap between the assessments made by other people (bosses, colleagues and subordinates).

Feasibility of a quality-improvement program based on routinely collected health outcomes in Dutch primary care physical therapist practice: a mixed-methods study

BackgroundThis study evaluates the feasibility of a nine-month advanced quality-improvement program aimed at enhancing the quality of care provided by primary care physical therapists in the Netherlands. The evaluation is based on routinely collected health outcomes of patients with nonspecific low back pain, assessing three feasibility domains: (1) appropriateness, feasibility, and acceptability for quality-improvement purposes; (2) impact on clinical performance; and (3) impact on learning and behavioral change.MethodsA mixed-methods quality-improvement study using a concurrent triangulation design was conducted in primary care physical therapist practice. Feedback reports on the processes and outcomes of care, peer assessment, and self-assessment were used in a Plan-Do-Study-Act cycle based on self-selected goals. The program’s appropriateness, feasibility, and acceptability, as well as the impact on clinical performance, were evaluated using the Intervention Appropriate Measure, Feasibility Intervention Measure, Acceptability Intervention Measure (for these three measure, possible scores range from 4 to 20), and with a self-assessment of clinical performance (scored 0–10), respectively. The impact on learning and behavioral change was evaluated qualitatively with a directed content analysis.ResultsTen physical therapists from two practices participated in this study. They rated the program with a mean of 16.5 (SD 1.9) for appropriateness, 17.1 (SD 2.2) for feasibility, and 16.4 (SD 1.5) for acceptability. Participants gave their development in clinical performance a mean score of 6.7 (SD 1.8). Participants became aware of the potential value of using outcome data and gained insight into their own routines and motivations. They changed their data collection routines, implemented data in their routine practice, and explored the impact on their clinical behavior.ConclusionsThis explorative study demonstrated that a quality-improvement program, using health outcomes from a national registry, is judged to be feasible.Impact statementThis study provides preliminary evidence on how physical therapists may use health outcomes to improve their quality, which can be further used in initiatives to improve outcome-based care in primary physical therapy.

Analysis of driver behavior at grade-separated intersections to support design

Understanding driver behaviors in varied traffic scenarios is critical to the design of safe and efficient roadways and traffic control device. This research presents an analysis of driver cognitive workload, situation awareness (SA) and performance for three different scenarios, including a standard intersection and contraflow grade-separated intersections (C-GSI) and quadrant GSI (Q-GSI) with lane assignment sign manipulations. The study used a simulator-based driving experiment with application of the NASA Task Load Index and Situation Awareness Global Assessment Technique to assess the influence of the scenarios on driver behavioral responses. The findings reveal challenges for drivers navigating the C-GSI, characterized by diminished SA and elevated workload. These states were associated with behaviors such as delayed lane changes, missed opportunities for appropriate lane changes, heightened acceleration behavior within deceleration segments, and frequent speeding. In contrast, while drivers in the Q-GSI scenario faced elevated workloads, their SA remained steady, largely due to lane-specific signs facilitating early lane changes. Although the Q-GSI led to increased speed variability and slight increases in deceleration, the use of supplementary speed signage revealed a promising alternative to the S-intersection. Correlation analysis highlighted a significant relationship between mental workload and acceleration responses, indicating that increased acceleration was associated with higher mental workload. In addition, a significant negative correlation between driver perceived performance and absolute lane deviations indicated that drivers with higher self-assessed performance were more accurate in lane-keeping. The study underscores the need for GSIs and signage designs that support driver SA, manage cognitive workload to improve driver performance and increase road safety.

"DV Fatigue": Work Stress and Officers' Attitudes and Performance at Domestic and Family Violence Incidents.

A self-report instrument was created to measure stress, attitudes, and performance of domestic and family violence (DFV) first responders in an Australian state. DFV-related stress negatively impacted officers' attitudes and self-assessed performance. Higher DFV stress was predicted by the frequency and severity of DFV incidents, and the absence of lived experience. Negative attitudes were predicted by a shorter length of service and lower severity, and poorer performance by a longer length of service and lower perceived social support. Males reported higher stress and poorer performance than females. The findings reveal systemic issues that inhibit effective police response, emphasizing the need to address negative attitudes and "DV fatigue."

Gender differences in autonomy and performance assessments in a national cohort of vascular surgery trainees

ObjectiveGender disparities in surgical training and assessment are described in the general surgery literature. Assessment disparities have not been explored in vascular surgery. We sought to investigate gender disparities in operative assessment in a national cohort of vascular surgery integrated residents (VIRs) and fellows (VSFs). MethodsOperative performance and autonomy ratings from the Society for Improving Medical Professional Learning (SIMPL) application database were collected for all vascular surgery participating institutions from 2018 to 2023. Logistic generalized linear mixed models were conducted to examine the association of faculty and trainee gender on faculty and self-assessment of autonomy and performance. Data were adjusted for post-graduate year and case complexity. Random effects were included to account for clustering effects due to participant, program, and procedure. ResultsOne hundred three trainees (n = 63 VIRs; n = 40 VSFs; 63.1% men) and 99 faculty (73.7% men) from 17 institutions (n = 12 VIR and n = 13 VSF programs) contributed 4951 total assessments (44.4% by faculty, 55.6% by trainees) across 235 unique procedures. Faculty and trainee gender were not associated with faculty ratings of performance (faculty gender: odds ratio [OR], 0.78; 95% confidence interval [CI], 0.27-2.29; trainee gender: OR, 1.80; 95% CI, 0.76-0.43) or autonomy (faculty gender: OR, 0.99; 95% CI, 0.41-2.39; trainee gender: OR, 1.23; 95% CI, 0.62-2.45) of trainees. All trainees self-assessed at lower performance and autonomy ratings as compared with faculty assessments. However, women trainees rated themselves significantly lower than men for both autonomy (OR, 0.57; 95% CI, 0.43-0.74) and performance (OR, 0.40; 95% CI, 0.30-0.54). ConclusionsAlthough gender was not associated with differences in faculty assessment of performance or autonomy among vascular surgery trainees, women trainees perceive themselves as performing with lower competency and less autonomy than their male colleagues. These findings suggest utility for exploring gender differences in real-time feedback delivered to and received by trainees and targeted interventions to align trainee self-perception with actual operative performance and autonomy to optimize surgical skill acquisition.

Indoor Environmental Quality Effect Analysis in Green and Non-green Office Building to Staff’s Performance and Satisfaction in Surabaya

The energy efficiency in an office building can decrease the company’s operational cost. Even so, the operational cost for staff is still larger than the cost for energy. It is important to reassure that the impact given by the building’s indoor environmental quality (IEQ) is positive to staff. This research focusses on two office building in Surabaya, one of them is designed using the green principles and calculations, and the other is not. The building’s IEQ aspects being inspected includes indoor air quality, thermal, lighting, acoustics and layout. A questionnaire survey was held to obtain the reaction from the full time staff regarding the building’s IEQ performance, their satisfaction to it and their self-assessed performance. There are IEQ aspects that affects staff’s performance and satisfaction significantly. The IEQ mean score differs significantly in green and non-green building, but the mean difference in satisfaction and performance were found not significant.

The effects of positive visualization with and without sound on sleep actigraphy measures in a small sample of tinnitus patients

BackgroundTinnitus is a common oto-neurological disorder associated with sleep disturbances. This research explored visualization and visualization reinforced with nature sounds as an acute therapy for sleep disturbance in people with tinnitus.MethodsTwelve adults with bothersome tinnitus and sleep disturbances participated in a randomized cross-over design in which measurements of tinnitus perception (rating scales), anxiety/depression (Hospital Anxiety and Depression Scale), attention (Attention and Performance Self-Assessment), and sleep quality (sleep diary and actigraphy—automated estimates of total sleep time, sleep onset latency, sleep fragmentation, and wake after sleep onset) were undertaken at baseline and repeated with therapy. The visualization task was 30 min in duration and was performed every night before sleep. The visualization with sound reinforcement task added nature sounds played overnight.ResultsSleep onset latency analyzed using the sleep diary normalized actigraphy was significantly reduced with both interventions (visualization reduced by 60 min and visualization with sound reinforcement reduced by 70 min). None of the other sleep quality markers demonstrated a statistically significant change. Self-reported attention ability significantly improved with visualization. Of the participants, 90% were able to consistently complete actigraphy measures over the 3 weeks of the study, and 75% kept sleep diaries.ConclusionSleep onset time was reduced with visualization.

A meta-cognitive Wisconsin Card Sorting Test in people with schizophrenia and bipolar disorder: Self-assessment of sorting performance

People with serious mental illness have challenged self-awareness, including momentary monitoring of performance. A core feature of this challenge is in the domain of using external information to guide behavior, an ability that is measured very well by certain problem-solving tasks such as the Wisconsin Card Sorting Test (WCST) . We used a modified WCST to examine correct sorts and accuracy decisions regarding the correctness of sort. Participants with schizophrenia (n = 99) or bipolar disorder (n = 76) sorted 64 cards and then made judgments regarding correctness of each sort prior to feedback. Time series analyses examined the course of correct sorts and correct accuracy decisions by examining the momentary correlation and lagged correlation on the next sort. People with schizophrenia had fewer correct sorts, fewer categories, and fewer correct accuracy decisions (all p<.001). Positive response biases were seen in both groups. After an incorrect sort or accuracy decision, the groups were equally likely to be incorrect on the next sort or accuracy decision. Following correct accuracy decisions, participants with bipolar disorder were significantly (p=.003) more likely to produce a correct sort or accuracy decision. These data are consistent with previous studies implicating failures to consider external feedback for decision making. Interventions aimed at increasing consideration of external information during decision making have been developed and interventions targeting use of feedback during cognitive test performance are in development.

Job insecurity and job performance as the key research issues of the modern labor market

The analysis of the contemporary labour market requires consideration and multidimensional interpretation of the concept of "insecurity" in relation to employment and job retention, as well as changes in working circumstances. It points to correlations between the concept of uncertainty and work efficiency and time. This article aims to contribute to the understanding of the relationship between job insecurity and productivity by looking at two important research issues that have received relatively little empirical attention so far. An intra-individual model is presented here, combining job insecurity, understood as a more or less continuous and long-term stress factor, with work efficiency. It was pointed out that job insecurity changes over time, and employees achieve better professional results feeling confident in their future in the workplace. It presents the mechanisms underlying job insecurity and labour productivity. A thesis has been proposed according to which the relationship between job insecurity and self-assessment of work performance may be non-linear, or more precisely "U-shaped". According to this perspective, it has been suggested that job insecurity negatively affects work productivity by weakening occupational energy, the so-called vigor, enthusiasm for work. The article can be a starting point for further studies on the problem job insecurity.

NA CESTE ZA VÝNIMOČNOSŤOU: VÝZNAM AGILITY A SAMOHODNOTENIA V EFEKTÍVNEJ PREMENE PODNIKOV

Purpose of the article: The contribution aims to support the application of the self-assessment tool in companies, to help the development of services in practice with an emphasis on the effectiveness of the management of activities in increasing performance. It focuses on strategic agility in connection with quality and self-evaluation as a management tool in the context of effective transformation in the practice of excellence businesses. Methodology/methods: The paper, based on analyzes and practice, highlights the importance of using a self-assessment tool in small and medium-sized enterprises, while quality is recommended to be perceived as part of all processes and performance management at all levels. Scientific aim The main goal of the submitted artcile is to focus on selected determinants of excellence, i.e. strategic agility and self-assessment. The intention is to raise awareness of the importance of agility and the application of self-assessment as a tool in small and medium-sized enterprises with the aim of increasing the efficiency and quality of managing activities. The task is to identify barriers to adaptation to change and adaptability to the competitive environment, including pointing out the key principles of exceptional companies. Findings: In practice, there are various principles of management of business activities. The problem arises when managing changes in the competitive environment. Even large enterprises, like smaller enterprises, face challenges, but they use agility to successfully adapt to change, constantly develop and achieve exceptional results. It is recommended to focus on increasing the effectiveness of activity management using a self-assessment tool, which is based on the principles of quality management - a catalyst for continuous innovative development and a pillar of performance improvement. Conclusions (limits, implications etc.): The principles of quality management form the basis of the sustainable development of enterprises of various sizes. Performance evaluation is a key activity in improving the efficiency and quality of management of activities in exceptional enterprises. The purpose of the contribution is to highlight the benefit of self-assessment of performance as a separate tool even in smaller companies. The paper can be a starting point for professionals who want to participate in the development of smaller ponds in integrating aspects of performance and digitization of processes.

Formative assessments during COVID-19 pandemic: an observational study on performance and experiences of medical students

Background Because of COVID-19, the 2020 written medical examinations were replaced by mandatory formative online assessments. This study aimed to determine students’ performance, self-assessment of performance, and perception about the switch from a summative to a formative approach. Methods Medical students from year 2 to 5 (n=648) were included. They could repeat each test once or twice. They rated their performance after each attempt and were then given their score. Detailed feedback was given at the end of the session. An online survey determined medical students’ perception about the reorganization of education. Two items concerned the switch from summative to formative assessments Results Formative assessments involved 2385 examinees totaling 3197 attempts. Among examinees, 30.8% made at least 2 attempts. Scores increased significantly at the second attempt (median 9.4, IQR 10.8), and duration decreased (median -31.0, IQR 48.0). More than half of examinees (54.6%) underestimated their score, female students more often than male. Low performers overestimated, while high performers underestimated their scores. Students approved of the switch to formative assessments. Stress was lessened but motivation for learning decreased. Conclusions Medical students’ better scores at a second attempt support a benefit of detailed feedback, learning time and re-test opportunity on performance. Decreased learning motivation and a minority of students repeating the formative assessments point to the positive influence of summative assessment on learning.

The interconnection between evaluated and self-assessed performance in full flight simulator training

This study explores potential disparities between flight instructor evaluations and pilot self-assessments in the context of full flight simulator training. Evaluated performance was based on the Competency-based Training and Assessment framework, a recent development of competency-based education within aviation. Self-assessed performance is derived from survey responses and debriefing interviews. The simulator session involves eight multi-crew pilot training graduates and eight experienced flight captains, encompassing two tasks featuring sudden technical malfucntions during flight. The flight instructor’s evaluations reveal no significant differences in pilot performance. However, disparities become apparent when pilots engaged in reflecting their performance. Novice pilots, despite perceiving both tasks as easy, exhibited an overconfidence that led them to underestimate the inherent risks. Conversely, experienced pilots demonstrated greater caution towards the risks and engaged in discussing possible hazards. Furthermore, this study highlights the challenge of designing flight simulator training that incorporates surprise elements. Pilots tend to anticipate anomalies more readily in simulator training than during actual flights. Thus, this study underscores the importance of examining how pilots reflect on their performance, complementing the assessment of observable indicators and predefined competencies.

Traumatic brain injuries caused by knockout in Japanese amateur boxers: A questionnaire-based survey.

The aim of the present study is to conduct a trauma and disability survey in amateur boxers and show the actual conditions of injuries based on the current situations. We have obtained 663 valid responses from male and female boxers. In the questionnaire survey who was carried out on a Web questionnaire form. The questions involve that Face Sheet (gender, height, weight, athletic experience, etc.) and prepared 10 questions about trauma and impairment, 7 questions with concussion or damage on head. and, set 11 self-evaluations, which the boxers assessed their boxing skills. The subjects include amateur boxers who are all high school students (15 years old) and retired boxers. We had analyzed relation between the skills and the injuries. And, main outcome was that make a measure to setting whether or not questionnaires have been knockout (KO) as a variable, we applied a method of multiple logistic regression analysis. Moreover, as for the group who got KO in the past, we have also applied multiple regression analysis by using stepwise regression to factors affecting numbers of symptoms. The number of hits they experienced was smaller in international tournament matches, and the odds rate for KO was 0.669. And, KO experience group was compared with non-KO experience group, and the factors influencing the number of severity symptoms were examined. As a result, 2 factors were selected what "Seriousness in practice" and "Fighting spirit in games". It might be possible that the relation between the experience of being KO and self-assessment of boxing performance.

Immediate post performance judgements about cognitive performance in schizophrenia and bipolar disorder: associations with test performance and subjective overall judgments regarding abilities

ABSTRACT Introduction: The study explored associations between the accuracy of post assessment judgements of cognitive performance with global self-assessments of psychosocial functioning compared to evaluations generated by observers in schizophrenia and bipolar disorder. Methods: An abbreviated cognitive assessment based on the MATRICS Consensus Cognitive Battery was administered to 122 individuals with schizophrenia and 113 with bipolar disorder. They provided self-estimates of their performance after each subtest. In addition, self-reports on cognition, social cognition, and everyday functioning were collected and compared to observer ratings. Results: Both groups overestimated their cognitive function, but in bipolar disorder, there was 30% shared variance between task performance and self-rated task performance (vs. 5% in schizophrenia). Significant correlations were found between self-reported everyday outcomes and both actual and self-assessed performance. In schizophrenia, immediate judgements were only related to self-rated functioning, not to observer rated functioning. In bipolar disorder, impairments in self-assessment of performance correlated with observer ratings of cognitive ability, which was not observed in schizophrenia. Conclusions: While both groups showed correlations between cognitive performance and introspective accuracy, individuals with bipolar disorder showed higher accuracy in assessing their cognitive performance and other outcomes. Notably, impairments in introspective accuracy were associated with observer-rated functioning exclusively in bipolar disorder.

The Value of the Pediatric Urgent Care in Pediatric Resident Education.

Pediatric urgent care (UC) is a growing field and may provide unique learning opportunities for pediatric residents. We aimed to assess whether a UC rotation could be feasible and meaningful and help fill educational gaps. Within our current X+Y rotational model, we used Kern's 6-step approach for curriculum development to create a longitudinal UC educational experience for postgraduate year 2 (PGY2) pediatric residents. We assessed progress towardachieving our aim by using a mixed-methods approach matched to Kirkpatrick's levels of learning, including program annual evaluations, self-assessed UC competencies, and 360 milestone evaluations. A total of 14 PGY2s participated in our yearlong longitudinal rotation without duty hour violations or deviations from well childcare. Thematic analysis revealed concepts of autonomy, procedural access, and intentionality of education. Residents showed statistical improvement in 4/10 milestones and 26/27 self-assessed performance items. Of 14 residents, 6 scored ≥4 on all milestones by the end of the year. Our curriculum demonstrates a valuable role for the pediatric UC in the procedural and clinical education of pediatric residents. Practical implications and assessment tools of such a curriculum may be valuable for others interested in integrating this learning experience into their current educational model.

Investigating the ecological validity of second language writing assessment tasks

Nowadays, writing in academic settings is mediated by digital technology in essential ways, yet many writing test tasks deny access to the digital resources common to everyday practice (e.g., spell-check, electronic dictionaries). This discrepancy potentially threatens the ecological validity of such tasks and raises questions about construct (under) representation. Informed by an ecological perspective on language and communication (van Lier, 2004), a study was carried out to better understand how access to writing resources impacts writing test task performance. Twenty-two international students enrolled in a graduate program in the United States completed two argumentative writing tasks. On one of the tasks, participants were given full access to writing resources; on the other task, no access to writing resources was given. Average scores on participants' essays were analyzed quantitatively to determine the degree to which, and in what specific domains, performance differed under each condition. In addition, participants’ self-assessments of performance on the tasks were analyzed quantitatively and qualitatively. Results suggest that writers benefitted from having access to writing resources, but the perceived impact of resource accessibility differed from the scores given by raters. These findings have implications for writing test task design and may help inform L2 writing instruction.