Potential Hawthorne Effect Research Articles

Verification of using radar vital sign monitors in deception tests (2023)

This study examines the validity and accuracy of a typical radar-based vital signal monitoring system during spoken responses, a common and necessary scenario in deception tests. Traditional deception tests, such as polygraph tests, often involve testees wearing numerous electrodes, which can induce nervousness and affect their physiological measurements. Additionally, testers may be hindered by the potential Hawthorne effect caused by such varied measurements, while the movement and behavior of testees are typically restricted to ensure data validity. Based on the conclusive findings of this paper, practitioners can employ radar technology to non-invasively extract crucial vital signs during deception tests, ensuring validation. This approach enhances efficiency and affords greater flexibility to testers.

Early intervention for children with/at risk of developmental coordination disorder: a scoping review.

To summarize current evidence for early identification and motor-based intervention for children aged 5 years and younger of age with/at risk of developmental coordination disorder (DCD). Using scoping review methodology, we independently screened over 11 000 articles and selected those that met inclusion criteria. Of the 103 included articles, 78 articles were related to early identification and are summarized in a companion article. Twenty-two articles focused on early intervention, with an additional three articles covering both early identification and intervention. Most intervention studies were at a low level of evidence, but provide encouraging evidence that early intervention is beneficial for young children with/at risk of DCD. Direct intervention can be provided to whole classes, small groups, or individuals according to a tiers of service delivery model. Educating and building the capacity of parents and early childhood educators are also key elements of early intervention. Evidence for early intervention for children with/at risk of DCD is emerging with promising results. Further studies are needed to determine best practice for early intervention and whether intervening early can prevent the negative developmental trajectory and secondary psychosocial consequences associated with DCD.

Quality Assessment and Validation of a Direct Observation Hand Hygiene Program

<h3>Background</h3> Hand hygiene (HH) is a critical infection prevention practice to prevent transmission of microorganisms in healthcare settings. Direct overt HH observation programs provide opportunities for direct feedback, but face concerns over potential Hawthorne effect. We sought to compare our overt HH program to covert observations and perform quality assessments. <h3>Methods</h3> During May-July 2019, covert HH observations were conducted on inpatient units of healthcare personnel (HCP) in direct contact with patients and patient surroundings. An observer was trained to perform observations using the World Health Organization's Five Moments for HH. Electronic data collection included time, unit, HCP role, moments of HH and compliance. Quality metrics included duration of alcohol-based hand rub (ABHR), hand areas missed and compliance with nail policy. Observations included varying times and days covering all shifts and roles. Data was excluded if the observer was unable to fully visualize HH or if staff became aware of observations. Simultaneously, the institutional HH overt observations continued. <h3>Results</h3> During the study period, 189 covert observations were obtained, compared to 1826 overt observations on study units. We found no significant difference (p=0.217) between the rate of compliance of overt HH observations (99%, n=1804) and covert HH observations (95%, n=179). The majority of staff were nurses (77%). The median ABHR was 6 seconds (range: 2-15 seconds), with 10% of HCP completing the recommended 15 second hand rub. Most commonly missed areas (n=48) included the fingertips (65%, n=31) and between the fingers (65%, n=31). Staff were compliant with our nail policy (98%). <h3>Conclusions</h3> We describe the validation of a direct, overt HH program. The Hawthorne Effect did not make a statistically significant difference in compliance rates and HCP maintained high compliance (>95%) whether or not they knew they were observed. Quality metrics including appropriate duration of AHBR and coverage of hands were identified as opportunities for improvement.

LO56: Rate of delirium recognition by nurses and physicians in a cohort of 1584 older emergency department patients: how many would have been sent home?

Introduction: Unrecognized delirium in the ED remains common despite a 3 fold mortality increase for those discharged home. But previous studies have not assessed delirium recognition rate in a multicenter study nor assessed the management plans of ED staff when they fail to recognize delirium. Objectives: To document 1) the rate of delirium recognition by nurses and MDs in a national sample and 2) the intended management plans for patients with unrecognized delirium. Methods: This is a planned sub-study of a randomized clinical trial at 5 EDs in 4 provinces conducted in English and French. We included people ≥ 65 years old. We excluded those with an ED stay &lt; 4 hours, critical illness, visual impairment or from a nursing home. Research assistants (RAs) assessed delirium using the validated Confusion Assessment Method. RAs then asked ED nurses and physicians if the patient had delirium according to their clinical assessment. RAs also asked how confident they were that the patient could be safely discharged home using a 10 point Likert scale. We report proportions and 95% confidence intervals. RAs notified all ED staff of unrecognized CAM + ve patients prior to actual discharge for safety reasons. Results: We recruited 1584 older people; 1496 (92.5%) had complete data. Mean age was 76.5; 49% were female. Nurses performed 1465 delirium assessments. There were 76 CAM + ve patients in our sample (5.2%, 95% CI 4.2 to 6.5%). Nurses recognized delirium in 34/76 (44.7%, 95% CI: 33.3 to 56.6%). MDs assessed 20 CAM + ve patients and recognized the delirium in 10/20 (50.0%, 95% CI: 27.2 to 72.8). Nurses felt that 11/42 patients with unrecognized delirium could be discharged (26.2% 95% CI: 13.9 to 42.0%). Their median confidence in the safety of their plan was 7.0/10. MDs felt that 2/10 patients with unrecognized delirium could be discharged (20.0% 95% CI: 2.5 to 55.0%). Their median confidence in the safety of their plan was 7.5/10. Conclusion: Despite the potential Hawthorne effect raising initial delirium recognition rates above clinicians’ usual practice outside of a study, delirium recognition by both nurses and MDs remains poor in a national sample of ED patients. We also showed that a significant number of these patients could have been discharged with unrecognized delirium. Further research to find novel ways to improve delirium recognition is needed.

Practice transformations to optimize the delivery of HIV primary care in community healthcare settings in the United States: A program implementation study.

BackgroundThe United States HIV care workforce is shrinking, which could complicate service delivery to people living with HIV (PLWH). In this study, we examined the impact of practice transformations, defined as efficiencies in structures and delivery of care, on demonstration project sites within the Workforce Capacity Building Initiative, a Health Resources and Services Administration (HRSA) Ryan White HIV/AIDS Program Special Projects of National Significance (SPNS).Methods and findingsData were collected at 14 demonstration project sites in 7 states and the District of Columbia. Organizational assessments were completed at sites once before and 4 times after implementation. They captured 3 transformation approaches: maximizing the HIV care workforce (efforts to increase the number of existing healthcare workforce members involved in the care of PLWH), share-the-care (team-based care giving more responsibility to midlevel providers and staff), and enhancing client engagement in primary HIV care to reduce emergency and inpatient care (e.g., care coordination). We also obtained Ryan White HIV/AIDS Program Services Reports (RSRs) from sites for calendar years (CYs) 2014–2016, corresponding to before, during, and after transformation. The RSR include data on client retention in HIV care, prescription of antiretroviral therapy (ART), and viral suppression. We used generalized estimating equation (GEE) models to analyze changes among sites implementing each practice transformation approach. The demonstration projects had a mean of 18.5 prescribing providers (SD = 23.5). They reported data on more than 13,500 clients per year (mean = 969/site, SD = 1,351). Demographic characteristics remained similar over time. In 2014, a majority of clients were male (71% versus 28% female and 0.2% transgender), with a mean age of 47 (interquartile range [IQR] 37–54). Racial/ethnic characteristics (48% African American, 31% Hispanic/Latino, 14% white) and HIV risk varied (31% men who have sex with men; 31% heterosexual men and women; 7% injection drug use). A substantial minority was on Medicaid (41%). Across sites, there was significant uptake in practices consistent with maximizing the HIV care workforce (18% increase, p < 0.001), share-the-care (25% increase, p < 0.001), and facilitating patient engagement in HIV primary care (13% increase, p < 0.001). There were also significant improvements over time in retention in HIV care (adjusted odds ratio [aOR] = 1.03; 95% confidence interval [CI] 1.02–1.04; p < 0.001), ART prescription levels (aOR = 1.01; 95% CI 1.00–1.01; p < 0.001), and viral suppression (aOR = 1.03; 95% CI 1.02–1.04; p < 0.001). All outcomes improved at sites that implemented transformations to maximize the HIV care workforce or improve client engagement. At sites that implemented share-the-care practices, only retention in care and viral suppression outcomes improved. Study limitations included use of demonstration project sites funded by the Ryan White HIV/AIDS Program (RWHAP), which tend to have better HIV outcomes than other US clinics; varying practice transformation designs; lack of a true control condition; and a potential Hawthorne effect because site teams were aware of the evaluation.ConclusionsIn this study, we found that practice transformations are a potential strategy for addressing anticipated workforce challenges among those providing care to PLWH. They hold the promise of optimizing the use of personnel and ensuring the delivery of care to all in need while potentially enhancing HIV care continuum outcomes.

Effect of investigator observation on gait parameters in individuals with stroke

Improvements in gait speed following various training paradigms applied to patients post-stroke does not always lead to changes in walking performance, defined as gains in daily stepping activity. We hypothesized that testing conditions, specifically the presence of an observer, influences patient behaviors and resultant outcomes may overestimate their true walking capacity. This potential Hawthorne effect on spatiotemporal and biomechanical measures of locomotor function in individuals post-stroke has not been assessed previously.Fifteen ambulatory individuals with chronic stroke wore instrumented insoles and performed two separate normal-pace walking assessments, including unobserved conditions during which participants were unattended and unaware of data collection, and observed conditions with an investigator present. Gait analysis was conducted outside of a laboratory setting using instrumented insoles equipped with a 3D accelerometer and pressure sensors which captured the spatiotemporal kinematics, vertical ground reaction forces and foot acceleration. Data were compared using paired comparisons, with subsequent correlation and stepwise regression analyses to explore potential associations between Hawthorne-induced changes in walking strategies, gait speed and locomotor performance (daily stepping).Except for cadence, other measures of spatiotemporal parameters and swing kinematics (acceleration) were not significantly different between observed vs unobserved conditions. However, analyses of ground reaction forces revealed significantly greater paretic limb loading (Δ1st peak = 1.5 ± 1.6 N/kg Δ2nd peak = 1.4 ± 1.8 N/kg; p < 0.01) and increases in weight bearing symmetry (11–24%, p < 0.01) during observed vs unobserved conditions. This potential Hawthorne effect was greater in those with slower walking speeds and shorter stride lengths but was not related to daily stepping.The present findings suggest that biomechanical parameters of walking function may be related to the presence of an observer and highlight the need to separately measure locomotor capacity (gait speed) and performance (daily stepping).

Prospective Evaluation of a Blood Transfusion Protocol for Patients Undergoing Cardiac Operations

The Society of Thoracic Surgeons clinical practice guidelines recommend the creation of an interdisciplinary blood management team to implement protocols for improved blood transfusion practices. We report our center's prospective evaluation of a blood transfusion protocol. An interdisciplinary blood management team developed protocols for transfusion of packed red blood cells, fresh frozen plasma, platelets, and cryoprecipitate. The protocols were prospectively evaluated by tracking transfusions administered to consecutive patients undergoing cardiac operations, and the primary outcome of interest was the mean number of adjusted units of blood product transfused per patient. Protocol implementation phases were separated by washout phases to control for a potential Hawthorne effect associated with protocol implementation. Protocol compliance was also assessed. A total of 1441 patients underwent cardiac operations during the 16-month study period. Although there was no statistically significant reduction in transfusions with an unadjusted analysis, there was a significant trend toward a reduction of the mean adjusted total units transfused per patient over the course of the study period (P < .001). The mean adjusted total units transfused per patient were significantly less during the second washout phase (2.8 units; 95% confidence interval [CI], 2.3-3.3) and second protocol phase (2.8 units; 95% CI, 2.32-3.27) compared with the initial baseline survey phase (3.6 units, 95% CI, 3.1-4.1; P < .05 for both comparisons). Only 55.2% of all units were transfused in compliance to the implemented protocols: platelets, 46.8%; cryoprecipitate, 32.1%; packed red blood cells, 60.7%; and fresh frozen plasma, 53.6%. During a prospective evaluation of blood transfusion protocols, a risk-adjusted analysis demonstrated a reduction in transfusions despite poor protocol compliance.

Improving Quality of Care for Maternal and Newborn Health: Prospective Pilot Study of the WHO Safe Childbirth Checklist Program

BackgroundMost maternal deaths, intrapartum-related stillbirths, and newborn deaths in low income countries are preventable but simple, effective methods for improving safety in institutional births have not been devised. Checklist-based interventions aid management of complex or neglected tasks and have been shown to reduce harm in healthcare. We hypothesized that implementation of the WHO Safe Childbirth Checklist program, a novel childbirth safety program for institutional births incorporating a 29-item checklist, would increase delivery of essential childbirth practices linked with improved maternal and perinatal health outcomes.Methods and FindingsA pilot, pre-post-intervention study was conducted in a sub-district level birth center in Karnataka, India between July and December 2010. We prospectively observed health workers that attended to women and newborns during 499 consecutively enrolled birth events and compared these with observed practices during 795 consecutively enrolled birth events after the introduction of the WHO Safe Childbirth Checklist program. Twenty-nine essential practices that target the major causes of childbirth-related mortality, such as hand hygiene and uterotonic administration, were evaluated. The primary end point was the average rate of successful delivery of essential childbirth practices by health workers. Delivery of essential childbirth-related care practices at each birth event increased from an average of 10 of 29 practices at baseline (95%CI 9.4, 10.1) to an average of 25 of 29 practices afterwards (95%CI 24.6, 25.3; p<0.001). There was significant improvement in the delivery of 28 out of 29 individual practices. No adverse outcomes relating to the intervention occurred. Study limitations are the pre-post design, potential Hawthorne effect, and focus on processes of care versus health outcomes.ConclusionsIntroduction of the WHO Safe Childbirth Checklist program markedly improved delivery of essential safety practices by health workers. Future study will determine if this program can be implemented at scale and improve health outcomes.

The effect of different cardiovascular risk presentation formats on intentions, understanding and emotional affect: a randomised controlled trial using a web-based risk formatter (protocol)

BackgroundThe future risk of heart disease can be predicted with increasing precision. However, more research is needed into how this risk is conveyed and presented. The aim of this study is to compare the effects of presenting cardiovascular risk in different formats on individuals' intention to change behaviour to reduce risk, understanding of risk information and emotional affect.Methods/designA randomised controlled trial comprising four arms, with a between subjects design will be performed. There will be two intervention groups and two control groups. The first control comprises a pre-intervention questionnaire and presents risk in a bar graph format. The second control presents risk in a bar graph format without pre-intervention questionnaire. These two control groups are to account for the potential Hawthorne effect of thinking about cardiovascular risk before viewing actual risk. The two intervention groups comprise presenting risk in either a pictogram or metonym format (image depicting seriousness of having a myocardial infarction). 800 individuals' aged between 45 and 64 years, who have not been previously diagnosed with heart disease and have access to a computer with internet, will be given a link to a website comprising a risk calculator and electronic questionnaires. 10-year risk of having a coronary heart disease event will be assessed and presented in one of the three formats. A post-intervention questionnaire will be completed after viewing the risk format. Main outcome measures are (i) intention to change behaviour, (ii) understanding of risk information, (iii) emotional affect and (iv) worry about future heart disease. Secondary outcomes are the sub-components of the theory of planned behaviour: attitudes, perceived behavioural control and subjective norms.DiscussionHaving reviewed the literature, we are not aware of any other studies which have used the assessment of actual risk, in a trial to compare different graphical cardiovascular risk presentation formats. This trial will provide data about which graphical cardiovascular risk presentation format is most effective in encouraging behaviour change to reduce cardiovascular risk.Trial registrationCurrent Controlled Trials ISRCTN91319318

The cost of community-managed viral respiratory illnesses in a cohort of healthy preschool-aged children

BackgroundAcute respiratory illnesses (ARIs) during childhood are often caused by respiratory viruses, result in significant morbidity, and have associated costs for families and society. Despite their ubiquity, there is a lack of interdisciplinary epidemiologic and economic research that has collected primary impact data, particularly associated with indirect costs, from families during ARIs in children.MethodsWe conducted a 12-month cohort study in 234 preschool children with impact diary recording and PCR testing of nose-throat swabs for viruses during an ARI. We used applied values to estimate a virus-specific mean cost of ARIs.ResultsImpact diaries were available for 72% (523/725) of community-managed illnesses between January 2003 and January 2004. The mean cost of ARIs was AU$309 (95% confidence interval $263 to $354). Influenza illnesses had a mean cost of $904, compared with RSV, $304, the next most expensive single-virus illness, although confidence intervals overlapped. Mean carer time away from usual activity per day was two hours for influenza ARIs and between 30 and 45 minutes for all other ARI categories.ConclusionFrom a societal perspective, community-managed ARIs are a significant cost burden on families and society. The point estimate of the mean cost of community-managed influenza illnesses in healthy preschool aged children is three times greater than those illnesses caused by RSV and other respiratory viruses. Indirect costs, particularly carer time away from usual activity, are the key cost drivers for ARIs in children. The use of parent-collected specimens may enhance ARI surveillance and reduce any potential Hawthorne effect caused by compliance with study procedures. These findings reinforce the need for further integrated epidemiologic and economic research of ARIs in children to allow for comprehensive cost-effectiveness assessments of preventive and therapeutic options.

A comparison of self-reported and observational work sampling techniques for measuring time in nursing tasks

To compare self-reported and observational work sampling techniques when applied to ward-based nurses. A self-reported work sampling study was undertaken with nine registered nurses in an Australian teaching hospital over 8.5 weeks, followed by an observational work sampling study conducted over 4.5 weeks. Both studies used a random reminder method and a multidimensional work task classification. Field notes were also recorded and analysed. 3910 data points were collected, 667 during the self-report study and 3243 in the observational study. The two techniques yielded significant differences in work patterns of registered nurses. The observational study showed that compared with the self-reported study, patient care (40% versus 33%, P <0.000) and ward-related activities (7% versus 3%; P <0.001) were recorded significantly more frequently, and documentation less frequently (8% versus 19%; P <0.000). Both the techniques generated similar proportions of time spent in breaks (12%), medication tasks (13%) and clinical discussion (15%). The self-report technique was poorly accepted by nursing staff. The observational technique was well accepted and data collection was more effcient. The self-report work sampling technique is not a reliable method for obtaining an accurate reflection of the work tasks of ward-based nurses. The observational technique was preferred by nurses, and despite concern regarding a potential Hawthorne effect, this was not substantiated.

Sensory Integration Therapy with Learning Disabled Children: A Critical Review

This paper is a reaction to the profound impact which sensory integration theory has had on theory and practice in occupational therapy. Five key outcome studies employing sensory integration therapy with learning disabled children are critically reviewed. In four of the five studies, the possibility of Type I error, destroying their internal validity, is strongly suggested as a result of inadequate sampling and matching procedures; lack of definition of the subject population; potential Hawthorne effect; the use of gain scores; possibility of tester bias; and absence of relevant information regarding reliability and validity of measures and levels of significance. In one of the studies, the possibility of a Type II error is evident because of unequal samples and the considerable variability among subjects indicated by the data. It is concluded that at least some of the research to date is fraught with serious methodological errors and that there is the need for controlled, systematic investigation of sensory integrative therapy.