Validity Of Evaluation Method Research Articles

Culturally Competent Care Pedagogy: What Works?

In its 2002 publication Unequal Treatment: Confronting Racial and Ethnic Disparities in Health Care, the Institute of Medicine reported American racial and ethnic minorities receive lower-quality health care than white Americans. Because caregiver bias may contribute to disparate health care, the Liaison Committee on Medical Education and the Accreditation Council for Graduate Medical Education have issued specific directives to address culturally competent care education. We discuss the general approaches to culturally competent care education, the tools used in evaluating such endeavors, and the impact of such endeavors on caregivers and/or the outcomes of therapeutic interventions from three perspectives: (1) Where are we now? (2) Where do we need to go? (3) How do we get there? We summarized information from (1) articles identified in a PubMed search of relevant terms and (2) the authors' experience in delivering, evaluating, and promoting culturally competent care education. WHERE ARE WE NOW?: Considerable variation exists in approaches to culturally competent care education; specific guidelines and valid evaluation methods are lacking; and while existing education programs may promote changes in providers' knowledge and attitudes, there is little empirical evidence that such efforts reduce indicators of disparate care. WHERE DO WE NEED TO GO?: We must develop evidence-based educational strategies that produce changes in caregiver attitudes and behaviors and, ultimately, reduction in healthcare disparities. HOW DO WE GET THERE?: We must have ongoing dialog about, development in, and focused research on specific educational and evaluation methodologies, while simultaneously addressing the economic, political, practical, and social barriers to the delivery of culturally competent care education.

A Qualitative Assessment of the Knowledge of Fruit and Vegetable Health Benefits among Preschoolers

Obesity in children has become an increasing issue in the United States. Dietary habits are developed through exposure and most children do not meet the recommended guidelines for fruits and vegetable intake; 42% of 2 year olds and 50% of 5 year olds consumes less than 2 servings per day. Research concerning the knowledge of the health benefits of fruits and vegetables among preschool children is limited. The purpose of this qualitative study was to establish baseline data on what preschool children know about the health benefits of fruits and vegetables through the use of cognitive interviews. A small sample of children 3–5 years of age from low‐income families, were chosen to participate in the study. Children were asked three open‐ended questions to analyze their knowledge of health benefits related to eating fruits and vegetables. Responses were recorded and coded for interpretation of the data. Information obtained from the cognitive interviews will be used to develop a practical, reliable, and valid method for evaluation of fruit and vegetable knowledge among preschool aged children.

A fast test technique for life time estimation of ultrasonically welded Cu–Cu interconnects

In this research the quality of the interconnects of the ultrasonically welded Cu terminals to the Cu substrate in the IGBT-module has been investigated. An ultrasonic resonance fatigue system in combination with a laser Doppler vibrometer and a special specimen design was used for shear fatigue testing of these large ultrasonic Cu–Cu welds (about 0.5 cm 2). Fatigue life curves up to 10 9 loading cycles were obtained in a very short period of time. Using this technique it was possible to evaluate the fatigue strength of these interconnects for the first time. The microstructural features of the interconnects were characterized and their crack growth behaviour was studied. Fracture analysis of the fatigued specimen shows that failure occur due to the propagation of the crack beneath the welding interface into the copper substrate. Additionally performed finite element simulations offer an insight into the stress and strain concentrations during the mechanical fatigue tests. As this method is not restricted to the welding geometry, material joints with larger interconnects can be tested likewise. Thus this new technique can be used as a practical and valid fatigue testing method for evaluation of various interconnects.

The impact of morphology on light transport in cancellous bone

In recent years, optical techniques based on diffusion approximation have demonstrated their ability to gain rich spectral information about bone. However, these methods normally assume homogeneity, while cancellous bone and marrow form a highly heterogeneous two-phase medium. This paper studies the limitations of this assumption, and quantifies the role of microstructure on long-range transport properties. The propagation of light pulses through trabecular bone is calculated by Monte Carlo simulation of the scattering and absorption in reconstructions of bone samples obtained from x-ray micro tomographic scans. The time-resolved responses are then fitted with the analytical response of a homogeneous material to obtain the apparent transport properties. These properties are used to test different homogenization equations that have been postulated in the past for heterogeneous tissues and to check their accuracy. The results show that nonlinearity and crosstalk between absorption and scattering are statistically significant, although their impact is relatively small. More importantly, we found that the weight of the components is not only affected by their volume fractions, but need to be corrected by other morphologic measures like trabecular spacing or connectivity density. These deviations from the homogeneous assumption are stronger for scattering than for absorption. In conclusion, the average optical properties of cancellous bone are strongly determined by its microstructure, meaning that optical techniques are a valid method for tissue evaluation, but careful consideration of structure-related perturbation sources is required.

S26– How to develop new methods for systematic evaluation of internal validity of CPG recommendations

S26– How to develop new methods for systematic evaluation of internal validity of CPG recommendations

Evaluating municipal websites: A methodological comparison of three think-aloud variants

Usability methods have received relatively little methodological attention within the field of E-Government. This paper aims to address this gap by reporting on a usability test of the municipal website of Deventer (the Netherlands), carried out by means of three variants of the think-aloud method (concurrent/retrospective think-aloud protocols and constructive interaction). These three methods had proved successful in a previous evaluation of a different municipal website, yet we decided to replicate our study in order to investigate whether the three methods would reveal different results when applied to another municipal website with a different information architecture. The results of our study showed that, as in the previous municipal website evaluation, the three evaluation methods were largely comparable in terms of output. Nevertheless, we did find a number of differences between the present and previous municipal website evaluation regarding the workings of the three methods—differences that could be explained by the different information architectures of the municipal websites tested. This suggests that the three evaluation methods might indeed work differently depending on the nature of the website that is being evaluated, and calls for more research into the effect of task type on the validity of evaluation methods.

Measurement of forelimb function by digital video motion analysis in rat nerve transection models

The object of this study was to demonstrate that digital video motion analysis is a quantitative, valid, and reproducible method for evaluation of function in the rat model of forelimb nerve transection and repair. Median, ulnar, and radial nerves were transected and directly repaired in 220 g Sprague-Dawley rats. Normal rats and sham-operated rats served as controls (six rats in each group). Two-dimensional (2D) digital video motion analysis was used to capture the gait cycle and quantify joint movement and changes in toe spread. Recordings were made preoperatively and at 1, 4, 8, 12, and 16 weeks postoperatively. Wrist and metacarpophalangeal (MP) joint extension decreased after radial nerve injury, and wrist and MP joint flexion decreased after combined median and ulnar nerve injury or injury to the median nerve only. Toe spread decreased after combined median and ulnar nerve injury and after radial nerve injury. Median or ulnar nerve injury alone did not lead to a significant change in toe spread. 2D digital video motion analysis can be used to quantify movement of the wrist and the MP joint in rats. It is a valid method to evaluate functional deficit and recovery after nerve injury and repair in the forelimb.

QUANTITATIVE EVALUATION OF ESCAPE SAFETY IN BUILDINGS CONSIDERING DECREASE OF RELIABILITY BY ESCAPE BARRIER

The aim of this study is to develop an evaluation method which considers the escape distance and the escape barrier such as doors. The results of this study are as follows;1. The validity of evaluation method was ascertained by applying it to a simple network model2. Realistic path choice rules are proposed which exclude improvable escape routes. It can also reduce calculation time drastically.3. The evaluation model is applied to the network model in a real hospital ward plan with balconies and two fire compartments for horizontal escape, and proper results were obtained.

Prognostic Implication of the Left Atrial Appendage Mechanical Reserve After Cardioversion of Atrial Fibrillation

This study aimed to demonstrate the long-term prognostic implication of left atrial appendage (LAA) mechanical reserve determined after electrical cardioversion (CV) of atrial fibrillation (AF). 53 successfully cardioverted chronic AF patients were studied (M/F =40/13, mean age =59+/-3). LAA emptying velocity (LAAEV) and filling velocity (LAAFV) were measured using transesophageal echocardiography (TEE) before cardioversion, immediately after CV, and with isoproterenol infusion. TEE was done at baseline, 1 month, 3-6 months, and 1 year after CV. At 1-year follow-up, 27 patients remained in sinus rhythm (SR, Group 1) and 26 patients showed AF recurrence (Group 2). Baseline clinical and echocardiographic findings were similar between the 2 groups. Immediately after CV, LAAEV and LAAFV decreased similarly in both groups. With isoproterenol infusion, the increase of LAAEV was greater in group 1 than in group 2. Multivariate analysis revealed that the peak increase of LAAEV after isoproterenol infusion was an independent predictor for SR maintenance (odds ratio 1.044, 95% confidence interval 1.014 to 1.075; p=0.0033). Prediction model consisting of the peak increase of LAAEV (>34.4 cm/s) and E/A ratio immediately after CV (<2.5) showed a good predictability for SR maintenance (correct ratio 69.8%). This study presents a valid evaluation method for LAA mechanical reserve and demonstrated that LAA mechanical reserve is responsible for the maintenance of SR.

Can a faked cystometry deceive patients in their perception of filling sensations? A study on the reliability of spontaneously reported cystometric filling sensations in patients with non‐neurogenic lower urinary tract dysfunction

To evaluate the reliability of spontaneously reported bladder sensations during real and faked cystometry in patients with non-neurogenic lower urinary tract dysfunction. Fifty-nine patients with non-neurogenic lower urinary tract dysfunction were submitted to a real and faked filling cystometry and were asked to describe all bladder-related sensations they experienced during the investigations. All patients were told that the bladder had to be filled twice, but during the faked cystometry, no water was infused in the bladder. During the real cystometry, the normal pattern of filling sensation was reported by 88%. During the faked cystometry, none of the patients reported the normal pattern of filling sensations. Five patients reported first sensation of filling, one first desire to void (FDV). None of the patients reported a strong desire to void (SDV) during the faked cystometry. Asking patients with a non-neurogenic lower urinary tract dysfunction to report on the bladder filling sensations during cystometry is a valid method for sensory evaluation. A minority of patients may report some sensation of bladder filling even without actual bladder filling. Memory and habituation may play a role in the perception of bladder sensation and one should be aware of this. However, reporting some sensation during faked cystometry not necessarily means the evaluation of the perception of bladder filling is unreliable.

Introduction and comparison of two methods of assessment of coronary lesions in Atlantic salmon, Salmo salar L.

This study investigated and compared quantitative and semi-quantitative coronary lesion evaluation in Atlantic salmon, Salmo salar. A total of 121 immature farmed and 47 sexually mature wild Atlantic salmon were included. Coronary arteries from all fish were morphometrically evaluated using a semi-quantitative method. A subsample of 76 salmon was additionally evaluated using a quantitative method. Another subsample of 71 salmon was used for reliability testing of the semi-quantitative method. Ten cross-sections of coronary arteries located on the ventral surface of the bulbus arteriosus were semi-quantitatively scored with regard to myointimal coronary lesions. Quantitative measurements comprised maximal intimal thickness and area lesion (%) while semi-quantitative measurements comprised maximal intimal thickness and lesion degree (%). Scores for individual fish were expressed as the average of lesion score, denoted as mean range lesion. One person performed all evaluations blindly. Two pathologists tested repeatability of the semi-quantitative lesion score measurements blindly. Both semi-quantitative and quantitative variables increased significantly with increasing lesion score. Semi-quantitative estimation gave significantly higher maximal intimal thickness values than quantitative measurement. Semi-quantitative measurements were found to explain 63.2% of variation in quantitatively measured maximal intimal thickness. Due to lack of agreement, the two methods are not directly comparable and one method cannot replace the other. Repeatability within and between observers with regard to semi-quantitative classification was very good with Kappa values larger than 61.5%. The semi-quantitative method was a valid and reliable method for coronary lesion evaluation in Atlantic salmon.

Evaluation of Reflux Condensation Heat Transfer of Steam-Air Mixtures under Gas-Liquid Countercurrent Flow in a Vertical Tube

Reflux condensation in steam generator (SG) is one of the major heat removal mechanisms in a loss of residual heat removal (RHR) system event in mid-loop operation during a pressurized water reactor (PWR) plant outage. In order to evaluate the effectiveness of reflux condensation in SG U-tubes, the condensation heat transfer characteristics in the presence of a non-condensable gas must be clarified. Local temperature data were previously measured for steam-air mixtures under gas-liquid countercurrent flow, in a vertical tube of inner diameter 19.3 mm. In this study, local reflux heat transfer coefficients were calculated by evaluating steam flow rate profile along the tube at low heat fluxes assuming saturated steam conditions and empirical correlations were derived. The correlations are valid over a range 2–9,000W/m2-K for 0.1–0.4MPa, 0.014–0.2 air mass fraction. The axial distributions of the steam—air mixture temperatures calculated using the correlation agreed well with the measured results and validity of evaluation methods and the correlation were verified.

Evaluation of Reflux Condensation Heat Transfer of Steam-Air Mixtures under Gas-Liquid Countercurrent Flow in a Vertical Tube

Reflux condensation in steam generator (SG) is one of the major heat removal mechanisms in a loss of residual heat removal (RHR) system event in mid-loop operation during a pressurized water reactor (PWR) plant outage. In order to evaluate the effectiveness of reflux condensation in SG U-tubes, the condensation heat transfer characteristics in the presence of a non-condensable gas must be clarified. Local temperature data were previously measured for steam-air mixtures under gas-liquid countercurrent flow, in a vertical tube of inner diameter 19.3 mm. In this study, local reflux heat transfer coefficients were calculated by evaluating steam flow rate profile along the tube at low heat fluxes assuming saturated steam conditions and empirical correlations were derived. The correlations are valid over a range 2–9,000W/m2-K for 0.1–0.4MPa, 0.014–0.2 air mass fraction. The axial distributions of the steam—air mixture temperatures calculated using the correlation agreed well with the measured results and validity of evaluation methods and the correlation were verified.

430 圧力容器貫通部の残留応力評価手法の検証(OS3-7 SCC・残留応力,OS3 エネルギー構造機器の健全性評価と信頼性の高度化3)

430 圧力容器貫通部の残留応力評価手法の検証(OS3-7 SCC・残留応力,OS3 エネルギー構造機器の健全性評価と信頼性の高度化3)

Determination of enzyme/substrate specificity constants using a multiple substrate ESI-MS assay

The traditional method used to investigate the reaction specificity of an enzyme with different substrates is to perform individual kinetic measurements. In this case, a series of varied concentrations are required to study each substrate and a non-regression analysis program is used several times to obtain all the specificity constants for comparison. To avoid the large amount of experimental materials, long analysis time, and redundant data processing procedures involved in the traditional method, we have developed a novel strategy for rapid determination of enzyme substrate specificity using one reaction system containing multiple competing substrates. In this multiplex assay method, the electrospray ionization mass spectrometry (ESI-MS) technique was used for simultaneous quantification of multiple products and a steady-state kinetics model was established for efficient specificity constant calculation. The system investigated was the bacterial sulfotransferase NodH (NodST), which is a host specific nod gene product that catalyzes the sulfate group transfer from 3′-phosphoadenosine 5′-phosphosulfate (PAPS) to natural Nod factors or synthetic chitooligosaccharides. Herein, the reaction specificity of NodST for four chitooligosaccharide acceptor substrates of different chain length (chitobiose, chitotriose, chitotetraose, and chitopentaose) was determined by both individual kinetic measurements and the new multiplex ESI-MS assay. The results obtained from the two methods were compared and found to be consistent. The multiplex ESI-MS assay is an accurate and valid method for substrate specificity evaluation, in which multiple substrates can be evaluated in one assay.

Analytic assessment of multiple-choice tests

Background : Multiple choice tests (MCT),are widely known and applied as useful evaluation tests in the field of education especially in Medical Science. Items on a multiple-choice test consist of a stem, which is followed by a correct answer as well as three to jour distracters. Items on a well-written multiple-choice test will have stems that are precise and clear, one answer that is clearly correct or best, and distracters that are plausible. Purpose : The purpose of the present study is conducting item and test analysis to 24 MCTs given in first semester of 2000-2001 educational year in medical faculty of Mashad University of Medical Science. Methods : Data of this descriptive study were composed of 1496 MCQs gathered from 2092 answer sheets of 24 MCTs obtained from educational department of the medical faculty.A split-half method of reliability was employed to calculate reliability coefficient for MCTs. Items Difficulty and Discrimination index also were calculated for questions. Further studies should be undertaken for developments the methods for evaluation of validity, assessment of distracters and structural principles in MCTs . Results : Mean reliability coefficient of the exams was 0.72±0.13 and In more than 50% of cases, reliability coefficient was greater than 0.7. There was a significant difference between basic science exams and clinical clerkship exams in Reliability coefficient (P=0.001). Mean standard error a/measurement (SEM) was 3.51±1.11. In 52.2% of the cases, difficulty of MCQs was inappropriate and 49.3% of questions had inadequate discriminative power to discern between poor students and good students. Conclusion : Our finding indicate that only 33% of studied MCQs have desirable or acceptable item difficulty and discrimination indices both and 34.9% of those have no desirable or acceptable item difficulty neither acceptable discrimination index. Having subjects respond reliably on a measure is a great sta11, but there is another concept needed to gel down really well named validity. Keywords : multiple choice question, test analysis, reliability, item difficulty Discrimination index

Longitudinal Construct Validity

Although widely used and reported in research for the evaluation of groups, measures of health status and health-related quality of life have had little application in clinical practice for the assessment of individual patients. One of the principal barriers is the demonstration that these measures add clinically significant information to measures of function or symptoms alone. Here, we review the methods for evaluation of construct validity in longitudinal studies and make recommendations for nomenclature, reporting of study results, and future research agenda. Analytical review. The terms "sensitivity" and "responsiveness" have been used interchangeably, and there are few studies that evaluate the extent to which health status or health-related quality-of life measures capture clinically important changes ("responsiveness"). Current methods of evaluating responsiveness are not standardized or evaluated. Approaches for the assessment of a clinically significant or meaningful change are described; rather than normative information, however, standardized transition questions are proposed. They would be reported routinely and as separate axes of description to capture individual perceptions. Research in methods to assess the subject's evaluation of the importance and magnitude of a measured change are critical if health status and health-related quality-of-life measures are to have an impact on patient care.

Toward a document evaluation methodology: what does research tell us about the validity and reliability of evaluation methods?

Although the usefulness of evaluating documents has become generally accepted among communication professionals, the supporting research that puts evaluation practices empirically to the test is only beginning to emerge. This article presents an overview of the available research on troubleshooting evaluation methods. Four lines of research are distinguished concerning the validity of evaluation methods, sample composition, sample size, and the implementation of evaluation results during revision.

Central precocious puberty in girls: Internal genitalia before, during, and after treatment with long-acting gonadotropin-releasing hormone analogues

Pelvic ultrasonography was systematically performed on 33 girls with idiopathic central precocious puberty to investigate the impact of treatment with gonadotropin-releasing hormone analogues on female internal genitalia. All girls were treated with a long-acting gonadotropin-releasing hormone analogue (Decapeptyl Depot; Ferring Co., Copenhagen, Denmark) 75 μg/kg every 4 weeks. Before, during, and after treatment, pelvic ultrasonography was performed and ovarian and uterine volumes were calculated. The size of follicles > 5 mm were accurately measured. The results were related to a normative study of healthy Danish schoolgirls. Our data demonstrated that ovaries and uterus are enlarged in a significant number of girls (50%) with the diagnosis of central precocious puberty at the time of diagnosis. Median ovarian volume at time of diagnosis was 1.1 standard deviation scores (range –0.6 to 3.2 SD), median uterine volume was 1.8 standard deviation scores (range 0.0 to 3.5 SD). Within 3 months of treatment, both ovarian and uterine volumes decreased significantly ( p < 0.01) to normal values appropriate for age. Median ovarian volume after 3 months of treatment was 0.0 SD (range –2.4 to 1.5 SD); median uterine volume was 0.7 SD (range –0.6 to 4.1 SD). Ovarian and uterine volume remained within normal range (<2 standard deviation scores) after discontinuation of treatment. Follicles and macrocysts regressed during treatment. None of the girls' ovaries had a polycystic appearance during or after treatment with the gonadotropin-releasing hormone analogue. Our results confirmed pelvic ultrasonography as a reliable tool for investigation of internal genitalia in girls with precocious puberty and as a valid method for evaluation of the efficacy of treatment with gonadotropin-releasing hormone analogues. We suggest that repeated investigations be performed when evaluating treatment because the morphologic changes, including follicular maturation or regression, reflect ovarian stimulation or suppression. We found no evidence that girls with precocious puberty treated with long-acting gonadotropin-releasing hormone analogues have enlarged polycystic ovaries develop. (J Pediatr 1998;132:105-8)

Dependence of corrosion fatigue behaviour of friction‐welded butt joints on friction welding procedure

Summary Although friction‐welded butt joints are seeing more widespread applications as machine components and structural members, a valid method for evaluation of the joint performance, especially under operating load conditions, has not yet been established. The reliability of this type of joint is supported only by available empirical knowledge. To clarify the fatigue behaviour of joints, the authors have run a series of fatigue tests of several types of friction‐welded butt joints in air and have shown that the fatigue strengths of the joints are higher than that of the base metal but that the fatigue lives show heavy scatter. Evaluation of the corrosion fatigue behaviour of friction‐welded butt joints is also a matter of urgency, because some joints have practical applications in corrosive environments. The main purpose of this study is to determine the relationship between the fibre flow conditions near the weld interface of joints and their corrosion fatigue resistance. A series of experiments was ...