Validity Of Test Research Articles

B - 139 A Bayesian Approach to Performance Validity in Neuropsychological Testing

Abstract Objective Using the Test of Memory Malingering (TOMM), this study seeks to explore the feasibility of a continuous approach to performance validity by simulating experiments using a Bayesian statistical algorithm. Methodology A literature review was carried out to conduct statistical analyses from data of two known groups (those putting forth credible effort and those not). TOMM scores were modeled using various statistical distributions, with the inflated Conway-Maxwell-Poisson (ICMP) distribution providing the best fit. Simulation experiments were conducted to test the Bayesian statistics model. This involved generating artificial data from known distributions and then seeing how well the algorithm could recover the probability of a score belonging to the credible effort group. We tested the algorithm’s robustness by intentionally starting with incorrect assumptions and seeing if it could still converge on the correct probabilities. Finally, the Bayesian model was applied to real TOMM data to estimate the probability of credible effort for each possible score. Results The simulation studies showed that the Bayesian approach was generally robust, even when starting with incorrect assumptions. When applied to real data, TOMM scores of 40, 45, and 50 were essential, with approximately 5% change occurring with each score. A score of 40 covers approximately 50% of scores, 45 covers approximately 75%, and, finally, 50 covers 95% of scores. A perfect score of 50 encompassed ~95% of credible performances but not 100%. Conclusion This study provides initial statistically derived evidence for the feasibility and potential value of a continuous, probabilistic approach to performance validity.

Is the Silfverskiöld Test a valid tool for evaluating calf muscles spastic overactivity in patients with stroke? A retrospective observational study.

Spastic equinus (plantar flexed) foot is a common postural pattern in patients who suffer from post-stroke spasticity. To date, some clinicians use the Silfverskiöld Test in their practice to differentiate between gastrocnemius and soleus muscle overactivity in patients with spastic equinus (plantar flexed) foot. This use of the Silfverskiöld Test goes beyond its original aim, which was to distinguish isolated gastrocnemius contracture in patients with equinus deformity. The aim of this study was to investigate the Silfverskiöld Test validity for evaluating spastic equinus (plantar flexed) foot (i.e., differentiation between gastrocnemius and soleus muscle overactivity) by checking its outcome against those of selective diagnostic nerve block of tibial motor nerve branches to the soleus, gastrocnemius and tibialis posterior muscles. The design of the study was retrospective observational. The study was set in a university hospital. Sixty-seven adult stroke patients with spastic equinus (plantar flexed) foot. Each patient underwent selective diagnostic nerve block of tibial motor nerve branches to the soleus, gastrocnemius and tibialis posterior muscles. All patients were evaluated before diagnostic nerve block by means of the Silfverskiöld Test which was considered positive when ankle joint passive dorsiflexion was greater with the knee flexed than extended. Furthermore, they were assessed before and after nerve block by means of the modified Ashworth Scale and the Tardieu Scale. Our sample included 41 males and 26 females (mean age 57.6 years) suffering from spastic equinus (plantar flexed) foot due to chronic stroke (mean time from onset 2.4 years). Forty-eight patients out of 67 presented with positive Silfverskiöld Test. The χ2 test showed no association between the Silfverskiöld Test and spastic overactivity of the gastrocnemius (P=0.253), soleus (P=0.605) and tibialis posterior (P=0.462) muscles as evaluated by serial selective diagnostic block of the tibial nerve motor branches. Our findings do not support the Silfverskiöld Test as a valid tool for evaluating spastic equinus (plantar flexed) foot to differentiate between gastrocnemius, soleus and tibialis posterior spastic muscle overactivity in adult patients with stroke. The choice for an appropriate management of spastic equinus (plantar flexed) foot in adults with stroke should not be mainly defined on the base of Silfverskiöld Test.

Vulnerability extraction and prediction method based on improved information gain algorithm.

More and more attention has been paid to computer security, and its vulnerabilities urgently need more sensitive solutions. Due to the incomplete data of most vulnerability libraries, it is difficult to obtain pre-permission and post-permission of vulnerabilities, and construct vulnerability exploitation chains, so it cannot to respond to vulnerabilities in time. Therefore, a vulnerability extraction and prediction method based on improved information gain algorithm is proposed. Considering the accuracy and response speed of deep neural network, deep neural network is adopted as the basic framework. The Dropout method effectively reduces overfitting in the case of incomplete data, thus improving the ability to extract and predict vulnerabilities. These experiments confirmed that the excellent F1 and Recall of the improved method reached 0.972 and 0.968, respectively. Compared to the function fingerprints vulnerability detection method and K-nearest neighbor algorithm, the convergence is better. Its response time is 0.12 seconds, which is excellent. To ensure the reliability and validity of the proposed method in the face of missing data, the reliability and validity of Mask test are verified. The false negative rate was 0.3% and the false positive rate was 0.6%. The prediction accuracy of this method for existing permissions reached 97.9%, and it can adapt to the development of permissions more actively, so as to deal with practical challenges. In this way, companies can detect and discover vulnerabilities earlier. In security repair, this method can effectively improve the repair speed and reduce the response time. The prediction accuracy of post-existence permission reaches 96.8%, indicating that this method can significantly improve the speed and efficiency of vulnerability response, and strengthen the understanding and construction of vulnerability exploitation chain. The prediction of the posterior permission can reduce the attack surface of the vulnerability, thus reducing the risk of breach, speeding up the detection of the vulnerability, and ensuring the timely implementation of security measures. This model can be applied to public network security and application security scenarios in the field of computer security, as well as personal computer security and enterprise cloud server security. In addition, the model can also be used to analyze attack paths and security gaps after security accidents. However, the prediction of post-permissions is susceptible to dynamic environments and relies heavily on the updated guidance of security policy rules. This method can improve the accuracy of vulnerability extraction and prediction, quickly identify and respond to security vulnerabilities, shorten the window period of vulnerability exploitation, effectively reduce security risks, and improve the overall network security defense capability. Through the application of this model, the occurrence frequency of security vulnerability time is reduced effectively, and the repair time of vulnerability is shortened.

Cervical Sensorimotor Function Tests Using a VR Headset-An Evaluation of Concurrent Validity.

Sensorimotor disturbances such as disturbed cervical joint position sense (JPS) and reduced reaction time and velocity in fast cervical movements have been demonstrated in people with neck pain. While these sensorimotor functions have been assessed mainly in movement science laboratories, new sensor technology enables objective assessments in the clinic. The aim was to investigate concurrent validity of a VR-based JPS test and a new cervical reaction acuity (CRA) test. Twenty participants, thirteen asymptomatic and seven with neck pain, participated in this cross-sectional study. The JPS test, including outcome measures of absolute error (AE), constant error (CE), and variable error (VE), and the CRA test, including outcome measures of reaction time and maximum velocity, were performed using a VR headset and compared to a gold standard optical motion capture system. The mean bias (assessed with the Bland-Altman method) between VR and the gold standard system ranged from 0.0° to 2.4° for the JPS test variables. For the CRA test, reaction times demonstrated a mean bias of -19.9 milliseconds (ms), and maximum velocity a mean bias of -6.5 degrees per seconds (°/s). The intraclass correlation coefficients (ICCs) between VR and gold standard were good to excellent (ICC 0.835-0.998) for the JPS test, and excellent (ICC 0.931-0.954) for reaction time and maximum velocity for the CRA test. The results show acceptable concurrent validity for the VR technology for assessment of JPS and CRA. A slightly larger bias was observed in JPS left rotation which should be considered in future research.

Pengaruh Lokasi Terhadap Keputusan Menjadi Nasabah di Bank BSI KCP Pasar Aur Bukittinggi

This research is motivated by competition in the banking world. Where Sharia banks are required to be able to influence society with their advantages. With the support of this strategic business location, consumers can make more decisions to become customers at BSI KCP Pasar Aur Bukittinggi. The aim of this research is to find out how much influence location has on the decision to become a customer at BSI KCP Pasar Aur Bukittinggi. This research uses quantitative methods. The data collection technique uses a questionnaire. Sampling in this study used Rao Purba with a sample size of 96 people. The tests used include, Descriptive Analysis, Pre-Research Test (Validity Test and Reliability Test), Classic Assumption Test (Normality Test, Multicollinearity Test and Heteroscedasticity Test), Simple Linear Regression Analysis Test, and Hypothesis Test (t-Test, F Test and R2 test) assisted with SPSS 20. The results of this research partially show that location has a significant influence on customer decisions with a calculated value of tcount ≥ ttable (8.307 ≥ 3.380). Based on the results of research tests using simple linear regression analysis techniques, it can be stated simultaneously or together that there is a positive and significant influence with a significant F value of 0.000 ≤ 0.05. The test value of the coefficient of determination (R2) has an influence of 0.423 or 42.3% on customer decisions, while the remaining 57.7% is influenced or explained by other variables not discussed in this research.

The Influence of Organizational Citizenship Behavior, Organizational Commitment, and Organizational Culture on Production Employee Performance with Job Satisfaction as an Intervening Variable

This research is entitled "The Influence of Organizational Citizenship Behavior, Organizational Commitment and Organizational Culture on the Performance of Production Employees with Job Satisfaction as an Intervening Variable (Case Study at PT. Casuarina Harnessido Pemalang)". The purpose of this study was to determine the effect of Organizational Citizenship Behavior, organizational commitment and Organizational Culture on the Performance of Production Employees with Job Satisfaction as an Intervening Variable. In this research using purposive sampling technique with a total sample of 90 respondents. The testing in this research was carried out by testing validity, reliability testing, classical assumption test, multiple linear regression analysis, hypothesis testing in the form of t test, F test, R2 test, path analysis and Sobel test. In this research, there is a partially significant positive effect between the OCB variable on the performance of production employees with a value of tcount > ttable (2.184>1.662), organizational commitment to the performance of production employees with a value of tcount> ttable (3.689>1.662), organizational culture on the performance of production employees. with a value of tcount > ttable (3.160>1.662), job satisfaction affects the performance of production employees with a value of tcount > ttable (2,606>1,662). From the Sobel test results show that job satisfaction mediates the effect of OCB on the performance of production employees with a value of tcount > ttable (3.0496>1.6619), job satisfaction mediates the effect of organizational commitment on employee performance. production with a value of tcount > ttable (1.7531>1.6619), job satisfaction mediates the effect of organizational culture on the performance of production employees with a value of tcount > ttable (1.9392>1.6619).

Chemicals regulation and non-animal methods: displacing the gold standard.

Regulating industrial chemicals in foodstuffs and consumer products is a major aspect of protecting populations against health risks. Non-animal testing methods are an essential part of the radical change to the framework for toxicity testing that is long overdue in global economies. This paper discusses reasons why the drive to reduce animal testing for chemical safety testing is so difficult to achieve, as perceived by those who are closely involved in chemicals regulations in different capacities. Progress is slow, despite the fact that the ethico-legal conditions for a move away from animal testing are largely in place, and despite scientific arguments for a radical change in the paradigm of toxicity testing, away from reliance on animal studies. I present empirical data drawn from two studies in a European Commission context promoting non-animal methods. The aim of the paper is modest. It is to foreground the voices of those who deal with the science and regulation of chemicals on a day-to-day basis, rather than to offer a theoretical framework for what I heard from them. I offer a synthesis of the main challenges faced by non-animal alternatives, as these are perceived by people in different stakeholder groups dealing with chemicals regulation. I show where there are pockets of agreement between different stakeholders, and where the main disagreements lie. In particular there is dispute and disagreement over what counts as validation of these alternative tests, and by implication of the traditional 'gold standard' of animal testing. Finally, I suggest that the shift to non-animal methods in chemicals regulation demonstrates the need for the concept of validation to be broadened from a purely techno-scientific definition, and be more explictly understood as a demand for trust and acceptance, with more attention given to the complex social, institutional and economic settings in which it operates.

Analisis Perilaku terhadap Niat Berinvestasi

This study aims to determine and analyze the influence of behavior on investor intentions. This study uses primary data. The sample used was 100 respondents, namely people who have invested, have worked and have a fixed income. The sampling technique used nonprobability sampling, precisely the respondent accidental technique by distributing questionnaires. This type of research is quantitative research, then the data was analyzed using research instrument tests (validity and reliability tests), multicollinearity tests, multiple regression analysis (regression models, determination coefficients, F tests, t tests), and classical assumption tests (heteroscedasticity tests, normality, assistance and autocorrelation) with the SPSS software program version 25.0. The results showed that financial behavior has a positive and significant effect on investment intentions. This shows that the better a person's level of financial behavior, the better their investment intentions will be. Investment knowledge has a positive and significant effect on investment intentions. This shows that the better a person's level of investment knowledge, the better their investment intentions will be. Financial literacy has a positive and significant effect on investment intentions. This shows that the better a person's level of financial literacy, the better their investment intentions will be.

Print Rich Classroom: An Exposure to Learn English Language Reading Proficiency

The aim of this study was to investigate the effect of print rich classroom on English language reading proficiency of fourth grade. The study utilized a randomized pretest-posttest control group design, drawn from true experimental research methods, was employed. A sample of forty fourth-grade students was randomly selected from a private school in Aroop, Gujranwala. Forty students were chosen and divided into two groups: twenty were randomly assigned to the control group and twenty to the experimental group. The control group was taught using traditional teaching methods, while the experimental group received instruction through a print-rich method. Lesson plans incorporating the print-rich method were specifically designed by the researcher for the experimental group. The control group continued with the traditional teaching method for one month. An English Language Reading Proficiency (ELRP) test was developed by the researcher to assess reading skills. The test's validity was confirmed using quantitative methods and expert opinion. Data were collected from both groups, with pre-tests and post-tests administered. The results showed that students taught using the print-rich method confirmed greater improvement in reading proficiency compared to those taught using traditional methods. The study's review clearly indicated, in light of other researchers' earlier research investigations, that this study is beneficial for English language learners that print rich classroom offers a variety of chances for students to advance their English language reading abilities both within and outside of the classroom.

MAIN STAGES OF THE LANGUAGE TEST DEVELOPMENT PROCESS AND VALIDATION ANALYSIS METHODS: THE CASE OF GAZI TÖMER

Testing is the most widely used assessment tool in measuring the development process of students' languagecompetence. Therefore, the existence of valid and reliable language tests appropriate to student achievements in education is of great importance. Research on language test development in foreign language teaching in Kazakhstan is insufficient. The aim ofthis study is to practically demonstrate the basic stages of the test development process and how to conduct content validity analysis with the example of the proficiency test of foreign language (Turkish) prepared by Gazi TÖMER. The research method was based on a quantitative research design. The sample of the research for validation was consisted of 7 experts with experience in Gazi TÖMER. For reliability, there were a total of 66 students studying at Abai KazNPU. The first part of the study was examinedfor the content validity of the relevant test. For this purpose, based on the criteria determined by Webb for the evaluation of learning outcomes, the opinions received from field experts were evaluated using the Lawshe technique. The CVR value of the 45-question test was .96, and the CVI was “significant”. The second part of the study was about reliability. For this purpose, the difficulty level of each item was examined based on the data obtained from the pilot application of the test. Data were analyzedusing Excel and SPSS programs. Additionally, the KR-20 value was calculated and found to be .80, and the test was considered reliable. It is believed that the steps and results included in the study will guide the process of creating valid and reliable tests in various fields.

288P External validation of an AI-enabled digital test (PreciseDx Breast) to predict breast cancer recurrence within 6-years exhibited good independent performance on a comparable early-stage cohort from the Netherlands

288P External validation of an AI-enabled digital test (PreciseDx Breast) to predict breast cancer recurrence within 6-years exhibited good independent performance on a comparable early-stage cohort from the Netherlands

Analytical Validation of an Early Detection Pancreatic Cancer Test Using 5-Hydroxymethylation Signatures

Early detection of pancreatic cancer has been shown to improve patient survival rates. However, effective early detection tools to detect pancreatic cancer do not currently exist. The Avantect Pancreatic Cancer Test, leveraging the 5-hydroxymethylation [5-hydroxymethylcytosine (5hmC)] signatures in cell-free DNA, was developed and analytically validated to address this unmet need. We report a comprehensive analytical validation study encompassing precision, sample stability, limit of detection, interfering substance studies, and a comparison with an alternative method. The assay performance on an independent case-control patient cohort was previously reported with a sensitivity for early-stage (stage I/II) pancreatic cancer of 68.3% (95% CI, 51.9%-81.9%) and an overall specificity of 96.9% (95% CI, 96.1%-97.7%). Precision studies showed a cancer classification of 100% concordance in biological replicates. The sample stability studies revealed stable assay performance for up to 7 days after blood collection. The limit of detection studies revealed equal results between early- and late-stage cancer samples, emphasizing strong early-stage performance characteristics. Comparisons of concordance of the Avantect assay with the enzymatic methyl sequencing (EM-Seq) method, which measures both methylation (5-methylcytosine) and 5hmC, were >95% for all samples tested. The Avantect Pancreatic Cancer Test showed strong analytical validation in multiple validation studies required for laboratory-developed test accreditation. The comparison of 5hmC versus EM-Seq further validated the 5hmC approach as a robust and reproducible assay.

52032 Validation and Feasibility of Patient-Reported Outcomes Information System Computer Adaptive Tests for Anxiety and Depression in Atopic Dermatitis: A Real-World Practice-Based Study

52032 Validation and Feasibility of Patient-Reported Outcomes Information System Computer Adaptive Tests for Anxiety and Depression in Atopic Dermatitis: A Real-World Practice-Based Study

Postintensive care syndrome: Development and psychometric validation of a knowledge test.

Postintensive care syndrome (PICS) is a combination of short-, medium-and long-term morbidities that occur in patients discharged from the Intensive care unit (ICU). ICU professionals have a crucial role in managing and understanding the PICS. This study aimed to develop the PICS Knowledge Test (PICS-KT), which measures ICU professionals'awareness and knowledge levels regarding PICS, and to determine its validity and reliability. The databases were searched in detail, scientific research related to PICS was analyzed, and the draft scale was created accordingly. A total of 117 doctors and nurses who had been working in the ICU for at least 6 months were included in the study. For the validity and reliability analysis of the test, content validity ratio, item difficulty index, item discrimination index values and Cronbach α were examined. The Cronbach's α reliability coefficient for the 46-item PICS-KT is 0.93, indicating high reliability. Scores range from 0 to 46, with 32 or higher considered successful, suggesting adequate knowledge of PICS among ICU professionals. Scores of 14 or less indicate minimal knowledge. Those with scores between 14 and 32 possess some knowledge but need improvement. PICS-KT assesses knowledge in four main areas: general information, risk factors/causes, symptoms and findingsand interventions. ICU professionals show high awareness of interventions for preventing and treating PICS, as indicated by a high mean score in the interventions subdimension. The PICS-KT is crucial in assessing healthcare professionals'understanding of the various short-, medium-and long-term morbidities associated with PICS. The study ensures that the test is a robust and dependable instrument for evaluating ICU professionals'knowledge about PICS.

53632 Development and Validation of Gene Expression Panel Test for Cutaneous Squamous Cell Carcinoma

53632 Development and Validation of Gene Expression Panel Test for Cutaneous Squamous Cell Carcinoma

52034 Validation and Feasibility of Patient-Reported Outcomes Information System Computer Adaptive Tests for Sleep Disturbance and Sleep-Related Impairment in Atopic Dermatitis: A Real-World Practice-Based Study

52034 Validation and Feasibility of Patient-Reported Outcomes Information System Computer Adaptive Tests for Sleep Disturbance and Sleep-Related Impairment in Atopic Dermatitis: A Real-World Practice-Based Study

Criteria for second generation comparator tests in validation of novel HPV DNA tests for use in cervical cancer screening.

While HC2 and GP5+/6+ PCR-EIA were pivotal in test validation of new HPV assays, they represent the first generation of comparator tests based upon technologies that are not in widespread use anymore. In the current guideline, criteria for second-generation comparator tests are presented that include more detailed resolution of HPV genotypes. Second-generation comparator tests should preferentially target only the 12 genotypes classified as carcinogenic (IARC-group I), and show consistent non-inferior sensitivity for CIN2+ and CIN3+ and specificity for ≤CIN1 compared to one of the first-generations comparators, in at least three validation studies using benchmarks of 0.95 for relative sensitivity and 0.98 for relative specificity. Validation should take into account used storage media and other sample handling procedures. Meta-analyses were conducted to identify the assays that fulfill these stringent criteria. Four tests fulfilled the new criteria: (1) RealTime High-Risk HPV Test (Abbott), (2) Cobas-4800 HPV test (Roche Molecular System), (3) Onclarity HPV Assay (BD Diagnostics), and (4) Anyplex II HPV HR Detection (Seegene), each evaluated in three to six studies. Whereas the four assays target 14 carcinogenic genotypes, the first two identify separately HPV16 and 18, the third assay identifies five types separately and the fourth identifies all the types separately.

An intermittent recovery test for soccer players: a validation study.

Soccer is an intermittent team sport that demands high aerobic capacity. On field, soccer players' aerobic capacity, assessed through the maximal oxygen uptake (VO<inf>2</inf>max), is usually determined by an intermittent recovery test. The aim of this study was to obtain a construct validity of a new intermittent recovery test (IRT) with a fixed speed and a progressive decrement of rest period. Twenty-five male soccer players were recruited to perform an incremental continuous test (ICT) and the new IRT, to compare their physiological data. Fifteen male soccer players were involved to perform a test-retest of IRT to assess its reliability. VE<inf>peak</inf>, absolute VO<inf>2</inf>max, relative VO<inf>2</inf>max and VCO<inf>2</inf>peak registered during ICT and IRT correlated strongly (Pearson's correlation coefficient ranges from 0.75 to 0.80, with very large as magnitude of effects and with P<0.001). IRT showed reliability from good to excellent regarding VE<inf>peak</inf>, absolute VO<inf>2</inf>max, relative VO<inf>2</inf>max, VCO<inf>2</inf>peak and covered distance (ICC values ranged from 0.82 to 0.95). These findings and its underlying physiological and muscular demands, suggest that IRT can be considered as a valid and reliable test to assess aerobic capacity in soccer players during the competitive period.

1647P Clinical validity of plasma DNA testing to identify BRCA-mutated (BRCA+) patients in the MAGNITUDE study

1647P Clinical validity of plasma DNA testing to identify BRCA-mutated (BRCA+) patients in the MAGNITUDE study

Valid, invalid, or somewhere in between? Baseline Immediate Post-Concussion Assessment and Cognitive Testing (ImPACT) and stand-alone performance validity testing in collegiate athletes.

Valid, invalid, or somewhere in between? Baseline Immediate Post-Concussion Assessment and Cognitive Testing (ImPACT) and stand-alone performance validity testing in collegiate athletes.