Validity Test Research Articles

Invalid Response Set, Malingering, and Related Base Rate in Psychological Injury I: Performance Validity Tests

Invalid Response Set, Malingering, and Related Base Rate in Psychological Injury I: Performance Validity Tests

Detecting noncredible symptomology in ADHD evaluations using machine learning

ABSTRACT Introduction Diagnostic evaluations for attention-deficit/hyperactivity disorder (ADHD) are becoming increasingly complicated by the number of adults who fabricate or exaggerate symptoms. Novel methods are needed to improve the assessment process required to detect these noncredible symptoms. The present study investigated whether unsupervised machine learning (ML) could serve as one such method, and detect noncredible symptom reporting in adults undergoing ADHD evaluations. Method Participants were 623 adults who underwent outpatient ADHD evaluations. Patients’ scores from symptom validity tests embedded in two self-report questionnaires were examined in an unsupervised ML model. The model, called “sidClustering,” is based on a clustering and random forest algorithm. The model synthesized the raw scores (without cutoffs) from the symptom validity tests into an unspecified number of groups. The groups were then compared to predetermined ratings of credible versus noncredible symptom reporting. The noncredible symptom ratings were defined by either two or three or more symptom validity test elevations. Results The model identified two groups that were significantly (p < .001) and meaningfully associated with the predetermined ratings of credible or noncredible symptom reporting, regardless of the number of elevations used to define noncredible reporting. The validity test assessing overreporting of various types of psychiatric symptoms was most influential in determining group membership; but symptom validity tests regarding ADHD-specific symptoms were also contributory. Conclusion These findings suggest that unsupervised ML can effectively identify noncredible symptom reporting using scores from multiple symptom validity tests without predetermined cutoffs. The ML-derived groups also support the use of two validity test elevations to identify noncredible symptom reporting. Collectively, these findings serve as a proof of concept that unsupervised ML can improve the process of detecting noncredible symptoms during ADHD evaluations. With additional research, unsupervised ML may become a useful supplementary tool for quickly and accurately detecting noncredible symptoms during these evaluations.

The Effect of Motivation, Competence, Compensation on Employee Performance with Organizational Culture as A Moderating Variable

Motivation, Competence, Compensation, and Organizational Culture have a great influence on the Employee Performance of PT. Adi Dharma Abadi. These four variables prove that this study aims to analyze the influence of motivation, competence, and compensation on employee performance with organizational culture as moderating variables in PT. Adi Dharma Abadi Bogor Regency. The study was conducted at PT. Adi Dharma Abadi Bogor Regency took 35 employees as the research sample, which was calculated using an equation formula through an interaction test often referred to as Moderated Regression Analysis (MRA) with a total population of 35 employees at an error margin of 2.5 %, for the data collection techniques, questionnaires, interviews, and observations. The data is processed using the SPSS version 26 application. The test data used in this research are reliability tests, validity tests, statistical tests, and classical assumption tests. The results of this study show that Motivation, Competence, Compensation, and Organizational Culture have a positive and significant influence on Performance.

The Effects of Responsibility and Empathy on Customer Satisfaction in Teaching Factory Learning

Vocational education encourages students to achieve competency in order to make students more prepared when joining the world. In order to achieve this goal, vocational education applies the model of a teaching factory. In factory learning, students are taught to provide direct services and products suitable for sale to general consumers or the public. Fundamental values ​​such as responsibility, empathy, and cooperation in service to society are the keys to this learning. The research aims to determine the simultaneous influence of responsibility and empathy on customer satisfaction in teaching factory learning at UPJ Vehicle Engineering Vocational High School 1 Bendo. The research used a sample of 67 class XII students at Vocational High School 1 Bendo using a Likert scale questionnaire with instrument validity test results using V-Aiken and reliability testing using Cronbach alpha. The research uses multiple linear regression analysis for the independent variables (responsibility and empathy) and the dependent (customer satisfaction) variables. The results of the Anova significance research were 0.000, and the calculated F value was 358.402. Then, the R2 value was 0.964. This shows that responsibility and empathy significantly influence customer satisfaction, with a percentage of 96.4%. Hopefully, this research can become the basis for further policy-making.

Supplemental Material for The Validation of Multiple Performance Validity Tests (PVTs) for Indonesia

Supplemental Material for The Validation of Multiple Performance Validity Tests (PVTs) for Indonesia

Pengaruh Penggunaan Media Nyata Berupa Peta Timbul pada Materi Peta Kelas X terhadap Hasil Belajar Siswa di SMA 1 Pertiwi Kota Padang

The objectives of this study are 1) To determine the influence of the use of real media in the form of embossed maps in class x map material on the learning outcomes of students at SMA 1 Pertiwi Padang 2) To find out the learning outcomes of students who use embossed map media and those who do not use embossed map media. This study uses a quantitative method with an experimental type of research. The pretest was carried out in two groups to find out the basic abilities of each control and experiment class. The population in this study is all students of class X of SMA 1 Pertiwi Kota Padang which totals 264 students with 2 class samples with purposive sampling techniques. The variables in this study are divided into 2 namely independent variables and bound variables. The data sources in this study are primary and secondary data. The collection techniques in this study are test, questionnaire and documentation techniques. The research procedure in this study was carried out in 2 classes, namely the experimental and control classes. The test of this research instrument is a test of validity, reliability, and differentiation. The data analysis tests in this study were the normality test, homogeneity, hypothesis test (T), and N-Gain test. The results of this study show that 1) The use of real media in the form of embossed maps on map material has an effect on student learning outcomes at SMA 1 Pertiwi Padang which is seen through the results of hypothesis testing (T) which is also supported by the improvement of student learning outcomes after using embossed map media in the experimental class and then an N-Gain test with a score of 82.50% for the embossed map media group and 60.00% for the conventional media group (lecture). 2) To find out the learning outcomes of students who use pop-up map media and those who do not use pop-up map media have been fulfilled with the scores of students who use pop-up map media higher than students who do not use pop-up map media as seen from the N-Gain Test. One of the advantages of using Embossed Map Media is the high level of interactivity through the practice of making embossed maps. Pop-up Map Media provides a non-boring learning experience for students.

The Impact of Critical Thinking and Teaching Methods on Students' Writing Ability

Abstract – In today's global culture, writing—once thought to be the domain of the educated—has evolved into a critical ability for people from all walks of life. One of the most challenging language production tasks is writing, and both professional and amateur writers routinely lament the process' complexity and difficulty. Students need to be able to think critically to generate an idea. The aim of this study was to ascertain how instructional methods and critical thinking interact to affect students' writing abilities. An experimental research design was adopted. There were 80 pupils in the sample, 40 from MAN 1 Kabupaten Tangerang's experiment class and 40 from MAN 2 Tangerang's control class. The sampling method that was employed. The findings of the validity and reliability tests of the writing ability and critical thinking (30 items) were tested using research instruments. Two-way ANOVA analysis was the test utilized, and the outcome revealed: (1) At State Islamic High School 1 Tangerang Regency, educational methods have a major impact on pupils' writing abilities. It is demonstrated by the values of Fo = 77,449 and sig 0,000 &lt; 0,05. (2) At State Islamic High School 2 Tangerang, pupils' writing abilities are significantly impacted by critical thinking. The values of sig 0,000 &lt; 0,05 and Fo = 51,791 demonstrate this. (3) Do teaching methods and critical thinking have any discernible interacting effects on students' writing abilities at State Islamic High School in Tangerang?

Development and Reliability and Validity Test of the Adolescent Global Citizenship Scale

Under the influence of globalization and informatization, the world is gradually becoming a community, and adolescents need corresponding literacy and competence as world citizens in the international community. Based on literature combing and in-depth interviews, this study determines the theoretical conclusions and initial entries of the adolescent global citizenship scale, and revises the entries through the Delphi Method. The final scale was formed through item analysis, factor analysis, reliability, and validity test. The adolescent global citizenship scale includes three-dimensions of global awareness, citizenship, and sustainable development perspective, with a total of 21 items. The exploratory factor analysis extracted three common factors, and the cumulative variance contribution rate was 54.86%; the results of the validation factor analysis showed that the model fit was good. The standardized coefficients of each item in each dimension of the scale were greater than 0.5, the combined reliability was 0.86, 0.89, 0.86, and the total Cronbach’s alpha coefficient of the scale was 0.87. Therefore, the reliability of the Adolescent Global Citizenship Scale is good, and it can be used in related research.

Influence of Social Media Marketing and Influencers on Purchase Decisions of Culinary MSMEs in Bandung Regency

Purchase decision is a crucial concept in marketing because various elements that support or hinder a purchase decision significantly affect the choice to acquire a good or service. One element that affects the purcahse decision is social media marketing and influencers. This research was carried out to understand the extent of the impact of marketing through social media and influencers on purchase decisions. This research method implements qualitative and quantitative analysis using questionnaire data collection techniques. Sampling was done by probability sampling with simple random sampling involving 100 respondents. To analyze the data to answer the research question, validity and reliability tests, descriptive analysis, classical assumption testing, multiple linear regression, and hypothesis testing both partially and simultaneously were used. The results showed that (1) every aspect of the purchase decision received a positive rating in the good category. (2) respondents also gave a good rating on social media marketing in all questions (3) for influencers; they scored good on 4 and a fair rating on 2. (4) Social media marketing positively influences individual purchasing decisions. (5) Influencers positively impact purchase decisions (6) Simultaneously, social media marketing and influencers show a positive and significant influence on purchase decisions. That way, if the marketing strategy on social media and the use of influencers in promotions in the MSME culinary sector are more effective, then it will affect the level of consumer purchase decisions for MSME culinary.

Upaya Guru PKn dalam Melaksanakan Pembelajaran Berdiferensiasi Sesuai dengan Potensi Peserta Didik di SMP Pembangunan Laboratorium UNP

This research is motivated by the efforts made by PKn teachers in implementing differentiated learning according to the potential of students at SMP Pembangunan Laboratorium UNP. The purpose of this study is to describe the efforts of PKn teachers in implementing differentiated learning as well as the supporting and inhibiting factors of PKn teachers' efforts in implementing differentiated learning according to the potential of students. The type of qualitative research with descriptive methods. The research informants used the Purposive Sampling technique. Data collection techniques were carried out by interviews, observation and documentation. The data validity test used the source triangulation technique. The results of the study showed that the efforts of PKn teachers in implementing differentiated learning according to the potential of students were analyzing the results of cognitive and non-cognitive potential mapping, compiling teaching modules according to the characteristics of differentiated learning, implementing differentiated learning based on the characteristics of students, analyzing the weaknesses/deficiencies of differentiated learning that had been implemented. The supporting and inhibiting factors of PKn teachers' efforts in implementing differentiated learning according to the potential of students were: 1) Supporting factors. One of the PKn teachers is a driving teacher, there are supervision activities, there are CADAS activities, mapping of student needs is carried out. 2) Inhibiting factors. Limited time for teachers in compiling teaching modules according to student characteristics, teachers do not use varied learning methods and media.

The Chinese version of the patients' experiences scale for older inpatients in the medical group: Instrument development and cross-sectional validation study.

Value-based healthcare is increasingly emphasizing attention to patients' self-reported experiences. However, due to the lack of effective tools, older patients in China lack feedback on the comprehensive care experience. Based on the psychometric assessment procedure, we developed a new geriatric inpatient experience scale (GIES). The study comprised two stages: (1) instrument development and (2) empirical testing. Through literature screening and Delphi methods, 26 preliminary items were identified. The content and facial validity tests then produced 23 items across eight factors: 'Doctor-patient communication', 'Engagement', 'Privacy', 'Right to know', 'Services timeliness', 'Continuity care', 'Visiting environment', and 'Overall satisfaction'. Using reliability analysis, exploratory and confirmatory factor analysis to evaluate psychometric characteristics, GIES showed good reliability and structural validity. As a multidimensional instrument for the experience of older patients, the application of GIES in clinical practice can assist healthcare providers in identifying areas for improvement to improve care experiences and outcomes for older patients.

Analysis of Occupational Safety and Health Management System (SMK3) on Workers In Cikeruh Majalengka Bridge Construction Project

The implementation of safety and health (OSH) systems in the work environment is a crucial component for the running of a business entity, because the consequences of accidents can have a detrimental impact on the workforce and the institution. This study was conducted to evaluate how OHS affects the level of worker productivity. A quantitative approach is the method used by collecting primary data through distributing questionnaires to 35 workers at the Cikeruh Majalengka Bridge Construction Project. Data analysis was carried out using IBM SPSS 26.0 for Windows, by conducting an Instrument Test consisting of Validity Test and Reliability Test. The variables studied consisted of four independent variables: Planning (X1), Organization (X2), Actuating (X3), Controlling (X4) and one dependent variable, namely Worker Productivity (Y). The results showed that Planning has a positive effect on productivity with an average value of 1.98, Organization 2.0, Actuating 1.78, and Controlling 1.94. The four independent variables as a whole have an average value of 1.92 which indicates a positive influence on worker productivity on the project, because it is in the interval class 1.6 ≥ x ≤ 2.0. This proves that factors such as planning, organization, implementation, and supervision play a significant role in increasing worker productivity on the Majalengka Cikeruh Bridge Construction Project.

Development of the children's primitive reflex integration assessment scale

ObjectiveNon-integrated primitive reflexes (PRs) in children can lead to issues in motor function and psychological wellbeing, while prior studies have shown correlations between PR integration and neurodevelopmental disorders in children. However, measurement methods for PR integration remain unestablished. Therefore, in the present study, we describe the development of a measurement scale for PR integration, a novel assessment tool to evaluate PR integration in children.MethodsCombining a literature review, practical experience, and results of specialized group discussions, a preliminary draft of the Children's Primitive Reflex Integration Measurement Scale (CPRIMS) was formulated. Employing a convenience sampling method, participants were selected from first and second-grade students in three primary schools in Liaoning province, Shenyang city, from May to July 2023. Item Discrimination Method (IDM), Critical Ratio Method (CRM), and Internal Consistency Coefficient Method (ICCM) were used for item analysis of pilot testing data. For formal testing data, Cronbach's α assessed the reliability of the scale, while fit indices such as chi-square value/degrees of freedom (χ2/df), Root Mean Square Error of Approximation (RMSEA), and Comparative Fit Index (CFI), along with tests of construct validity, evaluated the scale's validity.ResultsOverall, 555 participants were selected, 234 children with a mean age of 7.59 ± 0.71 years participated in the pilot testing, while 321 children with a mean age of 7.73 ± 0.71 years participated in the formal testing. CPRIMS comprises seven dimensions and seventeen items, including the Moro reflex (MR), Asymmetrical Tonic Neck Reflex (ATNR), Symmetrical Tonic Neck Reflex (STNR), Tonic Labyrinthine Reflex (TLR), Spinal Galant Reflex (SGR), Spinal Perez Reflex (SPR), and Landau Reflex (LR), explaining 88.2% of the total variance. Confirmatory factor analysis revealed a good model fit (χ2/df = 1.631, RMSEA = 0.044, NFI = 0.950, CFI = 0.980, IFI = 0.932, TLI = 0.972). Cronbach's α coefficients for the seven dimensions ranged from 0.730 to 0.945, demonstrating strong reliability.ConclusionCPRIMS, which includes dimensions such as MR, ATNR, STNR, TLR, SGR, SPR, and LR, demonstrates strong reliability and validity, indicating that this measure could serve as a reliable and effective tool for assessing the integration levels of PRs in children aged 6 to 9 years old.

Development and Pilot Psychometric Testing of the Cancer Nurse Self-Assessment Tools for Early and Metastatic Breast Cancer.

To develop and psychometrically test two newly developed Cancer Nurse Self-Assessment Tools for early and metastatic breast cancer (CaN-SAT-eBC and CAN-SAT-mBC). Instrument development and psychometric testing of content validity, reliability and construct validity. A three-phase procedure was conducted. Phase 1: An expert working group was formed to design and develop each tool using Benner's Model of Clinical Competence. Phase 2: The Content Validation Index (CVI) was used to assess the relevance and clarity of each item on the tools with breast cancer nurse experts and nursing educators. A CVI ≥ 0.78 was required for an item to be included in each tool. Phase 3: The tools were tested for internal consistency using Cronbach's alpha and construct validity using principal component analysis (PCA). The Guidelines for Reporting Reliability and Agreement Studies were followed in reporting this study. Each tool underwent two rounds of content validation. Ten experts were involved in the content validation for the CaN-SAT-eBC and 12 experts involved for CaN-SAT-mBC. The final versions comprised 18 (CAN-SAT-eBC) and 22 elements (CaN-SAT-mBC). All items obtained a satisfactory CVI of 0.83-1.0. Data from 159 and 126 nurses were analysed to evaluate reliability for CaN-SAT-eBC and CaN-SAT-mBC, respectively. The Cronbach's alpha coefficients for all elements were between 0.83 and 0.98. The PCA supported that each element was unidimensional and composed of internally correlated items, with the exception of the 'Diagnostics' element of practice which has a two-component structure measuring basic and advanced diagnostic tasks. The two CaN-SATs are comprehensive, valid and reliable. They can be used for self-assessment by nurses in relation to breast cancer care and for identifying learning needs for long-term professional development. The self-assessment tools can also be used to develop education initiatives for specialised breast cancer nurses. No patient or public contribution.

Strengthening Student Discipline Behavior Through The Implementation of Principal Policies in Banyumas Indonesia

Student discipline behavior is one of the characters that is targeted in the development of Indonesian character. However, field facts show that there are still school with low levels of student discipline. In Banyumas, there are schools which has managed to do strengthening student discipline behavior through the implementation of the principal's policies, one of which is Vocational School Ma'arif NU 1 Ajibarang Banyumas Indonesia. This study aims to describe the implementation of the principal's policy in strengthening the disciplined behavior of students at Vocational School Ma'arif NU 1 Ajibarang with types of qualitative research that are descriptive. Data collection using interview techniques, observation and documentation as well as triangulation of techniques and sources as a test of data validity. Data analysis was carried out with the stages of data reduction, presentation and verification. The results of the study showed that strengthening student discipline behavior through the implementation of the principal's policy in Vocational School Ma'arif NU 1 Ajibarang is carried out by compiling student regulations, points or sanctions for students who violate and giving rewards for exemplary students. The policy is implemented through four stages of implementation policy, namely policy preparation, policy testing, policy implementation and evaluation policy.

How destination image and trust mediate e-WOM's impact on halal tourism intentions

Purpose – This study examines the mediating role of destination image and destination trust in the relationship between Electronic Word-of-Mouth (e-WOM) and the intention to visit halal tourism destinations, specifically focusing on Bangka Belitung. Methodology – This study employed a quantitative approach, collecting data from 292 respondents via an online survey. SEM was used to test the relationships among e-WOM, destination image, destination trust, and intention to visit. Validity and reliability tests, as well as goodness-of-fit measures, were applied to assess the model's robustness.Findings – The results indicate that e-WOM significantly influences both destination trust and destination image. However, neither destination image nor destination trust directly affect the intention to visit, and e-WOM itself does not have a direct significant impact on the intention. These findings suggest that, while e-WOM fosters positive perceptions and trust, other factors are more critical in driving the halal tourism intention.Implications – This study provides valuable insights for tourism stakeholders, particularly in halal tourism, by highlighting the importance of managing e-WOM to enhance trust and image. However, halal tourism providers must prioritize authenticity, cultural sensitivity, and visitor engagement to attract and retain tourists.Originality – This study contributes to the literature by exploring the mediating effects of destination image and trust in halal tourism, challenging the assumption that positive perceptions are always translated into behavioral intentions. It expands the understanding of how e-WOM impacts tourist decision making within a specific cultural and religious context.

Risk factors for early childhood caries in patients with cleft lip and palate: a descriptive study

Introduction: Cleft lip and/or palate is a common congenital defect. Children with this condition often experience abnormalities in the anatomical and morphological structures of the oral cavity, which contribute to poor oral hygiene and a lack of interest in maintaining dental care. Early Childhood Caries (ECC) is a prevalent dental health problem in patients with cleft lip and/or palate and is affected by factors such as sugary food consumption, oral hygiene habits, frequency and use of milk bottles, and parental socioeconomic status. This study aims to identify the risk factors for ECC in children with cleft lip and/or palate. Methods: This study employed descriptive research methods, using interviews with ECC risk factor questionnaires and purposive sampling based on Taro Yamane's formula, resulting in a sample of 91 parents of children diagnosed with cleft lip and/or palate. The questionnaires used in this research had undergone validity and reliability testing. The results were analyzed using frequency distribution. Results: The results of this research showed that most respondents had education level equivalent to junior high school or high school (51.65%). The respondents' average income was below 1.5 million as follows, accounting 47.25% of the sample. All respondents (100%) demonstrated good knowledge of maintaining their children's oral hygiene. However, the majority of respondents provided sweet foods (51.65%) and sweet drinks (43.65%) to their children 1-3 times per day. Additionally, 49.45% of respondents reported giving milk to their children before sleep, and 45,05% indicated that their children sometimes fell asleep eating without brushing teeth. Conclusion: The risk factors for ECC in patients with cleft lip and/or palate include parental education and income, children's habit of sleeping after eating without brushing their teeth, frequency of sugary foods consumption, frequency of formula milk consumption, and the practice of giving milk to children before bedtime.

Analysis of skew, examination of intercorrelations, and determining the optimal threshold for performance invalidity when 10 performance validity tests are administered during a neuropsychological evaluation

ABSTRACT Introduction This study cross-validates and expands upon previous research by examining the optimal number of PVT failures necessary to determine invalid performance when 10 PVTs are administered during a neuropsychological evaluation. Additionally, the study assessed the degree of skewness of individual PVTs and PVT intercorrelations for the overall sample and by validity group. Method Participants were 283 adult neuropsychology outpatients evaluated at an academic medical center. Participants were initially classified as having valid (≤1 PVT failure; n = 225) or invalid (≥2 PVT failures; n = 58; base rate of 20% performance invalidity) performance based on four independent criterion PVTs. Failure rates of 10 additional PVTs were then compared, and sensitivity and specificity were calculated at different thresholds (e.g. ≥1, ≥2, ≥3, ≥4 PVT failures) to determine the optimal threshold for detecting invalid performance while maintaining ≥ 90% specificity. Results Findings indicate that failing ≥ 2 PVTs yielded 86% sensitivity/76% specificity, failing ≥ 3 PVTs yielded 69% sensitivity/92% specificity, failing ≥ 4 PVTs yielded 57% sensitivity/96% specificity, failing ≥ 5 PVTs yielded 29% sensitivity/99% specificity, and failing ≥ 6 PVTs yielded 22% sensitivity/100% specificity. PVT intercorrelations were generally small for the overall sample and by validity group. As expected, data were more highly skewed for patients with valid performance. Conclusions Findings were consistent with previous research and demonstrate that the three-failure threshold optimally detects invalid performance when 10 PVTs are administered. These findings inform the use of multiple PVTs in clinical settings and aid in the interpretation of PVT results.

The Influence of Local Government Integrity on Local Government Budget and its Implications for Development

This research aims to analyze the influence of local government integrity on APBD management and its implications for the quality of regional development in Indonesia. Secondary data from BPS, SPI, and APBD records for cities and regencies in Indonesia in 2022 were used. Data were analyzed using the Structural Equation Modeling-Partial Least Squares (SEM-PLS) method. This method integrates measurement models to validate indicators and structural models to assess relationships between latent variables. Key evaluation criteria, including reliability, validity, and hypothesis testing, were employed to ensure robustness. The results indicate that higher local government integrity improves APBD management, albeit with a relatively modest effect. Integrity plays a crucial role in preventing corruption and enhancing the sustainability of regional development, highlighting its importance in public financial management. These findings underscore the necessity of promoting high-integrity practices in local governance to achieve sustainable development goals.

Excellent Service Management of School Administration Personnel in Senior High Schools in Sleman District

Excellent service is the best form of service that aims to optimally meet customer expectations and needs. In the world of education, school administration personnel have a strategic role as the main support for the continuity of the educational process. This study aims to describe the formulation and implementation of excellent service management for administrative staff at high schools in Sleman Regency. This research uses a qualitative method with a descriptive approach. Data were collected through observation, interviews, and documentation, then analyzed using the Miles, Huberman, and Saldana model. Data validity tests include credibility, transferability, dependability, and confirmability. The results show that the formulation of excellent service management is carried out by formulating innovations through strengthening the competence and quality development of administrative staff. This aims to create a superior and quality education service system in SMA-Kabupaten Sleman. The implementation of excellent service is carried out through professional attitudes, attention, and real action to build an administrative service system that is responsive to aspirations, needs, and the dynamics of scientific and technological developments. This research recommends strengthening the competence of administrative staff on an ongoing basis and innovating service management, so as to create quality, superior and highly competitive education services in accordance with the demands of the times.