Good Items Research Articles

A Generalized Approach to Defining Item Discrimination for DCMs

ABSTRACTDiagnostic classification models (DCMs, also known as cognitive diagnosis models) hold the promise of providing detailed classroom information about the skills a student has or has not mastered. Specifically, DCMs are special cases of constrained latent class models where classes are defined based on mastery/nonmastery of a set of attributes (or “facets”). In addition to identifying an examinee’s mastery profile, DCMs provide student information that can be used to describe the quality of an item, or the item discrimination. This paper discusses a unified item and test discrimination approach for identifying good and bad DCM items for polytomous models that is on an interpretable scale. Furthermore, this index is defined in a way such that for dichotomous DCMs, such as the DINA it reduces to traditional measures of item discrimination. Finally, using a simulation study, this index is shown to be related to both Kullback–Liebler-based indices and correct classification rates.

Validation of Questionnaire on the Impact of applying Occupational Safety and Health Procedures on the Risk Work Environmentin Al-Walla Catering Companyat Jordan

This study entitled The impact of applying Occupational Safety and Health procedures on the Risk in the Work Environment, This study Aimed Verification of Validation of Questionnaire on The Impact of Applying Occupational Safety and Health Procedures on the Risk Work Environment in Al-Walla Catering Company at Jordan, Method used A cross-sectional study was conducted in 2017 at Al Walaa Catering Company during, Amman, Jordan. Al Walaa Catering Company is a best Jordanian company using the latest technology in the field of food trade, preparation and processing of raw materials for manufacturing, This study used administrated questionnaire, was generally well received by the respondent's, The validation involved content validity, exploratory factor analysis for the construct validity and internal consistency for reliability, Results showed The questionnaire on the impact of applying occupational safety and health procedures on the risks in the work environment was validated on AL-Walla Catering company at Jordan. The questionnaire was distributed among the total of 300 employees of a company and 294 respondents questionnaire were recovered. The descriptive statistics were used to measure mean score of each constrict, while for construct validity exploratory factor analysis was used with the extraction method of the principal component and the varimax rotation with normalization. The descriptive statistics showed four items with mean constrict score (5.9, 4.0, 3.7, and 1.1) within 25 items which were associated with occupational safety and health procedure on the risks in the work environment. The internal consistency was [.80,.75,.70, and.61] with the total value of Cronbach's Alpha for four factors of occupational safety and health procedure on the risks in the work environment. Therefore, questionnaire for occupational safety and health procedure on the risks in the work environment was valid and reliable with good items to assess occupational and health safety risks, As we conclude from this study the questionnaire on the knowledge of Validation of Questionnaire on The Impact of Applying Occupational Safety and Health Procedures on the Risk Work Environment in Al-Walla Catering Company at Jordan. was valid with good reliability and can be used to measure knowledge the Impact of Applying Occupational Safety and Health Procedures on the Risk Work.

Characteristics and equation of accounting vocational theory trial test items for vocational high schools by subject-matter teachers' forum

This study is aimed at: (1) understanding the characteristics of Accounting Vocational Theory trial test items using the Item Response Theory and (2) determining the horizontal equation of Accounting Vocational Theory trial exam instruments. This was explorative-descriptive research, observing the subject of the eleventh-grade students. The research objects were test instruments and responses of students from six schools selected through the stratified random sampling technique. The data analysis employed review sheets and BILOG program for the Item Response Theory 2PL. The findings were as follows. (1) The test item review of test packages A and B found 37 good quality items, the Item Response Theory using 2PL showed that Package A Test generated 27 good questions, Package B Test contained 24 good questions. (2) The question equating using the Mean/Sigma method resulted in the equation of = 1.168bx + 0.270, with the Mean/Mean method resulting in the equation of = 0.997bx - 0.250, the Mean/Mean method at 0.250, while Mean/Sigma method at 0.320.

The influence of rule availability and item similarity on metacognitive monitoring during categorisation

ABSTRACTIn four experiments, we examined the sources of metacognitive judgments during the categorisation of new items after the learning of old items was completed. In the rule condition, the categorisation rule was explicitly given to the participants during learning, while in the no-rule condition participants relied on feedback to infer category membership. In the transfer phase, two types of novel items were used: good and bad transfer items. Transfer items also differed in the level of similarity to their training pairs. In the rule condition, all types of transfer items were classified with high accuracy and confidence. In the no-rule condition, a dissociation between accuracy and confidence was revealed. Good transfer items were classified more accurately than bad transfer items, whereas similar items were classified with higher confidence than dissimilar items. The obtained results suggest the utilisation of two potential cues for metacognitive judgments: declarative knowledge if the correct rule is explicitly available, and item similarity if it is difficult to infer the correct rule from feedback.

Work Safety and Health Principles (K3) in the Design of Workshop Center of Artificial Natural Stone in Gianyar, Bali

The embodiment of Balinese buildings is known to be synonymous with the use of natural stone materials which are exposed in such a way and not given additional dyes/coatings. The material used is usually in the form of bricks and sandstone. The center of the natural stone craftsman is a location of concentration of craftsmen who produce hand-crafted natural stone. The artificial natural stone craftsman center has a workshop used by artisans to produce crafts. In the production process, there is certainly a risk of workplace accidents that can be experienced by craftsmen. At the center must implement occupational safety and health to provide a sense of security and comfort in work. There are many work accidents caused by human factors, workplace accidents must be avoided so that the production of crafts can run smoothly. The risk of workplace accidents that can occur in craftsmen centers in the form of being injured by sharp objects, being hit by a hammer, or falling. The health of craftsmen is also an important factor in the production of artificial natural stones. Healthy craftsmen will be able to work productively and produce good quality craft items. The application of occupational safety and health is expected to be a solution in reducing the risk of workplace accidents that can occur in the production process.
 Index Terms— centers, craftsmen, accidents, health.

Test Development Strategies Used by Saudi In-Service Teachers of English as a School Subject

This study investigates how in-service teachers of English as a school subject (ESS) in Saudi schools deal with test construction, administration, and score analyses. To answer the study’s questions, a 60-item questionnaire was constructed according to the suggestions and recommendations of language testing specialists reported in the literature. The questionnaire was built according to seven dimensions: specifications/blueprints, test writing, moderation, test administration, scoring, analyses of students’ scores, and item banking. 199 female and male intermediate and high ESS teachers in Saudi schools, with different years of experience in teaching English, completed the questionnaire. The findings indicated that ESS teachers in Saudi schools do not usually follow suggested recommendations pertinent to the above-mentioned dimensions. Their tests are written without planned specifications or clear blueprints. Besides, ESS teachers- regardless of their gender, years of experience, or the level they teach- rarely moderate their tests. They rarely analyze their student test scores or store good testing items in an item bank for future use. The study provides suggestions and recommendations to improve the current situation. Workshops, seminars, and on-the-job training should be conducted. Academic departments in Saudi universities responsible for English teacher preparation programs should introduce courses related to language testing if they do not have any or increase their numbers if they already have some. The study concludes with suggestions for future research.

SYNCHRONIZATION OF ENGLISH STUDENTS’ WORKSHEET (LKS) TO THE CURRICULUM

This analysis is intended to uncover the synchronization between the students’ worksheet for vocational high school to the School Based Curriculum. This research explores the profile of the English students’ worksheet; evaluate the synchronization between the English students’ worksheet’s content and assessment to the learning objective in curriculum. This research utilizes qualitative research design, particularly in the form of a descriptive-evaluative content analysis. The data collection technique is in non-participant analysis study. The primary data is one printed students’ worksheet entitled “BAHASA INGGRIS Untuk SMK TEKNIK” published by MARGA MITRA and is used in SMK Al-Hidayah Cirebon. The data are analyzed by using textbook evaluation checklists which are represented into percentage and described into paragraph description as the result. The result of the research shows that the analyzed students’ worksheet obtains over a third of poor items, nearly two third of good items , and only a small portion of excellent. It means that this students’ worksheet is mostly categorized good in the term of general evaluation. However, fact found that some contents and assessments in this students’ worksheet are out of the guidance in the syllabus. It is clear that it contains roughly a quarter of not synchronous assessment in speaking, nearly a third in reading, and nearly two third in writing. It indicates that the references and the guidance of the students’ worksheet are questionable and untrustworthy Keywords: Students’ Worksheet, Synchronization, Curriculum, Syllabus, Learning Objective.

Inventory Modeling for Deteriorating Imperfect Quality Items with Selling Price Dependent Demand and Shortage Backordering under Credit Financing

The production processes throughout the world aim at improving quality by introducing latest technologies so as to perform well in fierce competition. Despite this due to various unavoidable factors, most of the manufacturing processes end up with certain imperfections. Hence, all the items produced are not of perfect quality. The condition tends to be more susceptible while dealing with items of deteriorating quality; therefore an inspection process is must for screening good quality items from the ordered lot. Demand is assumed to be price dependent and it is represented by a constant price elasticity function. Also to endure with the rapid growth and turbulent markets, the suppliers try to engage and attract retailers through various gimmicks and one such contrivance is offering trade credit, which is proved to be an influential strategy for attracting new customers. In view of this, the present paper develops an inventory model for items of imperfect quality with deterioration under trade-credit policies with price dependent demand. Shortages are allowed and fully backlogged. A mathematical model is developed to depict this scenario. The aim of the study is to optimize the optimal order level, backorder level and selling price so as to maximize the retailer’s total profit. Findings are validated quantitatively by using numerical analysis. Sensitivity analysis is also performed so as to cater some important decision-making insights.

RANCANG BANGUN SISTEM INFORMASI INVENTARIS BPJS KETENAGAKERJAAN CABANG PEKALONGAN

BPJS (Social Security Provider) Employment Branch Pekalongan has the Information Technology division that having responsibilities to implement data recapitulation such as  incoming goods data, outgoing goods data, and inventory data. Currently the data management still uses conventional methods that is manual system resulting some problems, these are; really takes time in searching data and less effective in doing the job. The aim of this study are to design and to build a system inventory information on BPJS Employment Branch Pekalongan supported by waterfall method. In the information system has the features of good data management items of incoming and outgoing goods. Continued to make the reports that can be printed in pdf format. The evaluation was done to measure several parameters such as the usefulness of the application parameters, usability and user satisfaction. Based on the results of the evaluation in the user environment involving four respondents obtained positive results. This indicates that the information system has the benefit value, usefulness and help in improving the performance of the relevant sections.

RANCANG BANGUN SISTEM INFORMASI INVENTARIS BPJS KETENAGAKERJAAN CABANG PEKALONGAN

BPJS (Social Security Provider) Employment Branch Pekalongan has the Information Technology division that having responsibilities to implement data recapitulation such as incoming goods data, outgoing goods data, and inventory data. Currently the data management still uses conventional methods that is manual system resulting some problems, these are; really takes time in searching data and less effective in doing the job. The aim of this study are to design and to build a system inventory information on BPJS Employment Branch Pekalongan supported by waterfall method. In the information system has the features of good data management items of incoming and outgoing goods. Continued to make the reports that can be printed in pdf format. The evaluation was done to measure several parameters such as the usefulness of the application parameters, usability and user satisfaction. Based on the results of the evaluation in the user environment involving four respondents obtained positive results. This indicates that the information system has the benefit value, usefulness and help in improving the performance of the relevant sections.

Adaptation and Validation of a Chinese Version of Patient Health Engagement Scale for Patients with Chronic Disease.

The Patient Health Engagement Scale (PHE-s) was designed to assess the emotional and psychological attitudes of patients' engagement along their healthcare management journey. The aim of this study was to validate a culturally adapted Chinese version of the PHE-s (CPHE-s). Three hundred and seventy-seven participants were recruited from eight community health centers in a sample of patients with chronic disease in Hunan Province, China. The original Italian PHE-s was translated into Mandarin Chinese using a standardized forward–backward translation. The Rasch model was utilized and presented uni-dimensionality and good items fitness of the PHE-s. The internal consistency was 0.89 and the weighted Kappa coefficients of the items (test–retest reliability) ranged from 0.52 to 0.79. Both principal component analysis and confirmatory factor analysis supported a single-factor structure of the PHE-s. In testing the external validity, the PHE-s showed a significant moderate correlation with patient activation but not with medicine adherence behavior, which requires further exploration. The result suggested that the PHE-s is a reliable and valid instrument to assess the level of patient engagement in his or her own health management among chronic patients in China. Further analysis of reliability and validity should be assessed among other patient cohorts in China, and future directions for testing changes after patient engagement interventions should be developed by exploring some clinical relevance.

Comparing t Test, rit Significance Test, and rit Criteria for Item Selection Method: A Simulation Study

Three criteria of items selection have been widely used despite of their limitations without any empirical evidence to support its practice. Current study examined the three criteria to determine which of the three criteria were the best among the others. Those criteria were the item total correlation, its significance by t-test and significance of rit. Simulations were conducted to demonstrate which of the three criteria provided the least errors in both excluding good items and including bad items in the scale. The author manipulate four conditions in conducting simulation study: (a) number of items in a scale; (b) value of rit in population; (c) sample sizes; and (d) criteria in including or excluding items in a scale. The results showed that criteria of rit > .30 provided the least errors of including bad items and excluding good items, particularly when n > 200. The two criteria based on significance test provided the largest errors therefore were not recommended in future practice.

Economic order quantity models for items with imperfect quality and emission considerations

ABSTRACTIncorporation of quality and environmental concerns in production and inventory models has received considerable attention in the inventory management literature; however, researchers studied these topics mostly independently. Thus, it is required to jointly incorporate those two relevant aspects in a single research to support decisions, compare the results and obtain new insights for complexities in practice. This paper takes a step in this line of thought and revisits some economic order quantity (EOQ) models with imperfect quality from a sustainable point of view. The objective is to investigate the impact of emission costs on the replenishment order sizes and the total profit of a buyer (retailer) in an imperfect supply process, where the buyer receives the batches containing a percentage of imperfect quality items. First, an EOQ model with imperfect quality items and emission costs, which are the result of warehousing and waste disposal activities, is formulated. Next, the model is extended to account for the situations where the buyer considers different areas for stocking the imperfect and good quality items, learning occurs in imperfect quality and the inspection process at the buyer's end contains error. The developed models are tested numerically and compared to investigate the optimal policies considering emission costs.

PENGEMBANGAN TES KETERAMPILAN PROSES SAINS DASAR SD/MI

The purpose of this study is to develop an valid and reliable test to measure the student's basic science process skills in elementary school. This is a Research and Development (RaD) study, the research methods used to produce a specific product and test it's effectiveness. To achieve the objectives, the research carried out in two phases, namely the phase of the instrument development process and psychometric analysis phase. The first phase includes: identifying an objective test; specifying the content/content of tests or describe the science process skill that will be tested; arrange grating instruments including indicators of there spective skills and items per indicator; write the item / items according tothe indicators; and perform expert judgment (to convince the face and content validity). The second phase is a psychometric analysis conducted by placing a pilot test. Results of the study are (1). Conduct the first phase of the development of the test, the result is the compilation of 24 multiple-choice items that have been valid after various appropriate revisions by expert advice.(2) conduct the second phase of the test development which is a psychometric analysis by conducting pilot tests to determine the internal reliability while recognizing the difficulty and discrimination level. Items accepted are those that have a level of difficulty, different power, distribution of answers suited to the ideal criteria. The results of this study phase are 10 items test are accepted as good items (item number 1, 2, 7, 8, 9, 15, 17, 18, 22 and 23), 13 items were fixed/revised (item number 3, 4, 5, 6 , 11, 12, 13, 14, 16, 19, 20, 21, 24), and the first question thrown away/not in use (number 10). Level reliability test items is fair (0,524).)

TH‐F‐201‐01: The Problem: Is This a Trick Question?

Multiple choice questions are a tool medical physicists encounter throughout their careers. They are a commonly used method of assessment during our early didactic training (graduate school, residency and board certification). They are used throughout our MOC process both in SAMs and online CE. And they are used for the MOC exam every 10 years. While we have significant training in answering these multiple choice questions, we rarely receive training in how to construct effective multiple choice questions. This is important too, as it is medical physicists who are creating the exams at academic institutions, for the AAPM SAMs and online CE as well as for the ABR exams (both initial and MOC). While there are rigorous scientific methods for evaluating the quality of questions in an exam that has been taken, creating good questions (stem) and multiple choice answers (distractors) requires skill and practice. This talk will cover some of the do's and don'ts for creating good multiple choice questions.Item analysis of answers to multiple choice questions can reveal a great deal about the quality of the questions. Questions can be measured in terms of their difficulty and ability to discriminate between examinees. The distractors themselves can be evaluated for their ability to discriminate as well. And finally the overall test can be evaluated for reliability. We will discuss some of the specifics of item analysis as well as provide guidelines for constructing good tests items. Learning Objectives: Understand rules for writing a good stem Understand rules for writing good distractors

TH‐F‐201‐00: Writing Good Multiple Choice Questions

Multiple choice questions are a tool medical physicists encounter throughout their careers. They are a commonly used method of assessment during our early didactic training (graduate school, residency and board certification). They are used throughout our MOC process both in SAMs and online CE. And they are used for the MOC exam every 10 years. While we have significant training in answering these multiple choice questions, we rarely receive training in how to construct effective multiple choice questions. This is important too, as it is medical physicists who are creating the exams at academic institutions, for the AAPM SAMs and online CE as well as for the ABR exams (both initial and MOC). While there are rigorous scientific methods for evaluating the quality of questions in an exam that has been taken, creating good questions (stem) and multiple choice answers (distractors) requires skill and practice. This talk will cover some of the do's and don'ts for creating good multiple choice questions.Item analysis of answers to multiple choice questions can reveal a great deal about the quality of the questions. Questions can be measured in terms of their difficulty and ability to discriminate between examinees. The distractors themselves can be evaluated for their ability to discriminate as well. And finally the overall test can be evaluated for reliability. We will discuss some of the specifics of item analysis as well as provide guidelines for constructing good tests items. Learning Objectives: Understand rules for writing a good stem Understand rules for writing good distractors

TH‐F‐201‐02: The Solution: The Science Behind Writing Good Questions

Multiple choice questions are a tool medical physicists encounter throughout their careers. They are a commonly used method of assessment during our early didactic training (graduate school, residency and board certification). They are used throughout our MOC process both in SAMs and online CE. And they are used for the MOC exam every 10 years. While we have significant training in answering these multiple choice questions, we rarely receive training in how to construct effective multiple choice questions. This is important too, as it is medical physicists who are creating the exams at academic institutions, for the AAPM SAMs and online CE as well as for the ABR exams (both initial and MOC). While there are rigorous scientific methods for evaluating the quality of questions in an exam that has been taken, creating good questions (stem) and multiple choice answers (distractors) requires skill and practice. This talk will cover some of the do's and don'ts for creating good multiple choice questions.Item analysis of answers to multiple choice questions can reveal a great deal about the quality of the questions. Questions can be measured in terms of their difficulty and ability to discriminate between examinees. The distractors themselves can be evaluated for their ability to discriminate as well. And finally the overall test can be evaluated for reliability. We will discuss some of the specifics of item analysis as well as provide guidelines for constructing good tests items. Learning Objectives: Understand rules for writing a good stem Understand rules for writing good distractors

체육수업 표정정서 인식력 측정도구 개발 및 타당화

The purpose of this study is to develop facial emotional recognition ability scale in physical education and to test reliability and validity of it. To this, The study of the second phase of the scale development phase validity and reliability were conducted. In step 1, the conceptualization of scale, making items, selecting emotional situations in physical education class and making picture items, selecting good picture items, completing preliminary measures and modifying them were conducted and the preliminary version of Facial Emotional Recognition Ability Scale in Physical Education(FERASIPE) including the two sub factors of Facial Emotional recognition ability(FERA) and Situational Emotional recognition ability(SERA) with a total of 47 questions were developed . Step 2, 505 students(M; 353, F; 152) being at 00 middle school in Jinju were completed preliminary FERASIPE for the reliability and validity study. And for validity, to investigate difference in FERASIPE depend on gender, exercise time, emotional intelligence gender, exercise time, emotional intelligence were investigated with FERASIPE. Emotional Intelligence Scale for youth(Moon, 1999) was used to measure emotional intelligence. For reliability and validity analysis, item analysis based on Baker(1985, 2001) was conducted and items lacking of the validity of the reliability were deleted. Item analysis program was used BayesiAn and ANOVAs for the difference of exercise time and emotional intelligence and independent t-test for gender difference in FERASIPE were conducted to use SPSS 18.0 program. Result the 10 questions lacking reliability and validity in the item analysis results are deleted, a total of 37 items(18 facial emotional recognition items, 19 situational recognition items) were a final decision. In emotional recognition ability in physical education, girl students were higher than boy students. A higher group on the emotional intelligence compared with the low group is high in F-E RASIPE. A higher group on exercise time compared with the low groups is high in FERA. but The SERA was no difference. These results demonstrate that the scale developed in this study have a validity and reliability. In terms of difference of gender, exercise time in FERASIPE, the results of this study compared with results of antecedent study were discussed.

An EOQ model with inspection error, rework and sales return

This paper develops an inventory model for the situation where the incoming lot contains a fraction of defectives. The ordered lot is subject to screening process which itself is faulty and hence commits errors, namely, type I error and type II error. Due to type II error, imperfect quality goods are shipped to the customers and are returned back. The defectives (those screened out in the inspection process along with the returned goods) are sent for rework and the demand is met from the inventory of good items till the time they are received back. A closed form solution is obtained for the optimal order quantity and corresponding optimal expected profit is also obtained. A comprehensive sensitivity analysis is performed to observe the effect of changes in various parameters on optimal quantity and profit.

An EOQ model with inspection error, rework and sales return

This paper develops an inventory model for the situation where the incoming lot contains a fraction of defectives. The ordered lot is subject to screening process which itself is faulty and hence commits errors, namely, type I error and type II error. Due to type II error, imperfect quality goods are shipped to the customers and are returned back. The defectives (those screened out in the inspection process along with the returned goods) are sent for rework and the demand is met from the inventory of good items till the time they are received back. A closed form solution is obtained for the optimal order quantity and corresponding optimal expected profit is also obtained. A comprehensive sensitivity analysis is performed to observe the effect of changes in various parameters on optimal quantity and profit.