Good Quality Items Research Articles

Development of Critical Thinking Ability Test using the Rasch Model on Substance Pressure Materials

This study aims to produce an instrument to measure students' critical thinking skills on pressure equipment in class VIII SMP. The type of research used is Research and Development (R&D). The type of research used is research and development (R&D). The test instrument developed was in the form of multiple choice based on eight development steps, namely potential and problems, information gathering, product design, product validation, product revision, product testing, product revision, and final product. Validation of the instrument was developed by 3 validators, namely 2 lecturers of Physics Education at FKIP Tanjungpura University and 1 science teacher at the school. The validation given to the validator is in the form of a material validation questionnaire and question validation. The results of material expert validation data obtained 84.72%, validation obtained from content validation with an Aiken index of 0.78, included in the high category and suitable for use. The results of the data analysis of teacher and student response questionnaires obtained 92.60% and 86.26% categorized as very feasible. The results of construct validity using the Rasch model with the application of Winstep 3.73 obtained result 3, which was declared inappropriate because it did not meet the MNSQ, ZSTD, and Pt Measure Corr criteria. The reliability of the Cronbach alpha test value obtained a value of 0.73 with a fairly high category. Regarding the level of difficulty of the item, 4 question items must be discarded because they are included in the very easy and very easy categories. The overall discriminatory power is in the good category with a discriminatory index of 0.40 DP < 70. The results of the study show that out of 30 things, 23 things are appropriate to be used to measure students' critical thinking skills with good-quality items.

Cognitive Analysis Using Rasch Modeling As an Assessment for Physical Fitness Knowledge for College Students

Having good physical fitness is the foundation for carrying out daily activities. Maintaining physical fitness requires knowledge and understanding for performing meaningful physical activities. This study aimed to analyze the physical fitness knowledge test instrument for college students using the Rasch modelling data analysis technique. The design, development, and research method employed the product model and research tool that consisted of four stages, including analysis, design, development, and evaluation. The samples involved in the instrument trial were 67 students from one university in Indonesia. The analysis used was the content validity ratio for testing content validity and the item response theory/Rasch model test employing Winstep software to determine the validity and reliability of the test instrument. The results of the data analysis showed a match between the students and the test instruments with very good quality items. It concludes that the test instrument development using the Rasch model can detect student misconceptions on physical fitness knowledge material.

Impact of Credit Financing on the Ordering Policy for Imperfect Quality Items With Learning and Shortages

The paper develops an order quantity model with trade credit plus shortages under learning effects for deteriorating imperfect quality products. Generally, when the lot has imperfect items, the inspection of a lot is necessary to improve the quality of the lot. In this article, the seller provides a defective lot to his buyer under credit financing scheme, and after that buyer separates the whole lot under the screening process into two categories, one is defective and the other is non-defective items. The buyer sells out defective items at a low price as compared to non-defective items. It is assumed that customers' demand of good quality items is greater than the inspection rate for the whole lot to neglect the shortages situation. After keeping all points together, the buyer optimized his total profit concerning order quantity and shortage. A suitable numerical example and a sensitivity analysis have been provided for the validity of this model. The aim and utility of this paper have been presented in the conclusion section.

An analysis of item response theory using program R

The test is one of the instruments used to assess the extent of student understanding in learning. Multiple choice is a type of test commonly used in testing students. In addition to testing students' understanding, the quality of the tests used also needs to be tested. This study aims to determine the characteristics of the national mathematics test items in Baubau in the 2015/2016 academic year and the test information function with the item response theory approach. This research is an ex-post-facto study with a sample size of 574 students using a random sampling technique. Data was collected through documentation and analyzed using the LTM R package program. Findings indicated that there were four items (I1, I2, I4, and I8) for the 1-PL model, six items (I1, I2, I4, I7, I8, and I10) for the 2-PL model, and seven items (I1, I2, I3, I4, I7, I9, and I10) (3-PL) that fit the model (FM). The percentage of good (G) item parameters using R was 90% for (b) (1-PL), 90% (b) and 100% (a) (2-PL), and 90% (b), 10% (a), and 70% (c) (3-PL). The percentage of good quality items in each model for the 1-PL model was 40% or four items, the 2-PL model was 60% or six items, and the 3-PL model was 0%, or none was included in the good quality item category.

ASSESSMENT OF MULTIPLE CHOICE QUESTIONS TEST ITEM QUALITY AFTER POST EXAM ITEM ANALYSIS

Item analysis is the collection, summarization and utilizing information from students' responses to assess the quality of test items. The item statistics can distinguish between good items and those that need improvement or deletion from question bank. Our aim is to assess the quality of the summative Multiple Choice Questions (MCQs) for all courses of the M.B.B.Ch program before and after staff awareness campaign, College of Medicine, Taibah University, KSA, 2020. This study is a Quasi-experimental pre-post test study design and was conducted in 4 stages, collection of the MCQ exams, conduction of Awareness campaign on how to benet the post-exam item analysis, Re-collection and analysis of the post-exam item analysis and Finally, the results of the post exam item analysis of both academic years were compared to detect any changes in the items quality. showed that there were marked improvement of good quality items after awareness campaign especially in the Pre-clinicalResults courses than clinical ones IN Item analysis when regularly incorporated can help to develop a very useful, valid and a reliable questionConclusion bank by changing awed items either by rectied or deleted from the question bank

Barriers And Facilitators To Write Good Quality MCQS For Dental Assessments: A Qualitative Case Study.

To explore barriers and facilitators to write good quality items for undergraduate dental assessments. A qualitative case study was conducted from Feb-April 2021. Semi-structured interviews were conducted with a purposive sample of eighteen item writers from a public-sector dental institute of Rawalpindi, Pakistan. The data were transcribed verbatim and thematically analyzed to extract themes regarding barriers and facilitators to write good quality items. All quality assurance procedures of qualitative research were ensured during the research process.. Five themes related to barriers and three themes related to facilitators to write good quality items emerged from the data. The participants reported more barriers such as lack of frequent training and lack of peer review and feedback. Other barriers were demotivation due to lack of acknowledgement or monetary incentives, lack of content and construct expertise, clinical workload, and contextual barriers such as lack of internet facility, outdated library, and lack of place and time allocation for item construction. Facilitators were availability of peer review, feedback from post-hoc analysis, motivation due to the senior designation, clinical experience, and ample time for basic sciences faculty. Frequent item writing training, strong peer review process, pre-exam item vetting by the dental education department, and institutional improvements such as striving for content experts, time and place allocation for item construction, internet facility, updated library, and equal distribution of workload among faculty could enhance the quality of items. Moreover, ways to inculcate motivation among item writers such as appreciation or monetary incentives could be used to improve the quality of undergraduate assessments.

Development of Order Quantity Optimization Model for Growing Item Considering the Imperfect Quality and Incremental Discount in Three Echelon Supply Chain

This research develops an optimization model for determining the order quantity for growing items by considering the imperfect quality and incremental discount by involving three supply chain members: farmers, processors, and retailers. The farmers are responsible for caring for the newborn items until they reach their ready-to-eat weight. The processors perform two roles, namely processing and screening. In the processing role, the processors process the grown items by a slaughtering and packaging process. Afterward, they inspected the processed items and categorized the items into good and poor quality. Finally, they shipped the end products to retailers. The retailers are responsible for selling good-quality items to the final consumers. This research considers two kinds of poor quality. First is the poor quality of growing items in terms of mortality rate. The second is the poor quality of final products on the processor side. The processed items with poor quality are then sold to the secondary market at lower prices in one batch at the end of the period. This model also considers the incremental discounts offered by vendors to farmers and retailers to consumers for specific amounts of purchases. The model's objective function is to maximize the total supply chain profit, with the number of orders quantity, cycle time, and the number of batches delivery set as the decision variables. The sensitivity analysis results show that the most sensitive parameter in the model is the probability that the live items survive throughout the growth period.

Utilizing test items analysis to examine the level of difficulty and discriminating power in a teacher-made test

Apart from teaching, English language teachers need to assess their students by giving a test to know the students� achievements. In general, teachers are barely conducting item analysis on their tests. As a result, they have no idea about the quality of their test distributed to the students. The present study attempts to figure out the levels of difficulty (LD) and the discriminating power (DP) of the multiple-choice (MC) test item constructed by an English teacher in the reading comprehension test utilizing test item analysis. This study employs a qualitative approach. For this purpose, a test of 50-MC test items of reading comprehension was obtained from the students� test results. Thirty-five students of grade eight took part in the MC test try-out. They are both male (15) and female (20) students of junior high school 2 Kempo, in West Nusa Tenggara Province. The findings revealed that16 items out of 50 test items were rejected due to the poor and worst quality level of difficulty and discriminating index. Meanwhile, 12 items need to be reviewed due to their mediocre quality, and 11 items are claimed to have good quality items. Besides, 11 items out of 50 test items were considered as the excellent quality as their DP scores reached around 0.44 through 0.78. The implications of the present study will shed light on the quality of teacher-made test items, especially for the MC test.

Exploring the barriers that influence intention to donate and role of the charity shop within the multi-tier supply chain

PurposeHumanitarian relief organisations such as charities count on donations to provide assistance to people in need when disasters occur. In the UK, about 11,200 charity shops collect second-hand goods from donors to raise funds for their parent charity to support target beneficiaries. As their numbers increase, charity shops are finding it difficult to secure good quality stock. Furthermore, they may need to plan ahead to secure sufficient stock when the economy experiences a downturn. This paper identifies the charity shop's role and its donation flow in the multi-tier supply chain and empirically assesses the barriers that influence intention to donate with a mixed-methods approach.Design/methodology/approachIn order to explore the charity shop's role within the multi-tier supply chain, this study begins with a literature review and then develops a conceptual model. In order to empirically evaluate the barriers that influence intention to donate, the authors conducted semi-structured interviews with 14 charity shop managers and collected 222 usable questionnaires from donors. The interpretive structural modelling (ISM) approach was applied to examine the interrelationship among barriers and rank their priority.FindingsThis paper identifies ten significant barriers that influence intention to donate: lack of good quality items for donation; lack of information on how charity shops make use of donations; lack of familiarity with the donation process; lack of information of what items can be accepted by charity shops; lack of awareness of the impact that donations make; the difficulty of being available at the scheduled times for charity shops' free pick-up services; the difficulty of donating during shops' opening hours; the difficulty of finding parking to access charity shops; and living too far away from charity shops. In particular, the questionnaires' results indicate that lack of good quality items is the most significant barrier. This is also reflected in the ISM model, and thus needs more attention.Practical implicationsThe results are very useful for charity shops themselves to understand current barriers to securing good quality stock and to develop potential stock-securing interventions based on these barriers' priority.Originality/valueAlthough charity shops have been investigated by several researchers, their supply chain remains insufficiently explored. This paper fills this gap by identifying the charity shop's role and its donation flow in the supply chain and by empirically assessing the supply-side barriers with a mixed-methods approach.

Ordering policies for deteriorating imperfect quality items with trade-credit financing under learning effect

In obedience with the economic order quantity model, the ordered lot has 100% good quality items, but this is only suppositional. On examination, it is learnt that some of the produced lots have defective items because of process retrogression and other such factors. Thus, in this situation, the inspection of lots is essential for all organizations when the items are deteriorating in nature. Owing to this fact, an inventory model is proposed for deteriorating items with in-process inspection with learning effect under permissible delay in the payments. The aim of this paper is to study the impact of learning on the ordered quantity under the influence of trade-credit financing. Finally, the expected total profit function is maximized with respect to order quantity under credit financing. This paper, which is an extension of Patro et al. (Int J Manag Decis Mak 17(2): 171–198, 2018) commendable work, makes significant use of permissible delay in payment and proposed an inventory model for deteriorating imperfect quality items with learning effect. A numerical example given ahead shows the verification of results. Results suggest that impact of trade-credit policy is positive on the proposed inventory model. The effect of key parameters on the model is studied by sensitivity analysis to deduce managerial insights.

An Analysis of High Order Thinking Skills Aspects on the Assessment Instruments Environmental Change Topic for the 10th GradeSenior High School Students

High level learning ability (HOTS) is the ability of students to be critical and creative thinking skills. In 2013, students were required to be able to receive information and remember it, but students must be able to solve the problems they faced with the knowledge they needed. Based on observations, the instruments used by teachers are still at the level of C1-C3, while for high-level thinking abilities students must be able to think at the C4-C6 level. This study aims to analyze the ability of high-level thinking of students on material changes in the environment. The assessment instrument used is an instrument of assessment of high-level thinking ability that is valid, practical, reliable and has good quality items. The instrument is said to be valid if the instrument can measure what should be measured. The practicality of the assessment instrument depends on how easily the instrument is used to assess students' abilities. Reliable means that the instrument gives the same results when tested in the same group at different times. An instrument that has good quality items is an instrument that has a moderate level of difficulty and sufficient differentiation, good and very good. Based on the results of the test questions, the average value of students is 41.37 which is still categorized as low. The low level of students' high-level thinking skills can be improved by familiarizing students with higher-order thinking and using scientific learning models.

A supply chain model under return policy considering refurbishment, learning effect and inspection error

This article presents a three-echelon supply chain model consisting of a supplier, manufacturer, and a retailer, considering the return contract between the manufacturer and the retailer. Here, the manufacturer has two adjacent production units - the main production unit and a refurbishment unit. The main production unit of the manufacturer is imperfect, which produces an admixture of perfect and defective items. He inspects all the products immediately after production and sells good quality items to the retailer. The retailer receives a proportion of faulty products from him due to his erroneous inspection process, which he returns after inspection. The manufacturer sends all the defective products received from the retailer and the main production unit to the refurbishment unit for reworking. Moreover, the learning effect of the employees on the production cost is considered. Under these circumstances, the cost functions of each of the supply chain players have been derived. Finally, the applicability of the proposed model has been shown using a numerical example. The sensitivity analysis has been presented to study the effect of the parameters on the optimum decision variables.

Reorder point for the EOQ inventory model with imperfect quality items

Abstract In today’s competitive business environment, every manufacturing organization desires to produce good quality items. Likewise, customers are also more concern with the quality of the item, which led to the increased competition among the organizations in ensuring that manufacturers are producing high-quality items. However, in reality, every manufacturing system encounters flawed productions. Keeping this in mind, there exists an economic batch quantity inventory model indicting should any received or produced items are imperfect. The study triggered a significant trend towards the economic lot size model for imperfect items. This research calculates optimal reorder point for Salameh and Jaber [12] ’s inventory model, which is a critical milestone for managers to determine the appropriate timing of an order. Then, a numerical example is solved to obtain the optimal reorder point under different situations. In this study we obtained the reorder point and managerial decisions to control system volatility.

An Analysis of validity of test items in chemistry final semester examination for vocational students majoring in computer and networking engineering in Bantul Regency

This research aims to investigate the quality of final examination test items given to the Computer and Networking Engineering students. The test items were developed by four chemistry teachers in the state vocational school (SVS) and private vocational school (PVS) in Bantul regency respectively. This research discusses on the quality of the test conducted and overall items developed by the chemistry teachers for both of SVS and PVS. The quality of the test items is measured by using four variables which are (1) material, construction, and language aspects, (2) cognitive level comparison, (3) the suitability of the materials tested to the materials covered in 2013 Curriculum, and (4) the suitability of the number of the test items given to the materials covered and time allocated. Ex-post facto research design was administered for this research. The sample of the research was taken from the final examination test items for the 10th grade vocational school students of the Computer and Networking Engineering in Bantul regency for 2017/2018 academic year. The schools that involved in this research were represented by four schools for each of the SVS and PVS. The quality of the final examination test items was measured by using the instrument that was validated by three lecturers who are specialized in chemistry education. Each variable was analyzed descriptively using performance average. For variable 1, it was found that the quality of material, construction, and language of the final examination test items for both schools’ categories were very good. For variable 2, the quality of cognitive level of the final examination test items by SVS was very poor but poor for the PVS. However, it was a reversal for variable 3, when the PVS was very good prevailed by the mean percentage of the suitability of the materials tested to the materials covered in 2013 Curriculum compared to the SVS which was only in good category. For variable 4, the suitability of the number of test items given to the materials covered and time allocated, the mean percentage in SVS was very poor but poor for PVS. In conclusion, the overall of the quality test items developed by both the SVS and PVS chemistry teachers, was in good category for variables 1 and 3, and poor for variables 2 and 4. To conclude, this research able to observe that vocational school chemistry teachers for both SVS and PVS are able to construct good quality and appropriate test items.

Improvement of Faculty’s Skills on the Creation of Items for Progress Testing Through Feedback to Item Writers: a Successful Experience

Abstract: The evaluation of knowledge is an important step in the teachers’ work, because it is fundamental that the evaluation results be valid and reliable. Several faculty development programs have been undertaken to improve teachers’ skills on item writing. Few studies, however, have explored the benefits of providing feedback to multiple-choice item writers. Progress Testing is a longitudinal assessment of students’ knowledge gain. Their results are useful for generating feedback to students, teachers and medical school managers. The aim of this report is to present a successful experience of faculty development on high-quality item writing for Progress Testing through feedback about the fate of the items written by faculty members. Annually, faculties from medical schools participating in a consortium for the application of the Progress Test are asked to formulate new items to compose the test version. However, the fate of the items is not known by their authors, that is, they do not know if the items are incorporated into the test, if the items have good quality, what is the students’ performance in each of the items, and what is the psychometric function of the items. In 2017, one of the schools participating in the consortium offered its item authors a feedback regarding the flaws in item writing, modification of items by the review committee and students’ performance, as well as psychometric function in each item. The percentage of flawed item (items without enough quality to be selected for the test) was more than 30%. There was an inverse relation between the number of flawed item and the number of items included in the final exam, when analyzing the different content areas of the test (that is, Internal Medicine, Surgery, Pediatrics, Obstetrics and Gynecology, Public Health, and Basic Sciences). In the following year, we observed a decrease in the number of flawed item (less than 10%) and an increase in the number of eligible items to be selected for the Progress Testing. Therefore, giving feedback to item writers seems to be a good strategy for developing the faculty’s ability on writing good quality items.

Analisis Butir Soal IPS Kelas V Sekolah Dasar Menggunakan Software ITEMAN

The assessment process did not end by only making questions. They will arrive at the analysis of the questions quality. Item analysis is performed to determine the quality of the questions items arranged. Good quality items will greatly affect the results of the assessment and properly capturing the results of learning. The purpose of this study is to analyze the Social Sciences question items for fifth grade of elementary school using the classic ITEMAN focusing on the characteristics of the level of difficulty, the discrimation power, and the functioning of distractor of items. This research is a descriptive study with quantitative research. Subjects were 370 elementary school students in Serang City. The instrument analuzed was made in the form of 20 items of multiple choices with four answer option. The instrument was validated by the content expert and estimated the reliability by using the KR-20 method by reliability index of 0.75 obtained. The data analysis technique used ITEMAN software to see the characteristics of items that contain the level of difficulty, discrimination power and disctractor’ function. The results showed that 80% of the difficulty level were in the medium category, 90% of the dircrimination power items were in the good category, and 90% of the distractors had well-fuctioned. This result indicated that the question created by teacher for fifth grade of elementary school in Serang City concluded as good category.

Barriers and facilitators to writing quality items for medical school assessments \u2013 a scoping review

BackgroundProducing a sufficient quantity of quality items for use in medical school examinations is a continuing challenge in medical education. We conducted this scoping review to identify barriers and facilitators to writing good quality items and note gaps in the literature that are yet to be addressed.MethodsWe conducted searches of three databases (ERIC, Medline and Scopus) as well as Google Scholar for empirical studies on the barriers and facilitators for writing good quality items for medical school examinations.ResultsThe initial search yielded 1997 articles. After applying pre-determined criteria, 13 articles were selected for the scoping review. Included studies could be broadly categorised into studies that attempted to directly investigate the barriers and facilitators and studies that provided implicit evidence. Key findings were that faculty development and quality assurance were facilitators of good quality item writing while barriers at both an individual and institutional level include motivation, time constraints and scheduling.ConclusionsAlthough studies identified factors that may improve or negatively impact on the quality of items written by faculty and clinicians, there was limited research investigating the barriers and facilitators for individual item writers. Investigating these challenges could lead to more targeted and effective interventions to improve both the quality and quantity of assessment items.

Economic order quantity model for growing items with imperfect quality

While the basic economic order quantity model has found some practical applications, it makes a number of assumptions which do not reflect most real life inventory systems. This paper proposes an inventory system where the items ordered are capable of growing during the course of the inventory replenishment cycle, for example livestock. Furthermore, it is assumed that a certain fraction of the items is of poorer quality than desired. It is also assumed that live newborn items are ordered and fed until they grow to a customer-preferred weight, after which they are slaughtered. Before all the slaughtered items are put on sale, they are screened so as to separate the good quality items from those of poorer quality. In order to determine the optimal inventory policy, a model, which aims to maximize the expected total profit, is developed and numerical examples are provided to illustrate the model and the solution procedure. The logistic growth function is compared to the linear and split linear growth functions. The margin of error between the results of the split linear function and the logistic growth function were found to be smaller than between the logistic and linear function. In addition, it was found that the optimal order quantity was most sensitive to the target slaughter weight.

Characteristics and equation of accounting vocational theory trial test items for vocational high schools by subject-matter teachers' forum

This study is aimed at: (1) understanding the characteristics of Accounting Vocational Theory trial test items using the Item Response Theory and (2) determining the horizontal equation of Accounting Vocational Theory trial exam instruments. This was explorative-descriptive research, observing the subject of the eleventh-grade students. The research objects were test instruments and responses of students from six schools selected through the stratified random sampling technique. The data analysis employed review sheets and BILOG program for the Item Response Theory 2PL. The findings were as follows. (1) The test item review of test packages A and B found 37 good quality items, the Item Response Theory using 2PL showed that Package A Test generated 27 good questions, Package B Test contained 24 good questions. (2) The question equating using the Mean/Sigma method resulted in the equation of = 1.168bx + 0.270, with the Mean/Mean method resulting in the equation of = 0.997bx - 0.250, the Mean/Mean method at 0.250, while Mean/Sigma method at 0.320.

Item Analysis of Preparation Test for English National Examination

<p>This research aims to reveal the quality of English national<strong> </strong>examination preparation test in terms of qualitative and quantitative aspects. Qualitative aspect includes content validity, technical item quality and cognitive domain learning outcome while quantitative aspect include reliability, difficulty level, item discrimination, and distractor effectiveness. Sample was taken from 3 out of 10 schools in Pati district using simple random sampling. This research employs both qualitative and quantitative analysis in which expert judgement is used to analyze content validity and technical item quality while ITEMAN is used for quantitative analysis. The result showed that the test has good content validity, 99.06% items appropriate with competence being measured, good technical item quality and most items (81.13%)are categorized as cognitive domain learning outcome C2 (Understand). Moreover, the test has high reliability index (> 0.8), fair difficulty, and good discrimination. However, 35.85% items have ineffective distractors.</p>