Quality Items Research Articles

Utilizing network analysis to identify core items of quality of life for children with autism spectrum disorder.

The purpose of this study was to develop and validate an ultra-short scale called the Quality of Life for Children with Autism Spectrum Disorder 3 (QOLASD-C3) from the full 16-item QOLASD-C scale. We first used network analysis to identify three core items to be retained on the QOLASD-C3 scale. Second, we used Cronbach's alpha and Pearson Product Moment correlations to determine the reliability and validity of the scale. Third, an optimal cut-off score of 6 was identified for the using receiver operating characteristic curve analysis. Finally, we used logistic regression to examine the similarities in the classification status based on demographic characteristics between the quality of life (QOL) status using the QOLASD-C and the QOLASD-C3 scales. Results were similar across the two versions and suggested variations in QOL status based on race/ethnicity, autism spectrum disorder (ASD) severity, and parents' socio-economic status. Implications for research and practice are discussed.

Utility of large language models for creating clinical assessment items

Purpose To compare student performance, examiner perceptions and cost of GPT-assisted (generative pretrained transformer-assisted) clinical and professional skills assessment (CPSAs) items against items created using standard methods. Methods We conducted a prospective, controlled, double-blinded comparison of CPSA items developed using GPT-assistance with those created through standard methods. Two sets of six practical cases were developed for a formative assessment sat by final year medical students. One clinical case in each set was created with GPT-assistance. Students were assigned to one of the two sets. Results The results of 239 participants were analysed in the study. There was no statistically significant difference in item difficulty, or discriminative ability between GPT-assisted and standard items. One hundred percent (n = 15) of respondents to an examiner feedback questionnaire felt GPT-assisted cases were appropriately difficult and realistic. GPT-assistance resulted in significant labour cost savings, with a mean reduction of 57% (880 GBP) in labour cost per case when compared to standard case drafting methods. Conclusions GPT-assistance can create CPSA items of comparable quality with significantly less cost when compared to standard methods. Future studies could evaluate GPT’s ability to create CPSA material in other areas of clinical practice, aiming to validate the generalisability of these findings.

Role of Small-Scale Industries Development and Management in India

Objectives: The hierarchical review did in Kerala SIDCO was fruitful in accomplishing the particular targets. It assisted with acquainting with the association design and it's working It additionally assisted with acclimating with the various divisions in the association and their capabilities and exercises including documentation. Methods: They have seen many all over in market still they have become effectively. The purpose for it is the administration and the specialists mutually cooperate for the kindness and for the benefit of the organization on occasion it required most. Most they has given just great quality items to the clients as indicated by the necessities of the clients. Results: The review assisted with understanding how the key business process are completed in an association and how data is utilized in association for decision making at different levels. The review was effective in figuring out the degree of innovation in the association for different capabilities and exercises. [14] Conclusion: This study helped in further developing information. The association study was useful as it assisted with acquiring certainty and mindfulness.

A new Q-matrix validation method based on signal detection theory.

The Q-matrix is a crucial component of cognitive diagnostic theory and an important basis for the research and practical application of cognitive diagnosis. In practice, the Q-matrix is typically developed by domain experts and may contain some misspecifications, so it needs to be refined using Q-matrix validation methods. Based on signal detection theory, this paper puts forward a new Q-matrix validation method (i.e., method) and then conducts a simulation study to compare the new method with existing methods. The results show that when the model is DINA (deterministic inputs, noisy 'and' gate), the method outperforms the existing methods under all conditions; under the generalized DINA (G-DINA) model, the method still has the highest validation rate when the sample size is small, and the item quality is high or the rate of Q-matrix misspecification is ≥.4. Finally, a sub-dataset of the PISA 2000 reading assessment is analysed to evaluate the reliability of the method.

Analysis of biology midterm exam items using a comparison of the classical theory test and the Rasch model

In biology learning, test instruments are essential for assessing students' understanding of complex concepts. A test instrument is a crucial factor in learning evaluation; however, its implementation remains minimal. This descriptive quantitative study aims to analyze the quality of test items using the classical approach in terms of validity, reliability, difficulty index, discrimination power, distractor effectiveness, and the Rasch model analysis. The data consists of 30 multiple-choice questions from a biology midterm exam administered to 40 students. Classical test data analysis uses Microsoft Excel, while Rasch model analysis uses Winsteps software. The validity test results from both approaches show 14 valid questions and 16 invalid ones. The reliability scores are 0.619 (adequate) for the classical approach's Cronbach's Alpha, 0.85 (good) for the Rasch model, and 0.65 (weak) for personal reliability. The classical test theory and the Rasch model categorize item difficulty into four levels. The classical approach produces five categories for item discrimination, while the Rasch model identifies three groups based on the item separation index (H=3.45) and two groups based on respondent ability (H=1.96). Distractor effectiveness shows 93.3% functional distractors in the classical test and 80% in the Rasch model. The Rasch model offers greater precision in measuring student ability and detecting bias. Both models should be integrated for comprehensive item analysis. Future tests should focus on improving invalid items and the quality of distractors.

Memetic ant colony optimization for multi-constrained cognitive diagnostic test construction.

Cognitive diagnostic tests (CDTs) assess cognitive skills at a more granular level, providing detailed insights into the mastery profile of test-takers. Traditional algorithms for constructing CDTs have partially addressed these challenges, focusing on a limited number of constraints. This paper intends to utilize a meta-heuristic algorithm to produce high-quality tests and handle more constraints simultaneously. This paper presents a memetic ant colony optimization (MACO) algorithm for constructing CDTs while considering multiple constraints. The MACO method utilizes pheromone trails to represent successful test constructions from the past. Additionally, it innovatively integrates item quality and constraint adherence into heuristic information to manage multiple constraints simultaneously. The method evaluates the assembled tests based on the diagnosis index and constraint satisfaction. Another innovation of MACO is the incorporation of a local search strategy to further enhance diagnostic accuracy by partially optimizing item selection. The optimal local search parameter settings are explored through a parameter investigation. A series of simulation experiments validate the effectiveness of MACO under various conditions. The results demonstrate the great ability of meta-heuristic algorithms to handle multiple constraints and achieve high statistical performance. MACO exhibited superior performance in generating high-quality CDTs while meeting multiple constraints, particularly for mixed and low discrimination item banks. It achieved faster convergence than the ant colony optimization in most scenarios. MACO provides an effective solution for multi-constrained CDT construction, especially for shorter tests and item banks with mixed or lower discrimination. The experimental results also suggest that the suitability of different optimization approaches may depend on specific test conditions, such as the characteristics of the item bank and the length of the test.

Development and Validation of Sensitivity for Needs of Elderly Scale Among Caregivers Based on Maslow’s Theory

The world currently lives in an aging society. Demand for elderly caregivers and services is rapidly rising. Elderly care encompasses not only medical care, but also the art of human care. Love and respect are usually considered the backbone of the modality of caregivers. This study aimed at developing a sensitivity for needs of elderly scale (SNES) among caregivers. Maslow’s theory of hierarchical needs, especially stage 3 (love and belongingness needs) and stage 4 (esteem needs), was used as a conceptual framework. This study consisted of four steps. The sample groups for the first two steps of item quality and exploratory factory analysis were 420 nursing students. A three-factor model emerged, which includes the sensitivity of needs for love and empathy, the sensitivity of needs for respect, and the sensitivity of needs for honor and dignity. The newly constructed measure consisted of 10 items, which explained the variance by 52.18%. The third step of confirmatory factor analysis, using a new group of 384 nursing students, indicated the model fit. In the final step, the scale was validated using 171 elderly caregivers. Moderate to strong absolute magnitudes of correlations between the new scale and psycho-moral strength, core self-evaluation, future orientation and self-control, moral disengagement, and caring behavior were found. Incremental validity was tested. Discussion and recommendations for further research and implications of the newly constructed measure were offered.

Development and validation of a conceptual test for the human circulatory system

Current biology assessments often lack a strong emphasis on conceptual understanding, which may limit students' ability to apply knowledge in real-world contexts. This study aimed to develop and validate a concept test to assess high school student's understanding of the human circulatory system. The test was carefully designed using the revised Bloom's Taxonomy and aligned with the K-12 curriculum. Initial content validation by biology education experts ensured accuracy and relevance, leading to refinements in the test items. Item quality was enhanced through dichotomous Rasch analysis following preliminary testing with 100 students. After a second administration to a new group of 100 students, further analysis confirmed the test's reliability and validity. A final round of testing with an additional 100 students yielded a Cronbach's alpha of 0.79, confirming internal consistency. The study concluded that the developed concept test is valid and reliable for assessing students' understanding of the circulatory system, providing teachers with a tool to refine instructional methods. Future recommendations involve expanding and updating test items to ensure relevance, integrating technology-enhanced questions to improve the assessment of student comprehension, and evaluating reliability across diverse contexts.

Increased accessibility of computer-based testing for residency application to a hospital in Brazil with item characteristics comparable to paper-based testing: a psychometric study

With the coronavirus disease 2019 pandemic, online high-stakes exams have become a viable alternative. This study evaluated the feasibility of computer-based testing (CBT) for medical residency applications in Brazil and its impacts on item quality and applicants’ access compared to paper-based testing. In 2020, an online CBT was conducted in a Ribeirao Preto Clinical Hospital in Brazil. In total, 120 multiple-choice question items were constructed. Two years later, the exam was performed as paper-based testing. Item construction processes were similar for both exams. Difficulty and discrimination indexes, point-biserial coefficient, difficulty, discrimination, guessing parameters, and Cronbach’s α coefficient were measured based on the item response and classical test theories. Internet stability for applicants was monitored. In 2020, 4,846 individuals (57.1% female, mean age of 26.64±3.37 years) applied to the residency program, versus 2,196 individuals (55.2% female, mean age of 26.47±3.20 years) in 2022. For CBT, there was an increase of 2,650 applicants (120.7%), albeit with significant differences in demographic characteristics. There was a significant increase in applicants from more distant and lower-income Brazilian regions, such as the North (5.6% vs. 2.7%) and Northeast (16.9% vs. 9.0%). No significant differences were found in difficulty and discrimination indexes, point-biserial coefficients, and Cronbach’s α coefficients between the 2 exams. Online CBT with multiple-choice questions was a viable format for a residency application exam, improving accessibility without compromising exam integrity and quality.

An Analysis of English Mid-Term Test Items at the 7th Grade Students of SMPN 7 Bukittinggi

This study was motivated by several problems, such as the mismatch between the test questions and the material learned, unclear question instructions, and the lack of statistical analysis by English teachers. The main objective of this study was to identify the quality of English midterm test items for grade 7th students at SMPN 7 Bukittinggi, focusing on Validity, Reliability, difficulty level, Discrimination Power, and Distractor Effectiveness. The research method used was Quantitative Descriptive, with data collection through student answer sheets and analysis using various statistical formulas, including Point Biserial Correlation for validity, Spearman-Brown for reliability, and Narsya's formula for difficulty level and differentiating power, as well as Djumingin's formula for effectiveness. The results showed that most of the items were valid, and reliable, had a moderate difficulty level, and had good discriminating power, with only a few items showing minor problems. Overall, the English midterm exam items were considered good quality.

A Large Language Model and Qualitative Comparative Analysis-Based Study of Trust in E-Commerce

The primary goal of this study is to predict and analyze customer trust in e-commerce by leveraging neural computation within large language models (LLMs) alongside configurational approaches. We employ LLMs to predict trust levels based on customer reviews, applying artificial intelligence to analyze key aspects of the e-commerce experience, such as customer service, refund processes, item quality, and shipping. To extend beyond predictive performance, we integrate Qualitative Comparative Analysis (QCA) to identify the causal relationships between trust and various stages of the customer journey, including selection, delivery, and post-purchase support (recovery). This dual approach not only showcases the power of neural computation in predicting trust outcomes but also provides a deeper understanding of how specific configurations of customer experience elements contribute to either positive or negative trust. By combining machine learning techniques and QCA, this study contributes to the application of LLMs and configurational approaches, offering novel insights into the drivers of trust in e-commerce.

Cardioneuroablation for the treatment of carotid sinus syndrome

Abstract Introduction Carotid sinus syndrome (CSS), characterized by exaggerated vagal responses leading to asystolic pauses with carotid sinus massage (CSM), often necessitates pacemaker implantation. This study investigates cardioneuroablation (CNA) as an alternative management strategy for CSS. Methods Prospective study of consecutive patients referred for CNA. All patients underwent CSM, atropine test, 24-hour Holter monitoring and SF-36 quality of life questionary before the procedure and at 6 months. The objective of the study was to assess syncope free survival, grade of cardioinhibition with CSM and heart rate variation (HRV) and quality of life after the procedure. Results A total of 13 patients (84.6% male, mean age 63.8 ± 12.3 years) were included. After a median follow-up of 11.2 (10.6-16.3) months, none of the patients experienced syncope (0%) and none of the patients required pacemaker implantation. After the procedure all the patients had a negative CSM and only one patient (7.7%) had a positive CSM at 6 months (Figure 1). There was an improvement in the energy and health change items in the SF-36 quality of life questionary (Figure 2). There was a reduction in HR increase in the atropine test at 6 months (pre-CNA: 66% (52-84) vs. post-CNA 27.4% (21.9-90.9); p=0.027) and in most of the 24-hour Holter monitoring HRV parameters. Conclusions Cardioneuroablation emerges as a promising and effective alternative to pacemaker implantation in managing cardioinhibitory CSS. Further research is warranted to solidify these findings and explore the long-term effects of CNA in this scenario.Figure 1Figure 2

The relationship between health literacy level and quality of life in bariatric surgery patients

Abstract Background Today, obesity is an important public health problem. In addition to the intervention programmes developed to prevent obesity, the necessity of medical and surgical treatment is increasing with the growing population. This study was conducted to determine the relationship between health literacy and quality of life in patients undergoing bariatric surgery. Methods This cross-sectional study was conducted with the participation of 136 patients aged 18 years and older who underwent bariatric surgery in a general surgery service between January 2021 and December 2023 and whose contact information was available. The survey participation rate was 75.1%. The questionnaire used for data collection consisted of questions about the sociodemographic information of the participants, The European Health Literacy Survey Questionnaire (HLS-EU-Q16) and the Postbariatric Surgery Quality of Life Scale items. Descriptive statistics, Mann Whitney U, Kruskal Wallis H test and Spearman correlation analysis were used to analyze the data. A value of p < 0.05 was considered statistically significant. Results The mean age of the patients who participated in the study was 38.2 ± 10.8 years; mean BMI was 42.3 ± 6.4 before surgery and 29.0 ± 6.2 after surgery. In the study, 44.1% of the patients who underwent bariatric surgery were found to have inadequate/problematic health literacy level. Participants who had less than a bachelor’s degree (p = 0.009) and low income (p < 0.001) had significantly lower health literacy levels. In addition, a moderate positive correlation was found between overall health literacy score and quality of life score (r = 0.252; p = 0.003). Conclusions In conclusion, this study shows that improved health literacy positively affects quality of life in patients undergoing bariatric surgery and that health literacy education should be emphasized in this context. Key messages • The level of health literacy of bariatric surgery patients is a determining factor on quality of life, and therefore health literacy education is important, especially in identified risk groups. • Increased health literacy can have positive results in terms of psychosocial and physical health and improve quality of life after bariatric surgery.

Analysis of volatile compound metabolic profiles during the fermentation of filler tobacco leaves through integrated E-nose, GC–MS, GC-IMS, and sensory evaluation

Tobacco is an agricultural commodity with great economic significance. Producers recognize that the flavor characteristics of filler tobacco clear-out (FTLs) affect the quality of cigar tobacco items. To identify the major volatile organic compounds (VOCs) responsible for differences in FTLs, E-nose, HS-SPME-GC–MS, and HS-GC-IMS were employed for multi-dimensional analysis of nine groups of FTLs at various fermentation stages. The E-nose results indicated a progressive increase in nitrogen-oxygen compounds during fermentation. Coupled with these findings, HS-SPME-GC–MS identified 56 VOCs, and HS-GC-IMS revealed 55 VOCs in the FTLs. Principal component analysis (PCA) suggested that FTLs from various fermentation stages of the Yunxue No 39 tobacco plant exhibit significant differences. Partial least squares discriminant analysis (PLS-DA), along with the variable importance in projection (VIP) method for feature selection, pinpointed 12 VOCs as the essential unmistakable metabolites embroiled within the agrarian fermenting prepare of matured FTLs. During the fermentation process, these crucial metabolites are predominantly enriched in pathways including pyruvate metabolism, phenylalanine metabolism, as well as nicotinate and nicotinamide metabolism. The study provides insights into the differences and diversity of FTLs at agricultural fermentation stages. It offers valuable information for optimizing the quality of agricultural fermentation and guiding the directional fermentation of tobacco leaves.

Managing Peer-Feedback Resistance In Pre-Service Language Testing And Evaluation Course

This study is situated within the English language testing and evaluation course, integral to the English language teaching curriculum, wherein senior-year preservice teachers are involved in designing language exams as a part of their evaluation criteria. They actively engage in reciprocal peer feedback sessions aimed at identifying weaknesses and problems in the exams to enhance the quality, validity, and reliability of test items, thereby cultivating an environment favorable to enhanced learning and the effective incorporation of feedback. Employing a micro-analytic approach, conversation analysis, to closely examine the interactions of preservice teachers, the study has revealed that peer groups follow a set of principles on language testing and assessment as they critically engage in delivering feedback to one another. However, recognized for its inherently problematic nature due to the emotional investment involved in feedback exchanges, interlocutors may experience high levels of anxiety and defensiveness while their work undergoes a detailed review (Pekrun et al., 2002, 2011). Accordingly, the study's main findings discovered the emergence of resistance and misalignment among peers during the feedback exchanges, leading to sequence expansion, including evaluation, justification, and recommendation until a joint consensus is achieved. Despite extensive research on resistance encounters in medical interviews, couples counseling, post-feedback sessions, and service encounters, the field remains notably deficient in studies examining peer feedback interactions in the higher education context among preservice language teachers. Therefore, this study aims to fill this gap by examining the dynamics of peer feedback interactions among preservice teachers, shedding light on how resistance to feedback unfolds among peers and is managed through the emergent phenomenon, reference to testing principles.

Development of Three-Tier Diagnostic Test to Measure Misconceptions of Grade 5 Students about Fractions

This research developed a measuring instrument in the form of a three-tier diagnostic test to measure students' misconceptions in fraction material in grade V. This research aims to determine (1) the validity, reliability, and item characteristics of the three-tier diagnostic test and (2) the level of misconceptions of grade V elementary school students in Pontianak. This research used quantitative approach and test development model by Mardapi, that has nine steps. The subjects were fifth-grade students in Pontianak City, and the developed test instruments focused on addition-subtraction of fractions, each with two sets of questions A and B. The instrument were analyzed for content and construct validity, reliability, and item characteristics based on IRT using Partial Credit Model (PCM). The results show that the developed test instrument demonstrated strong content and construct validity. Reliability analysis shows high reliability, with Cronbach's Alpha values >0,7. Item fit analysis reveal that 91% and 73% were fit, therefore the unfit items were fixed or eliminated. The analysis of misconceptions shows that 39.52% of students do not understand the concept of fractions’ addition and subtraction, and 29.09% experienced misconceptions. Additionally, 12.61% have false positives, and 8.97% have false negatives. Only 6.30% understood the concept correctly, and 3.52% guessed correctly or understood but had doubts. Generally, the final test instrument demonstrated good validity, reliability and item qualities.

ChatGPT's quality: Reliability and validity of concept inventory items.

The recent advances of large language models (LLMs) have opened a wide range of opportunities, but at the same time, they pose numerous challenges and questions that research needs to answer. One of the main challenges are the quality and correctness of the output of LLMs as well as the overreliance of students on the output without critically reflecting on it. This poses the question of the quality of the output of LLMs in educational tasks and what students and teachers need to consider when using LLMs for creating educational items. In this work, we focus on the quality and characteristics of conceptual items developed using ChatGPT without user-generated improvements. For this purpose, we optimized prompts and created 30 conceptual items in kinematics, which is a standard topic in high-school level physics. The items were rated by two independent experts. Those 15 items that received the highest rating were included in a conceptual survey. The dimensions were designed to align with the ones in the most commonly used concept inventory, the Force Concept Inventory (FCI). We administered the designed items together with the FCI to 172 first-year university students. The results show that ChatGPT items have a medium difficulty and discriminatory index but they overall exhibit a slightly lower average values as the FCI. Moreover, a confirmatory factor analysis confirmed a three factor model that is closely aligned with a previously suggested expert model. In this way, after careful prompt engineering, thorough analysis and selection of fully automatically generated items by ChatGPT, we were able to create concept items that had only a slightly lower quality than carefully human-generated concept items. The procedures to create and select such a high-quality set of items that is fully automatically generated require large efforts and point towards cognitive demands of teachers when using LLMs to create items. Moreover, the results demonstrate that human oversight or student interviews are necessary when creating one-dimensional assessments and distractors that are closely aligned with students' difficulties.

Reliability of the Revised Neurophysiology of Pain Questionnaire-Turkish in patients with neck pain: a cross-validation study

Background & Objectives: The Neurophysiology of Pain Questionnaire (NPQ) measures the level of knowledge of patients and healthcare professionals regarding the neurophysiology of pain. The revised Turkish (Tr) version has low reliability for patients with chronic spinal pain. In this study, we investigated the reliability of the Revised NPQ-Tr in patients with neck pain. Methodology: The Revised NPQ-Tr was administered to 219 participants suffering from neck pain for at least 3 months, who were between the ages of 25 and 60 y and native Turkish speakers. Correct responses were awarded one point, while undecided or incorrectly marked responses were awarded 0 points. In order to analyse the validity of the test, the high-scoring and low-scoring groups were compared. Using the percentage of correct responses in the high and low scoring groups, we calculated the difficulty of the item (P-value) and the discrimination power of the item (r). Results: Responses to the questionnaire were highly correlated. Items 1 and 2 had high discrimination power (r > 0.40), and items 3 and 5 had very good item quality (0.30 < r < 0.39). Among the items ranked between 1-7 and 9-12 in terms of difficulty of the item and discrimination power, only item 8 was found to be a difficult yet discriminating item (P < 0.60). According to Cronbach's alpha (0.81) and Kuder-Richardson-20 (0.81) coefficients, the questionnaire had a high internal consistency and reliability, and a split-half correlation coefficient (0.802) determined its internal consistency and reliability. Conclusion: We conclude that the Neurophysiology of Pain Questionnaire-Turkish can be used on neck pain, and it is reliable and highly valid. Keywords: Chronic Pain, neck pain, pain knowledge, pain education, pain beliefs, Turkish language, reliability, validity. Citation: Yasarer O, Sari Z, Copuroglu OB, Eker TA, Aydogdu O. Reliability of the Revised Neurophysiology of Pain Questionnaire-Turkish in patients with neck pain: a cross-validation study. Anaesth. pain intensive care 2024;28(5):859−865; DOI: 10.35975/apic.v28i5.2552 Received: August 04, 2024; Reviewed: August 14, 2024; Accepted: August 17, 2024

Actd regulatory requirements for approving an anticancer drug (thioguanine)

This work makes document handling safer and more accessible. It can manage even more complex papers in addition to all the benefits. Using this work, a composite document or papers from several different document sources and formats can be assembled, updated, and published. Each document is treated as a single, identically organized document. BMR, Process Validation Record, Stability Study (including Accelerated & Long Term Stability Study per Myanmar Zone Specification), Anticancer Drug Packing Requirements, and Certificate for Product Permission (covering all aspects from manufacturing to its packing & registration) are among the required documents. It offers reliable scientific methods for determining the effectiveness, safety, and quality of medicinal items. It will assist in comprehending the documentation needs for drug registration in Myanmar.

Diabetes Self-Management Smartphone Application: Patient Satisfaction Survey for Rightest app Using the Short Version User Experience Questionnaire (UEQ-S) : A Single Center Pilot Study

Abstract Background The ability of people with type 1 diabetes mellitus (T1DM) to improve glycemic control depends on their ability to interpret and act on blood glucose results. We investigated applicants satisfaction when switching to blood glucose meters (BGMs) featuring rightest app via Bluetooth using their smartphones. Objective This study aimed to assess the feasibility of the app (rightest) and the participants satisfaction after using the app in 3 months interval by using UEQ -S score. Methods This is an observational study, conducted at the Pediatric and Adolescent Diabetes Unit, Children’s Hospital, Faculty of Medicine, Ain Shams University (PADU), on participants with T1DM(13-18 years old). The recruited participants (n = 20) with T1DM started using the “Rightest” app for 3 months. UEQ-S was used at the end of the study to asses the participants satisfaction. It consists of the two dimensions pragmatic quality (item 1–4) and hedonic quality (item 5–8). Each item is measured on a 7-point Likert scale with two opposite meanings ranging. Results 20 participants with T1DM, following up at PADU, used BGM with rightest app for 3 months. UEQ-S results revealed pragmatic total score (1.425) was above average while the hedonic total score was good(1.250) and the overall score was good(1.338) where -3 indicates extremely bad score while +3 indicates extremely good score. This indicates that they showed overall good satisfaction for mobile app using UEQ-S score. Conclusion This study demonstrated that switching to BGMs with mobile app showed good satisfaction after 3 month interval.