Pool Of Questions Research Articles

Development of a minimum data set for long COVID: a Delphi study protocol

IntroductionPrevious consensus-based long COVID research has focused on establishing research priorities, developing clinical definitions, core outcomes and a list of recommendations of patient-reported outcome measures that can be used to...

Collapse of Pre-COVID-19 Differences in Performance in Online vs. In-Person College Science Classes, and Continued Decline in Student Learning

Studies comparing student outcomes for online vs. in-person classes have reported mixed results, though with a majority finding that lower-performing students, on average, fare worse in online classes, attributed to the lack of built-in structure provided by in-person instruction. The online/in-person outcome disparity was normative for non-major geology classes at the University of Mississippi prior to COVID-19, but the difference disappeared in the years after 2020. Previously distinct trendlines of GPA-based predictions of earned-grade for online and in-person classes merged. Of particular concern, outcomes for in-person classes declined to match pre-COVID-19 online expectations, with lower-GPA students disproportionally impacted. Objective evidence of continued decline in student learning, masked by sliding grading scales, is also presented with a long-term record of exam scores drawing from the same question pool for over a decade. Average scores remained relatively constant until COVID-19. Scores then declined in each successive year, attributed to an increase over time in the percentage of enrolled students who had been in high school during the pandemic shutdowns. At the close of 2023, exam scores showed no signs of returning to pre-COVID-19 outcomes. The negative impacts of the shutdowns, with greater impact on those who were in high school during the pandemic, appear to be due to a loss in the developmental life-skills (e.g., self-motivation, focus, critical thinking, social development) needed to thrive in college, not just reduced exposure to preparatory subject material. These results provide a global cautionary message for the management of future pandemics.

A/R/Tographic Investigation into Artistic Development Processes of Painting and Drawing Teacher Education Undergraduate Students

This study is a qualitative study designed to investigate the artistic development processes of undergraduate art education students a/r/tographically and to determine the role of portfolio preparation in this process. The present research was conducted in the workshop course of the 4th-grade students of the Department of Art and Art Education of a medium-sized university in the academic year 2022-2023 with the participation of 10 volunteer workshop students. The study group of this research was selected through criterion (purposive) sampling. The collection of the data of the research consisted of student educational development files (portfolio) prepared during the inquiry process, the question pool created, a/r/tograph opinions collected through a semi-structured interview form prepared by taking the opinions of field experts, peer opinions, expert opinions and student artistic products that emerged at the end of the process. Qualitative data analysis was used to analyse the data related to the a/r/tographic process, which is an art-based research method. Accordingly, content analysis was used in student, peer and expert evaluations of educational development files (portfolio). Students' artistic processes and a/r/tographic questioning processes were analysed using descriptive analysis. It was seen that the students were satisfied with the educational development files (portfolio) that they examined by making self-evaluation. Peers and experts who examined the educational development files (portfolio) stated that the files could generally be improved. It was observed that the students were involved in the a/r/tographic process in a determined or accidental way and that they continued the process by making inquiries. It was observed that students developed different perspectives with their artist identities and expressed themselves with process-oriented products that they reflected themselves.

Performance of large language artificial intelligence models on solving restorative dentistry and endodontics student assessments

ObjectivesThe advent of artificial intelligence (AI) and large language model (LLM)-based AI applications (LLMAs) has tremendous implications for our society. This study analyzed the performance of LLMAs on solving restorative dentistry and endodontics (RDE) student assessment questions.Materials and methods151 questions from a RDE question pool were prepared for prompting using LLMAs from OpenAI (ChatGPT-3.5,-4.0 and -4.0o) and Google (Gemini 1.0). Multiple-choice questions were sorted into four question subcategories, entered into LLMAs and answers recorded for analysis. P-value and chi-square statistical analyses were performed using Python 3.9.16.ResultsThe total answer accuracy of ChatGPT-4.0o was the highest, followed by ChatGPT-4.0, Gemini 1.0 and ChatGPT-3.5 (72%, 62%, 44% and 25%, respectively) with significant differences between all LLMAs except GPT-4.0 models. The performance on subcategories direct restorations and caries was the highest, followed by indirect restorations and endodontics.ConclusionsOverall, there are large performance differences among LLMAs. Only the ChatGPT-4 models achieved a success ratio that could be used with caution to support the dental academic curriculum.Clinical relevanceWhile LLMAs could support clinicians to answer dental field-related questions, this capacity depends strongly on the employed model. The most performant model ChatGPT-4.0o achieved acceptable accuracy rates in some subject sub-categories analyzed.

Co-designing assessment tasks with students in tertiary education: a scoping review of the literature

Traditional assessment methods in tertiary education may not suit students’ diverse learning needs, values, and preferences. Co-designing assessment with students may engage them more effectively. This scoping review determined assessment co-design processes employed in tertiary education, evaluated the impacts on student learning outcomes and key factors contributing to effective assessment co-design. Seven databases were searched, limited to human studies in English language published between 2003–2023, with records screened by two reviewers. Data were presented in tabular form and a narrative synthesis. From 6233 records identified, 51 articles were included. Three main assessment co-design processes were: co-design of assessment rubrics and marking criteria; assessment co-design with larger student groups (e.g. via multiple-choice question pools and co-creation workshops); and intensive assessment co-design with smaller groups. Positive student outcomes included increased assessment literacy, student autonomy, engagement and interest and development of professional and learning skills. Staff support and effective communication between team members were some key enablers, while some barriers included time constraints and student resistance to participation. There were diverse co-design processes and outcomes from assessment co-design across disciplines. Future research should prioritise assessment co-design with international students for inclusion and equity and graduate students to accommodate advanced learning skills.

Development and Validation of the Attitude Towards Surrogacy Scale in a Turkiye Sample

Bacground: Surrogacy is one of the options a lot of ethical, legal and psychological controversy. Surveying attitudes toward surrogacy plays an important role in building awareness of this phenomenon in the society. In this study authors aimed to develop and validate a scale to assess the attitudes towards surrogacy. Methods: In this study cross-sectional design was implemented. Development process of the Attitude towards Surrogacy Scale (ATSS) included items development based on literature reviews, other existing questionnaires, confrmatory factor analysis (CFA), and reliability analysis using internal consistence coefcients. A total of 272 people residing in Büyükçekmece and Beylikdüzü districts of Istanbul were included in the study. Firstly, conceptual structure and item pool were created for the draft scale created by the researchers. Then, the question pool was submitted to expert opinion. After the expert opinion, a pilot study was applied to the statements in the draft scale. After the test-retest reliability was performed, the data collection phase started. Participants who agreed to participate in the study were reached both face-to-face and online. Convenience sampling method was used to reach the participants. Results: IBM SPSS and IBM AMOS package programmes were used to analyse the data obtained within the scope of the study. In the data analysis, firstly, item analysis was performed for internal consistency reliability. After this stage, structural validity analysis was used. As a result of the analysis, a measurement tool consisting of 4 dimensions and 24 statements expressed as “positive impact, negative impact, legal impact and economic impact” was developed. It has been statistically determined that this measurement tool is valid and reliable. Conclusion: The results obtained show that the scale developed for the perception of surrogacy has validity and reliability. Therefore, the “scale developed for the perception of surrogacy” can be used to measure the perception of surrogacy of people in our country.

Development of Ecology Achievement Test for Secondary School Students

This study aimed to develop a valid and reliable multiple-choice achievement test for the subject area of ecology. The study was conducted within the framework of exploratory sequential design based on mixed research methods, and the study group consisted of a total of 250 middle school students studying at the sixth and seventh grade level. In the process of preparing the question pool, the level and scope of the questions in the pool were shaped by taking into account the achievements of science, environmental education and climate change courses. A question pool consisting of questions obtained as a result of the literature review and prepared by the researcher was created. The pool of 41 questions was reduced to 29 questions in line with expert opinions. The 29-question multiple-choice test, whose language comprehensibility was examined and necessary arrangements were made, was made ready for implementation. The draft form of the achievement test, which was piloted, was applied to 250 students. Item difficulty indices and item discrimination indices of the test answers obtained from the students were calculated. After the item analysis, a total of 4 questions were removed from the test. As a result of the analyses, the average difficulty value of the test was calculated as 0.58 and the average discrimination value was calculated as 0.60. The KR-20 reliability coefficient of the developed test was 0.85 and Cronbach alpha reliability coefficient was 0.88. As a result of the research, a valid and reliable ecology achievement test was developed.

Normative study of 500 general-knowledge of true-false questions for Russian young adults.

The main aim of this study was to validate 500 true-false general-knowledge questions in Russian. These norms are valuable to researchers in many fields, as is shown by the impact and relevance of similar norms available in other languages. Although the Russian language is widely spoken, there are no norms available in this language for this type of questions. True-false questions are very useful for measuring semantic memory, among other topics, in neurocognitive studies where there is a trade-off between experimental time and the need for many trials. These types of experimental materials are heavily rooted in cultural background knowledge, making the mere translation from one language to another insufficient. The present research aims to fill this gap. One hundred fifty-five participants answered 500 true-false general knowledge questions split over several consecutive days and three topics: Social Sciences, Natural Sciences, and Culture & Sport. The participants' task was to indicate whether the statements were true or not, as well as the confidence they had in the correctness of their answer. Despite obtaining questions on each of the topics covering all difficulty levels, grouped analyses showed that Social Science's accuracy was higher than for Natural Science's or Culture & Sport questions. In relation to confidence, the grouped perceived difficulty was higher for questions about Culture & Sports when compared with the other two topics. Thus, this study reports and makes available a large pool of Russian true-false general knowledge questions covering different levels of difficulty.

БРОНХИАЛЬНАЯ АСТМА – ФАРМАКОЭПИДЕМИОЛОГИЧЕСКИЙ СРЕЗ ЗНАНИЙ ВРАЧЕЙ. ИТОГИ ИССЛЕДОВАНИЯ «ASSA–III»

Introduction. Number of bronchial asthma (BA) cases increases every year. Despite the improvement of clinical guidelines proposed by national societies and GINA (Global Strategy for Asthma Management and Prevention) expert committee, BA is still an urgent and significant public health problem. In some basic issues of etiology, pathogenesis, diagnosis, and pharmacotherapy, there is still a deficiency in healthcare professionals’ knowledge. Aim. To study the basic bronchial asthma knowledge of physicians from different regions. Materials and Methods. A multicenter anonymous survey was conducted among medical specialists regarding their knowledge of and preferences in the topic of bronchial asthma. This is the third stage of the ASSA (Assessment of Senior Medical Students in Bronchial Asthma) project. Statistical data were processed using the Pearson chi-square criterion (χ2) and complementary adjustments. Results and Discussion. Over the years 2019-2023, an anonymous survey of 472 physicians was conducted in ten cities and regions of Russia. In general, the level of basic specialists was found to be relatively satisfactory: An average of 65.8 % according to the study. At the same time, a deeper understanding was noted in the basic and theoretical aspects of the BA etiopathogenesis and diagnosis (the average result in the pool of questions was 84.1%), while the pool of questions regarding the disease treatment turned out to be more difficult for the respondents (their average result was 52.1%). The respondents gave the best answers to questions regarding the reference to a prolonged suffocation attack (95.6%), the levels of asthma control (93.6%), and the key methods of BA diagnosis (91.3%); the worst results were obtained for questions related to the choice of reasonable treatment tactics for mild asthma at therapy stages 1 (34.7%) and 2 (32.2%), indications for sublingual immunotherapy (12%), and indications for adding tiotropium (33.6%). Conclusion. According to the findings, it was concluded that physicians generally had a relatively satisfactory level of knowledge on the main issues related to the BA definition, etiopathogenesis, and diagnosis. However, their knowledge regarding the advanced approaches to pharmacotherapy is insufficient, and these issues require in-depth and additional studies. We also identified the specific changes in the physicians’ knowledge depending on their seniority.

Scale Development Study on the Perception of Responsibility for Providing Professional Value for Prospective Teachers

In this study, it was aimed to develop a measurement tool with validity and reliability to determine the perceptions of academicians working in faculties of education about their responsibility to provide pre-service teachers with professional values. In order to create the necessary item pool for the scale, the literature was reviewed and in this context, a question pool of 44 items was created and expert opinions were taken. After the revisions in the items, Lawshe Technique was used to determine the content validity. 300 faculty members were administered the scale and a data set was obtained, which was analyzed for validity and reliability. Exploratory factor analysis (EFA) was used to reveal the construct validity of the scale, Cronbach's Alpha reliability coefficient, item-total score correlation and two-half test reliability methods were used to ensure the reliability of the scale, and lower 27%-upper 27% independent groups t-test was used for the discrimination of the scale. As a result of EFA, a 26-item, 3-factor structure emerged. This structure explains 59.647% of the total variance of the scale. Cronbach Alpha internal consistency coefficient for the reliability of the scale was found to be 0.952. It was observed that the item total correlation values were high and positive above 0.5 and the correlation values of all items were above 0.30, which is recommended as the lower limit. According to the results of the two-half test reliability analysis, the correlation coefficient between the equivalent halves was found to be 0.942. As a result of the t-test between the scores of the upper 27% and lower 27% groups in order to examine the discrimination of the scale items, it was found that the difference between the groups was significant at α=.000 level.

TRIBAL PERCEPTION SCALE: A SCALE DEVELOPMENT STUDY

The purpose of this study is to shed light on how students at Hakkari University see the political and social components of the concept of tribe, which is considered a way of life in Turkey. Before conducting group interviews with associate, undergraduate, and graduate students at the targeted university who were at least 18 years old to build the research's question pool, the researcher conducted a comprehensive literature study. Using the information obtained from the group interview and literature review, a five-way Likert survey containing questions about the notion of tribe will be administered to Hakkari University students for the 2022–2023 academic year. Using the Statistical Package for the Social Sciences (SPSS) tool, Exploratory Factor Analysis (EFA) was performed on 231 survey responses. In addition, a Confirmatory Factor Analysis (CFA) was conducted on the data acquired from 174 participants using the Analysis of Moment Structures (AMOS) program. As a result of the analyses, the Tribal Perception Scale (after this named TPS) with 15 items and two sub dimension was developed. The internal reliability coefficient (Cronbach Alpha) of this scale was discovered to be 0.85 as a result of an examination of its reliability. The social and political perception subdimensions of the scale were found to be 0.88 and 0.76, respectively, and this scale was found to account for 51.671% of the total variance. This result led to the conclusion that TPS is a highly valid and trustworthy instrument for data gathering.

The design and psychometric evaluation of a COVID-19 social stigma questionnaire in nurses

BackgroundThe patient’s fear of social reactions, the disease stigma, and being a transmission agent is a psychological and social consequence of contracting some diseases, especially infectious ones, in any society. The present study aimed to design and psychometrically evaluate a COVID-19 social stigma questionnaire in nurses.MethodsThis mixed-method study was conducted using a sequential exploratory approach according to the Creswell method in Mazandaran Province (Iran) during 2021-22. The study was performed in three phases: (1) a qualitative phase to explain the key concept, (2) designing the scale items, and (3) an experimental phase with the scale psychometric evaluation. In the first phase, nurses’ experiences regarding the concept of COVID-19 social stigma were evaluated using a qualitative method with an inductive qualitative content analysis approach. In this phase, the lived experiences of 12 nurses working at hospitals of Babol University of Medical Sciences were extracted through in-depth interviews with semi-structured questions and analyzed by conventional content analysis. The main classes are contradictory feelings, rejection, and adaptation strategies. In the second phase, the designed items were validated by determining face validity, content validity, and construct validity using exploratory factor analysis (EFA). In addition, the scale’s reliability was determined through internal consistency and stability.ResultsFollowing the study’s first phase, a pool of questions with 64 initial items was formed. After evaluating face and content validity, the number of items was reduced to 24 cases. An excellent total content validity (S-CVI/Ave) of 0.93 was calculated for the scale. According to EFA outputs, three factors accounted for the most variance (52.82%), and four items were excluded in this phase. The Kaiser-Meyer-Olkin (KMO) statistic and Bartlett’s test of sphericity were calculated at 0.776 and P < 0.001, respectively. The results of Cronbach’s alpha (0.796) and intraclass correlation (0.793) indicated the correlation and internal consistency of the scale.ConclusionThis scale can help healthcare managers and policymakers apply necessary protective measures by evaluating the social stigma of COVID-19 in nurses and emerging infectious diseases that may occur in the future.

391 Common Knowledge Or Common sense? Identifying Systematic Misconceptions of Animal Agriculture and Food Familiarity in Higher Education Individuals

Abstract Knowledge gaps in the context of agriculture contribute to mistrust and negative worldviews of the animal agricultural sector. The purpose of this quasi-experimental survey study stood on three tiers: quantify perceived connection to food production (FP) of the participants, their understanding, knowledge and perceptions of animal agriculture (AA) and FP, and determine predictors which may have contributed to their knowledge and perceptions of food animal production. A southeastern land grant institution served as the convenience sample for this study, where 265 completed responses were returned. The electronic survey collected several types of data including a Gapminder-influenced (Rosling et al., 2019) Animal Agricultural Knowledge and Perceptions Questionnaire, a Food Familiarity Index Questionnaire, and demographic questions. The study reports that almost 50% of participants demonstrated a negative worldview (P &amp;lt; 0.05) of animal agriculture, regardless of food familiarity scores. Natural and self-identified demographic characteristics impacted AA knowledge and perceptions, including gender, ethnicity, dietary preference, perceived connection to FP, and affiliation with the College of Agriculture. Additional research should be done to replicate the findings with broader question pools and other demographic groups to identify areas that need improvement in agriculture communication efforts designed to dispel misinformation.

Sosyal Girişimsel Liderlik Ölçeği (SGLO) Geçerlik ve Güvenirlik Çalışması

The purpose of this study is to develop a measurement tool that can assess the social entrepreneurial leadership skills of academic administrators in higher education institutions, based on the perspectives of students. The study was conducted at a university in Central Anatolia, involving two different participant groups. The first group consisted of 254 associate degree students studying at Vocational Schools, who were selected through convenience sampling. The second group included 305 undergraduate students from various faculties of the same university, who were recruited using the same method. The initial data for the research were collected using a 50-item draft scale prepared by the researchers from a pool of questions based on the literature. Expert opinions were sought, and a pilot study was conducted with the draft scale. As a result of these procedures, the scale was revised accordingly. The data collected from the main sample were analyzed using exploratory and confirmatory factor analysis techniques. For reliability analysis, Cronbach's Alpha and McDonald’s Omega methods were preferred. The findings revealed a four-factor and 24-item scale structure that can measure the social entrepreneurial leadership skills of administrators. The results were discussed in light of relevant literature, and some recommendations for the use of the scale were provided based on the research findings.

Beyond the symptoms: Personalizing giant cell arteritis care through multidimensional patient reported outcome measure

BackgroundGiant Cell Arteritis (GCA) is the commonest form of systemic vasculitis in people over the age of 50. Published research highlighted the lack of a disease-specific patient reported outcomes (PROMs) for GCA. ObjectivesTo assess the validity, reliability and responsiveness to change of a devised disease specific patient self-reported outcome measures questionnaire for Giant Cell Arteritis (GCA). MethodsThe GCA-PROMs was conceptualized based on frameworks outlined in the OMERACT developed core set of Outcome Measures for Large-Vessel Vasculitis and the guiding principles of the FDA guidance. Initially, cognitive interviews were conducted to identify item pool of questions. Item selection and reduction was achieved based on patients as well as an interdisciplinary group of specialists. Rasch and internal consistency reliability analyses were implemented. ResultsA total of 54 GCA patients completed the questionnaire. The GCA-PROMs questionnaire was reliable as demonstrated by a high standardized alpha (0.878–0.983). Content construct assessment of the GCA-PROMs functional disability and QoL revealed significant correlation (p< 0.01) with both HAQ and EQ-5D. Changes in functional disability, QoL showed significant (p< 0.01) variation with diseases activity status in response to therapy. ConclusionsThe developed GCA-PROMs questionnaire is a reliable and valid instrument for assessment of GCA patients. A stratified treatment regimen depending on the individual patient's risk factors as well as preferences and associated comorbidities is the best approach to tailored patient management.

Developing a scale for tourism literacy: validity and reliability study

ABSTRACT Tourism literacy encompasses the development and utilization of knowledge and skills within the tourism. These skills encompass problem-solving for various stakeholders, including managers, employees, tourists, and residents. Furthermore, they involve a deeper understanding of tourist destinations and active contributions to sustainable tourism promotion. Surprisingly, despite the extensive literature on literacy studies in fields like economics, media, maps, and water, there remains a conspicuous gap in tourism literacy research. Consequently, the novelty of this subject has spurred researchers to address this void. Accordingly, the main aim of this study is to develop a scale that can measure individuals’ tourism literacy, which will be the first of its kind. To achieve this, firstly a question pool was created. Then the scale was developed with expert opinions and pilot testing. CFA and EFA were performed for determining the final version of the scale. At the end of the study, a scale consisting of six dimensions (residents’ knowledge and skills related to tourism, tourists’ knowledge and skills, tourist guidance knowledge and skills, food and beverage management knowledge and skills, tourism management knowledge, and tourism management skills) was established, and its validity and reliability were confirmed. Future research suggestions and study limitations have been mentioned.

The Development and Validation of the "Hippocratic Hypertension Self-Care Scale".

The adoption of self-care behaviors among patients with arterial hypertension (AH) plays an important role in the management of their health condition. However, a lack of scales assessing self-care is observed. We aimed to develop and validate the Hippocratic hypertension self-care scale. From a pool of questions derived from a literature review, 18 items were included in the scale and reviewed by a committee of experts. Participants indicated the frequency at which they followed the self-behavior prescribed in each statement on a five-point Likert scale. Data were collected between April 2019 and December 2019. A total of 202 consecutive adult patients with AH were enrolled in the study. The internal consistency of the scale was found to be 0.807, using Cronbach's alpha coefficient. An exploratory factor analysis identified two domains that accounted for 92.94% of the variance in the scale items; however, each sub-scale could not be used as an independent scale. Finally, the test-retest of the scale showed a significant strong correlation (r = 0.0095, p < 0.001). This analysis indicates that the scale is reliable and valid for assessing self-care behaviors in patients with AH. It is suggested that health professionals use it in their clinical practice to improve the management of AH.

Health beliefs on type 2 diabetes: a methodological research for development and psychometric evaluation of “DIABA” (Diabetes-related Instrument to Assess Beliefs of Adolescents) health beliefs on type 2 diabetes

BackgroundSeveral reports have shown an increase in the number of type-2 diabetics among adolescents creating an extra burden for this age group. However, there is no instrument assessing adolescents’ attitude toward this disease. This study aims at designing a psychometric tool for assessing adolescents’ health beliefs regarding type-2 diabetes.Research design and methodsIn this methodological research, 770 boy and girl adolescents (between 13 and 15) from Tehran participated through multistage sampling. The Inclusion criteria were: junior high school students, students’ willingness for participation and not suffering from type-1 or type-2 diabetes. The questionnaire was designed by extensive literature review and the related existing questionnaires, as well as considering the research team’s comments. The validity of the questionnaire was determined through face and content validity. The construct validity was determined through exploratory and confirmatory factor analysis. Reliability was measured via internal consistency coefficient (ICC) and internal consistency reliability was measured by Cronbach Alpha. SPSS 16 and EQS6.1 were used for data analysis.ResultsThe pool of questions had 57 items, and by removing similar (23 questions) or inappropriate sentences (8 questions), a draft questionnaire with 26 questions was designed. No items were removed in the face validity phase. Based on the results of CVR and CVI, six items and 4 items in the exploratory factor analysis were removed. Finally, a questionnaire with 16 items in 4 dimensions of perceived self-efficacy, behavioral beliefs, perceived susceptibility and perceived severity was obtained. The results of confirmatory factor analysis confirmed the model. The internal consistency coefficient was confirmed measuring Cronbach Alpha at 0.78 and ICC = 0.73.ConclusionThe questionnaire designed can be employed as a reliable and valid instrument to assess the psychological perceptions and health beliefs of adolescents with respect to type-2 diabetes.

Design and development of a Telemedicine Assessment Toolkit (TAT) for the assessment of audiovisual telemedicine encounters.

Although the use of audiovisual telemedicine has grown in recent years especially during recent COVID-19-related lockdowns, evidence shows there is still a lack of tools that can be used for the assessment of telemedicine encounters. The few validated questionnaires that are available for assessing telemedicine encounters are not often used. Non-validated questionnaires dominate research, leading to results that cannot be compared or extrapolated to other research or medical sites. Development of standard measures for the assessment of telemedicine encounters has been advocated by stakeholders. The objective of this study is to provide a comprehensive set of measures by developing a conceptual approach and a preliminary Telemedicine Assessment Toolkit (TAT) for the assessment of audiovisual telemedicine encounters. A two-step conceptual approach was used to identify potential domains and sub-domains by qualitative analysis of a pool of questions from studies published from 2016 to 2021. Questions were adopted from validated questionnaires or generated to represent the underlying concept of each sub-domain, resulting in a core block of comprehensive questions. A toolkit is proposed with question-measures that cover the sub-domains relevant to the assessment of telemedicine encounters. This study recommended 11 domains to be used for the assessment of telemedicine encounters: "usability," "patient satisfaction," "patient-provider interaction," "patient perspectives," "telemedicine readiness," "qualitative feedback," "comparison to standard (in-person) care," "privacy," "technology," "patient feeling," and "patient costs." Of the 11 domains, 26 underlying sub-domains were created. From the subdomains, a 30-question core block was proposed. The core-block together with a precursor block aimed to retrieve demographic/patient characteristics and, together with a customizable clinical outcomes block, complete the comprehensive toolkit. The toolkit, upon testing and validation, would enable researchers and system owners to assess patient-oriented aspects of audiovisual telemedicine encounters more accurately and accelerate the adoption of common audiovisual telemedicine assessment measures.

Applying combinatorics in the design of multiversion exams

In Spring 2020, the need for redesigning online assessments to preserve integrity became a priority to many educators. Many of us found methods to proctor examinations using Zoom and proctoring software. Such examinations pose their own issues. To reduce the technical difficulties and cost, many Zoom proctored examination sessions were shortened; to create summative assessments we supplemented the short proctored sessions with short unproctored sessions. In the aftermath of the pandemic, the method of creating a large volume of examination variants is helping us design mastery-based examinations. We review the mathematics behind choosing the size of question pools to improve integrity of the exam. Finally we provide files for generating examination variants from the pools.