Online Administration Research Articles

74 Development and content validation of a tool to assess quality of primary care practice

OBJECTIVES/GOALS: Primary care practices struggle to identify which combination of care structures and processes need to be implemented to improve practice performance and subsequently, patient outcomes. The goal of this study is to develop and validate a tool to assess care structures and processes that are associated with better quality and patient outcomes. METHODS/STUDY POPULATION: Data from a scoping review, Delphi study, and qualitative interviews with high-performing primary care practices contributed to the development and content validation of the Tool for Advancing Practice Performance (TAPP). From these sources we identified 314 items representing care structures (e.g., care team makeup, use of electronic health records) and processes (e.g., care coordination, panel management). We developed criteria for deleting and rescuing items and received input from our expert panel to refine the pool of items. We eliminated items that were redundant and lacked clarity/specificity. The tool was further modified based on feedback from cognitive interviewing and pilot testing with practice managers, quality improvement leaders, and physicians from primary care practices. RESULTS/ANTICIPATED RESULTS: The pool of 314 items was winnowed to 188 after applying criteria for deleting and rescuing items. During the expert review, 70 items were eliminated and 8 new items were added, resulting in a working tool of 126 items. We conducted eight cognitive interviews with the 126-item tool and received feedback on the content, item structure, and language, which led to the elimination of 13 items that were poorly or incorrectly understood by respondents. We also modified the language of 23 items for clarity. After cognitive interviewing, the resulting tool comprised 113 items. Fifteen practices piloted the tool and no additional items were eliminated. We modified the instructions for completing the tool and resolved technical issues related to online administration. DISCUSSION/SIGNIFICANCE: TAPP is a novel tool for assessing care structures and processes that are associated with better quality and patient outcomes in primary care settings. The tool can be used by researchers and primary care clinicians to identify areas for improvement in practice performance and patient outcomes related to chronic disease prevention and management.

Cognitive Fusion, Ruminative Response Style and Depressive Spectrum Symptoms in a Sample of University Students.

Psychological inflexibility is related to depressive symptoms through the 'ruminative response style' (RR) and 'cognitive fusion' (CF). We aimed at exploring whether university students were more exposed to CF, RR and depressive symptoms because of their intellectual performance than non-university students of the same age. We compared university students (US) (n = 105) vs. non-university students (NUS) (n = 76) through online administration of the 'Cognitive Fusion Questionnaire' (CFQ-7), the 'Depression-Zung Self-Assessment Scale' (ZSDS) and the 'Perseverative Thinking Questionnaire' (PTQ) (study protocol #0077818/2022, approved by the Ethical Committee of the University of Pisa, Italy). University students scored significantly higher than non-university students in the CFQ-7 Total Score (27.5 ± 9.4 vs. 24.4 ± 9.5; p = 0.040), ZSDS Total Score (41.1 ± 7.7 vs. 39.0 ± 7.3; p = 0.031), PTQ Total Score (26.1 ± 13.1 vs. 21.8 ± 13.9; p = 0.029), PTQ 'Repetitiveness' (5.3 ± 2.8 vs. 4.5 ± 2.9; p = 0.034), 'Intrusiveness' (5.8 ± 3.0 vs. 4.8 ± 3.1; p = 0.046) and 'Repetitive Negative Thinking capturing mental resources' (5.0 ± 3.1 vs. 4.0 ± 3.0; p = 0.013) (MANOVA analysis). In a binary logistic regression analysis of US (with ZSDS scores < 44 vs. ≥44 as the dependent variable, and PTQ Total Score and dimensions, CFQ-7 Total Score, age and gender as the covariates), PTQ Total Score predicted the more severe depressive symptomatology (OR = 1.44, 95% CI: 1.017-2.039; p = 0.040). We believe that RR and CF should be specifically targeted through psychoeducational/psychotherapeutic interventions in university students.

Comparison of an online adaptation of the Autism Diagnostic Observation Schedule-2 with its in-person version in an adult autism diagnostic service.

Restrictions on in-person assessments during the COVID-19 pandemic were a challenge for an adult autism diagnostic service receiving over 600 referrals annually. The service sought to adapt the Autism Diagnostic Observation Schedule (ADOS-2) for online administration. To investigate whether an online adaptation of the ADOS-2 performed comparably to the in-person ADOS-2. To obtain qualitative feedback from patients and clinicians regarding experiences of the online alternative. Online ADOS-2 assessments were completed for 163 referred individuals. A matched-comparison group comprised 198 individuals seen for an in-person ADOS-2 assessment prior to COVID-19 restrictions. A two-way analysis of variance (ANOVA) was run to explore any effect of assessment type (online or in-person ADOS-2) and gender on total ADOS score. Qualitative feedback was collected from 46 patients and 8 clinicians involved in diagnostic decision-making after the online ADOS-2 assessment. A two-way ANOVA found no significant effect of assessment type or gender and no assessment type × gender interaction effect on total ADOS score. Qualitative feedback suggested that only 27% of patients would have preferred an in-person assessment. Nearly all clinicians reported gains from offering an online alternative. This is the first study to examine an online adaptation of ADOS-2 within an adult autism diagnostic service. It performed comparably to the in-person ADOS-2, making it a viable alternative when in-person assessments are not possible. As this clinic group has high rates of comorbid mental health difficulties, we encourage further work to determine whether online assessment approaches generalise to other services to increase options for patients and efficiencies for service delivery.

Pandemic Challenge Accepted: The Philippine Board of Ophthalmology Shifts to Online Administration of its Certifying Examinations

The ongoing global COVID-19 pandemic triggered a series of events that resulted in the disruption of the delivery of various certifying examinations including that which was given by the Philippine Board of Ophthalmology (PBO). This paper shares the experience of the PBO using digital technology in administering its first ever online delivery of its certifying examinations. Online platform requirements used for delivering the examination are enumerated, online proctoring described, as well as the conduct of oral panel examinations and skills evaluation via video submission. Challenges encountered, feedback reported by both examinee and examiner, lessons learned from this endeavor, and future directions are discussed.

Introducing a short-form Parental Attachment Questionnaire for Muslim Societies (PAQ-MS): a study among young adults in Pakistan

ABSTRACT This paper examines the psychometric properties of Kenny’s 55-item Parental Attachment Questionnaire (PAQ), formatted for online administration, among a sample of 370 young adults between the ages of 18 and 26 who were born in the Punjab and had lived there since their birth, and tested the hypothesis that the negatively-voiced items would detract from the unidimensionality of the scales. The data identified the problematic nature within Muslim societies of many (but not all) of the negatively-voiced items concerning parents. The proposed 30-item short-form Parental Attachment Questionnaire for Muslim Societies (PAQ-MS), containing fewer negatively-voiced items, reported good qualities of internal consistency reliability and construct validity across the three domains of Affective Quality of Relationship with Mother/Father, Mother/Father as Facilitators of Independence, and Mother/Father as Source of Support.

Online test administration results in students selecting more responses to multiple-choice-multiple-response items

We developed the Physics Inventory of Quantitative Literacy (PIQL) to assess students’ quantitative reasoning in introductory physics contexts. The PIQL includes several “multiple-choice-multiple-response” (MCMR) items (i.e., multiple-choice questions for which more than one response may be selected) as well as traditional single-response multiple-choice items. In this paper, we discuss differences in performance on MCMR items that seems to result from differences in administration method (paper versus online). In particular, we find a tendency for “clickiness” in online administration: students choose more responses to MCMR items when taking the electronic version of the assessment. Student performance on single-response multiple-choice items was not affected by administration method. These results suggest that MCMR items may provide a unique opportunity to probe differences in online and on-paper administration of low-stakes assessments.Received 22 August 2022Accepted 20 December 2022DOI:https://doi.org/10.1103/PhysRevPhysEducRes.19.013101Published by the American Physical Society under the terms of the Creative Commons Attribution 4.0 International license. Further distribution of this work must maintain attribution to the author(s) and the published article’s title, journal citation, and DOI.Published by the American Physical SocietyPhysics Subject Headings (PhySH)Research AreasAssessmentInstructional strategiesTechnologyPhysics Education Research

Introducing the Psychological Wellbeing Scale for Muslim Societies (PWS-MS): a study among young adults in Pakistan

ABSTRACT This paper examines the psychometric properties of the short (18-item) form of the Ryff Scales of Psychological Wellbeing, presented for online administration, among a sample of 370 young adults between the ages of 18 and 26 years who were born in Punjab and who had lived there since their birth, and tested the two hypotheses that the negatively-voiced items would detract from the unidimensionality of the scale and that, with the removal of the negatively-voiced items, the remaining 10 items would generate a unidimensional and reliable measure of psychological wellbeing embracing all six of the proposed components of wellbeing (self-acceptance, positive relations with others, autonomy, environmental mastery, purpose in life, and personal growth). The data supported both hypotheses, and commended the resulting 10-item Psychological Wellbeing Scale for Muslim Societies (PWS-MS).

Workers’ non-discrimination in the metaverse

Technology is evolving and the workplace is radically changing; remote work is possible for activities that we never sought that could be done elsewhere than in a workplace organised by the employer. Digitalization enables automated production lines, but also automated decisions related to the employees, replacing human control and making platform work possible. The impact of innovation on labour law was very important during the pandemic, accelerated by the need of the so-called `social distance`. Several platforms, like Google Meet, Microsoft Teams, Zoom, Webex Meet were rapidly adapted to allow live interaction for those who could not meet in-person. Online meetings, online lectures, online administration etc. have become quite rapidly the `normality` of those days. In this context, an old idea has found fertile ground for development: the metaverse. Even if the metaverse doesn’t exist yet, work in virtual worlds advertised as metaverses has become a reality, challenging the traditional structures of labour law. One of the concerning issues related to the metaverse is related to workers’ discrimination in the virtual world and the possibilities to tackle it.

Influence of Situation Analysis on Performance of Youth Enterprises Development Fund in Nairobi City County

The absence of situation analysis may result in inadequately designed strategies, misallocation of resources, and poor risk management approach all of which could negatively impact organizational performance. The purpose of the study was to assess the influence of situation analysis on the performance of youth enterprise development funds (YEDF) in Nairobi city county. The study was descriptive, targeting a population of 114 staff at the headquarters. A Census of all the target respondents was considered as the sample. A questionnaire with open and closed questions was used to obtain data for the study through online and physical administration. Analysis of data was done by descriptive, content, and regression analysis. Out of a sample of 114 respondents, only 96 respondents returned their questionnaires which represented a response rate of 84.2%. Results of the study revealed that an r-square of 0.196, which implies that situation analysis, accounted for 19.6% of the changes in the performance of the youth enterprises fund. Besides, the study revealed a β of 0.713 and a p-value of 0.001&lt;0.05. The study concluded that situation analysis had a positive and significant influence on the performance of YEDF in Nairobi city county. The study recommended the YEDF enhance and pay more attention to both internal and external factors that affect its performance. YEDF should conduct more internal assessments of its strengths and weaknesses. Besides YEDF in Nairobi county should also conduct a situation analysis on the external environmental factors including technology and economics to enhance its performance.

Improving the Digitalization Capacity of Municipalities of Hungary Through Knowledge Management Tools

What does the digitization capability of local governments mean? What does it mean for a municipality to actively use digitization tools? How does the digital space affect the quality of life of the population and the attractiveness of businesses? Our goal is to present the digital tools that can be used to improve the quality of life of people living in settlements. Digitization is reflected in the way citizens and industries do business, helping them to access municipal functions and interact with the municipality on a daily basis. In addition, digitalization makes the management and operation of a settlement more sustainable. Last but not least, digitalization can make the everyday lives of those who live in it more livable and enjoyable. Our method is literature review, source analysis, and knowledge of economic and social processes. During our research, we explore the opportunities offered by digitization through examples, which we combine with knowledge management tools. We present models and tools for what needs to be done to improve urban life to the increasing satisfaction of residents. According to our results, municipalities do not use the toolbox of digitalization in the field of online administration, automated process management and marketing tools. Digitalization also provides opportunities for environmental awareness, administration, and support for companies and smart cities.

Measurement equivalence of two methods of online administration of the Vocational Gender Stereotype Attitudes Scale (VGSA) - the supervised in-class and the unsupervised at-home scale administration method

During the 2020-2022 COVID-19 global pandemic many researchers had to adopt or switch to online testing, which emphasized the need for ensuring measurement equivalence across different administration methods. The aim of this study was to determine whether gender stereotype measure (VGSA scale; Vocational Gender Stereotype Attitudes Scale) is equivalent in two different computer-based administration modes: supervised in-class and unsupervised at-home web survey. In-class web survey participants were 219 primary (11 to 16 years old; M = 12.97; SD = 1.16) and 195 secondary (15 to 19 years old; M = 16.78; SD = 0.96) school students that were surveyed in the group setting during a regular school day in their computer classrooms while the researcher was present in the room. At-home web survey participants were 144 primary (10 to 15 years old; M = 11.60; SD = 1.43) and 212 secondary (14 to 19 years old; M = 16.78; SD = 1.22) school students that were surveyed individually through the web link in their homes that was administered to them via the school administration. Results confirmed VGSA scale?s high internal reliability (?in-class = .89; ?at-home = .92), expected bi-factor structure (?2in-class (12) = 22.56, p = .032; ?2at-home(12) = 17.24, p = .141), and scalar measurement invariance across administration methods (??2(21) = 49.05, p &lt; .001; ?CFI = -.003; ?TLI = -.001; ?RMSEA = .009; ?SRMR = .013).

Social media usage in relation to their peers: Comparing male and female college students' perceptions

Administrators at many higher education institutions are capitalizing on the pervasive use of social media, but there are still disagreements about whether or not the use of social media has a positive impact on college students. With the wide use of social media and its possible effects, understanding students’ perceptions of their own social media usage in reference to their peers has implications for research and practice. With the research paradigm on pluralistic ignorance as a guide, this study used a subset of data from the 2018 online administration of the National Survey of Student Engagement, which contained responses from 5025 first-year students and 5487 seniors attending 33 institutions throughout the United States, with a majority being of traditional age (less than 24 years old). For both first-years and seniors, the results demonstrate that students perceive others to be posting and viewing social media more frequently than themselves, and this effect is even more pronounced for males. There was also a main effect for sex, such that females perceived both themselves and other students to be posting and viewing social media more frequently than males. These findings add nuance to the social media usage of college students, a topic that is continuously expanding as technology changes. These findings can help guide faculty, advisors, and administrators to better understand how students’ perceptions of peers’ social media usage might relate to their own, and consider how those perceptions of their classmates might affect their own behavior in both positive and negative ways.

Penetration Testing on the SISAKTI Application at Udayana University Using the OWASP Testing Guide Version 4

SISAKTI application is an information system to facilitate online administration of Udayana University student participation credit units. Until now, there has been no security testing carried out on the SISAKTI application, therefore this study aimed to test the security of SISAKTI application using Black Box penetration testing technique, conduct an assessment of system vulnerabilities and provide recommendations for improvements. The method used is by following the guidelines from OWASP Testing Guide version 4 using Information Gathering, Input Validation Testing, and Authorization Testing modules. From these three modules, there were 28 sub-tests that were successfully carried out, the results were 15 positive tests, 6 negative tests, and 7 tests which cannot be done, from the 28 sub-tests there are 8 vulnerabilities that have a direct effect on the system and are assessed using CVSS calculator, the results are 6 vulnerabilities have a vulnerable value from 6.4 (Medium) to 9.9 (Critical).

Examining the Efficacy of Online Administration of a Time-Limited School Readiness Intervention in the Face of COVID-19

Although the efficacy of online administration of behavioral parent training (BPT) programs is well-established, such programs address a single risk factor (behavioral functioning) for school readiness difficulties (comprised of academics, cognitive skills, and social, emotional, and behavioral functioning). The current study aims to examine the feasibility, acceptability, and efficacy of a telemedicine delivery of the School Readiness Parenting Program (SRPP), an integrative adaptation of PCIT designed to address the behavioral and academic domains of school readiness. The present study takes the first step towards validating an online administration of the SRPP as a treatment for early childhood disruptive behavior. Data were collected for 64 children ages 2–6 years (Mage = 4.63, SD = 0.86; 78.1% Hispanic/Latinx) and their families, who received either in-person administration of time-limited PCIT (PCIT-TL; n=30) or online administration of SRPP (n=34). A series of repeated measures ANOVAS were conducted to examine within and between group effects. Results revealed that both SRPP and PCIT-TL significantly reduced inattention (d’s = −0.54 to −0.88), aggression (d’s = −0.55 to −1.06), and behavioral symptomology (d’s = −0.55 to −0.85) and produced significant gains in parental skills (d’s = −1.47 to 2.99). Notably, online SRPP demonstrated greater improvement in positive parental verbalization, whereas PCIT-TL demonstrated greater reductions in parental stress. Overall, findings support the utility of online SRPP for addressing behavioral school readiness concerns.

Self-reported musculoskeletal disorders questionnaire for agriculturists: An online self-assessment tool development.

The musculoskeletal disorders (MSDs) severity and frequency questionnaire (MSFQ) has been used with agriculturists. Although it frequently appears in the literature, it does not periodically reflect the levels of MSDs. This study aimed to develop a MSDs assessment tool for agriculturists via an online database. The four hospitals that were assigned to the development and tryout group received a random selection of participants from 33 health promoting hospitals. In the development phase, 55 agriculturists (from two hospitals) completed the structured interview questionnaire. The MSFQ document for the analysis of MSDs symptoms among agriculturists was concentrated on the frequency and severity of symptoms. The online MSFQ was checked by using intraclass correlation coefficients (ICC) in a one-way random-effects model. In the tryout phase, a group of 44 agriculturists (from another two hospitals) completed a similar online MSFQ. Cronbach's alpha was used to test the reliability of the online self-reported MSDs questionnaires. A Likert rating scale, used to measure the satisfaction of users, was divided into three categories: information, program design, and benefits. The development phase showed an ICC = 0.99 with a 95% CI = 0.98-0.99. More than 65 percent of agriculturists were female, aged from 41-50 years old. A large number of them were engaged in self-cultivation. Their main crops were rice and cassava. In total, 50% reported that they had experienced mild MSDs levels. The shoulder, knee-calf, and hip-thigh areas were the top three parts of the body where agriculturists had experienced MSDs from cultivation. Excellent reliability of online MSFQ was found after the tryout. The agriculturists were very satisfied overall (information, program design, and benefits). Developments to the MSFQ and online administration did not diminish its reliability for obtaining information about the level of MSDs of agriculturists' musculoskeletal symptoms. This self-reported MSDs questionnaire was appropriate to be used among agriculturists.

IMPLEMENTASI PENDAFTARAN DOKUMEN ADMINISTRASI KEPENDUDUKAN DENGAN SISTEM ONLINE SEBAGAI UPAYA TERTIB ADMINISTRASI DI DINAS KEPENDUDUKAN DAN PENCATATAN SIPIL KABUPATEN DEMAK

&lt;p&gt;&lt;em&gt;Registration of population administration documents as an effort to orderly administration is carried out by the government with an online system to provide convenience for the community, so this study seeks to examine the implementation of registration of the population administration documents with an online system as an effort to orderly administration at the Department of Population and Civil Registration of Demak Regency, obstacles and efforts overcome it. The research methods used are: type of sociological juridical research, analytical descriptive specifications. The data used is primary data supported by secondary data with qualitative data analysis. The results showed that the registration of family card population administration documents with an online system as an effort to orderly administration at the Demak Regency Population and Civil Registration Office in January 2017 - February 2021 was based on the Republic of Indonesia Law Number 24 of 2013 concerning Population Administration changes. on Law Number 23 of 2006 concerning Population Administration, and Regulation of the Minister of Home Affairs of the Republic of Indonesia Number 7 of 2019 concerning Online Population Administration Services with the mechanism starting with register, login, select menu, upload, send, finish. For the implementation of the registration, there were 5,472 documents. The orderliness of administrative documents after using the online system before using the online system shows that it is more orderly to use the online system, as indicated by the increasing number from year to year. The obstacles include 2 things, first, the public's lack of understanding to access online services, in this case it can be attempted by means of socialization, namely through brochures, websites, Instagram and Youtube; Second, the absence of a strong network/signal in some areas, in this case it can be attempted by serving reporters who wish to register documents directly.&lt;/em&gt;&lt;em&gt;&lt;/em&gt;&lt;/p&gt;

Comparing random dot motion in MATLAB vs. Inquisit Millisecond.

Random Dot Motion (RDM) displays refer to clouds of independently moving dots that can be parametrically manipulated to provide a perception of the overall cloud moving coherently in a specified direction of motion. As a well-studied probe of motion perception, RDMs have been widely employed to understand underlying neural mechanisms of motion perception, perceptual decision-making, and perceptual learning, among other processes. Despite their wide use, RDM stimuli implementation is highly dependent on the parameters and the generation algorithm of the stimuli; both can greatly influence behavioral performance on RDM tasks. With the advent of the COVID pandemic and an increased need for more accessible platforms, we aimed to validate a novel RDM paradigm on Inquisit Millisecond, a platform for the online administration of cognitive and neuropsychological tests and assessments. We directly compared, in the same participants using the same display, a novel RDM paradigm on both Inquisit Millisecond and MATLAB with Psychtoolbox. We found that psychometric functions of Coherence largely match between Inquisit Millisecond and MATLAB, as do the effects of Duration. These data demonstrate that the Millisecond RDM provides data largely consistent with those previously found in laboratory-based systems, and the present findings can serve as a reference point for expected thresholds for when these procedures are used remotely on different platforms.

Validation of Videoconference Administration of Picture Description From the Western Aphasia Battery-Revised in Neurotypical Canadian French Speakers.

During the COVID-19 pandemic, clinicians and researchers have increasingly used remote online assessments to pursue their activities, but mostly with tests not validated for videoconference administration. This study aims to validate the remote online administration of picture description in Canadian French neurotypical speakers and to explore the thematic unit (TU) checklist recently developed. Spoken discourse elicited through the picture description task of the Western Aphasia Battery-Revised (WAB-R) was collected from Canadian French neurotypical speakers from Québec aged between 50 and 79 years old. Forty-seven participants completed the task in person, and 49 participants completed the task by videoconference. Videos of each discourse sample were transcribed using CHAT conventions. Microstructural variables were extracted using the CLAN (Computerized Language ANalysis) program, whereas thematic informativeness was scored for each sample using TUs. Chi-square tests were conducted to compare both groups on each TU; t tests were also performed on the total score of TUs and microstructural variables. Groups were matched on sex, age, and education variables. The t tests revealed no intergroup difference for the total TU score and for the microstructural variables (e.g., mean length of utterances and number of words per minute). Chi-square tests showed no significant intergroup difference for all 16 TUs. These findings support remote online assessment of the picnic scene of the WAB-R picture description in Canadian French neurotypical speakers. These results also validate the 16 TUs most consistently produced. The use of videoconference could promote and improve the recruitment of participants who are usually less accessible, such as people using assistive mobility technologies. https://doi.org/10.23641/asha.21476961.

Remote versus face-to-face neuropsychological testing for dementia research: a comparative study in people with Alzheimer’s disease, frontotemporal dementia and healthy older individuals

ObjectivesWe explored whether adapting neuropsychological tests for online administration during the COVID-19 pandemic was feasible for dementia research.DesignWe used a longitudinal design for healthy controls, who completed face-to-face assessments 3–4...

Viewing Time Measures of Sexual Interest and Sexual Offending Propensity: An Online Survey of Fathers

Relative viewing times (VTs)—time required to view and evaluate sexually salient images—discriminate individuals with a sexual interest in children, as indirectly indexed by their history of sexual offending against children, from those without such history. In an online sample of 652 fathers, we measured VTs and sexual attraction ratings to child and adult images. We assessed participants’ sexual offending history and propensity (self-reported likelihood to have a sexual contact with a child, a non-consensual sexual contact with an adult, and propensity toward father–daughter incest). In contrast with VT studies involving clinical or forensic samples, VTs and attraction ratings failed to discriminate participants with a sexual offending history. VTs successfully distinguished participants with a propensity to sexually offend against children but failed to identify those with a propensity toward incest. Conversely, attraction ratings distinguished participants with a propensity toward incest but failed to identify those with a propensity to sexually offend against children. Correlations between VTs and attraction ratings were small. Results illustrate, for the first time, the distribution of VT measures in community fathers, support the feasibility of online administration of VT tasks to detect propensity to sexually offend against children, and indicate that sexual interest in children and incest propensity are distinct.