36-item Form Research Articles

A Latent Space Diffusion Item Response Theory Model to Explore Conditional Dependence between Responses and Response Times.

Traditional measurement models assume that all item responses correlate with each other only through their underlying latent variables. This conditional independence assumption has been extended in joint models of responses and response times (RTs), implying that an item has the same item characteristics fors all respondents regardless of levels of latent ability/trait and speed. However, previous studies have shown that this assumption is violated in various types of tests and questionnaires and there are substantial interactions between respondents and items that cannot be captured by person- and item-effect parameters in psychometric models with the conditional independence assumption. To study the existence and potential cognitive sources of conditional dependence and utilize it to extract diagnostic information for respondents and items, we propose a diffusion item response theory model integrated with the latent space of variations in information processing rate of within-individual measurement processes. Respondents and items are mapped onto the latent space, and their distances represent conditional dependence and unexplained interactions. We provide three empirical applications to illustrate (1) how to use an estimated latent space to inform conditional dependence and its relation to person and item measures, (2) how to derive diagnostic feedback personalized for respondents, and (3) how to validate estimated results with an external measure. We also provide a simulation study to support that the proposed approach can accurately recover its parameters and detect conditional dependence underlying data.

A computational account of item-based directed forgetting for nonwords: Incorporating orthographic representations in MINERVA 2.

Recent research on item-method directed forgetting demonstrates that forget instructions not only decrease recognition for targets, but also decrease false recognition for foils from the same semantic categories as targets instructed to be forgotten. According to the selective rehearsal account of directed forgetting, this finding suggests that remember instructions may engage elaborative rehearsal of the category-level information of items. In contrast to this explanation, Reid and Jamieson (Canadian Journal of Experimental Psychology / Revue canadienne de psychologie expérimentale, 76(2), 75-86, 2022) proposed that the differential rates of false recognition may emerge at retrieval when foils from "remember" and "forget" categories are compared to traces in memory. Using MINERVA S, an instance model of memory based on MINERVA 2 that incorporates structured semantic representations, Reid and Jamieson successfully simulated lower false recognition for foils from "forget" categories without assuming rehearsal of category-level information. In this study, we extend the directed forgetting paradigm to categories consisting of orthographically related nonwords. Presumably participants would have difficulty rehearsing category-level information for these items because they would have no pre-experimental knowledge of these categories. To simulate the findings in MINERVA S, we imported structured orthographic representations rather than semantic representations. The model not only predicted differential rates of false recognition for foils from "remember" and "forget" categories, but also predicted higher rates of false recognition overall than what was observed for semantic categories. The empirical data closely matched these predictions. These data suggest that differential rates of false recognition due to remember and forget instructions emerge at retrieval when participants compare recognition probes to traces stored in memory.

Developing a construction waste material ‘passport’ for cross-jurisdictional trading

By degrading the natural environment and occupying valuable land space, the massive solid waste from construction and demolition activities is looming as a global crisis. Since more than 90% of construction waste is inert and suitable for recycling, promoting waste material cross-border trading is high on the agenda of solving this crisis. However, obstructing this potential trading is the asymmetric information between stakeholders. Inspired by the ideas of travel passports and the ‘material passports’, this research designs a waste material passport (WMP) to facilitate such cross-jurisdictional trading. It is proposed that the information items such as material types, properties, circularity, handling history, and so on should be included and readily for further expansion. By substantiating it in a semi-hypothetical case study of the Greater Bay Area, China, the WMP is found to be able to reduce information asymmetry in waste trading and cover information gaps to enable a circular economy in the long run.

Gender Bias in Test Item Formats: Evidence from PISA 2009, 2012, and 2015 Math and Reading Tests

AbstractLarge‐scale standardized tests are regularly used to measure student achievement overall and for student subgroups. These uses assume tests provide comparable measures of outcomes across student subgroups, but prior research suggests score comparisons across gender groups may be complicated by the type of test items used. This paper presents evidence that among nationally representative samples of 15‐year‐olds in the United States participating in the 2009, 2012, and 2015 PISA math and reading tests, there are consistent item format by gender differences. On average, male students answer multiple‐choice items correctly relatively more often and female students answer constructed‐response items correctly relatively more often. These patterns were consistent across 34 additional participating PISA jurisdictions, although the size of the format differences varied and were larger on average in reading than math. The average magnitude of the format differences is not large enough to be flagged in routine differential item functioning analyses intended to detect test bias but is large enough to raise questions about the validity of inferences based on comparisons of scores across gender groups. Researchers and other test users should account for test item format, particularly when comparing scores across gender groups.

Delayed evolutionary game clustering-based recommendation algorithm via latent information and user preference

Recommendation system is widely used because of its personalized service. It helps users obtain satisfactory results due to ambiguous expression in search engines. However, with the increasing number of users and items, most of the existing recommendation algorithms have problems of cold start, sparse data and high complexity. To address the above issues, this paper applies the rating information and attribute information of users and items to better represent the preferences of users and the activity of items by enriching the available information. Furthermore, we propose a novel game-based evolutionary clustering method to divide interest communities for users, which not only reduces the complexity of recommendation, but also takes full account of users’ preferences. In addition, the impact of delayed information transmission on experimental performance is considered in the game-based evolutionary clustering. Since the calculation of similarity plays a significant role in finding the nearest neighbors of target users in the community, we propose a new similarity measurement strategy based on user preferences. Finally, the effectiveness of the proposed algorithm is verified by ablation experiment and comparison experiments. The experimental results illustrate that our algorithm outperforms the existing excellent algorithms.

Development of a program to determine optimal settings for robot-assisted rehabilitation of the post-stroke paretic upper extremity: a simulation study

Robot-assisted therapy can effectively treat upper extremity (UE) paralysis in patients who experience a stroke. Presently, UE, as a training item, is selected according to the severity of the paralysis based on a clinician’s experience. The possibility of objectively selecting robot-assisted training items based on the severity of paralysis was simulated using the two-parameter logistic model item response theory (2PLM-IRT). Sample data were generated using the Monte Carlo method with 300 random cases. This simulation analyzed sample data (categorical data with three difficulty values of 0, 1, and 2 [0: too easy, 1: adequate, and 2: too difficult]) with 71 items per case. First, the most appropriate method was selected to ensure the local independence of the sample data necessary to use 2PLM-IRT. The method was to exclude items with low response probability (maximum response probability) within a pair in the Quality of Compensatory Movement Score (QCM) 1-point item difficulty curve, items with low item information content within a pair in the QCM 1-point item difficulty curve, and items with low item discrimination. Second, 300 cases were analyzed to determine the most appropriate model (one-parameter or two-parameter item response therapy) to be used and the most favored method to establish local independence. We also examined whether robotic training items could be selected according to the severity of paralysis based on the ability of a person (θ) in the sample data as calculated by 2PLM-IRT. Excluding items with low response probability (maximum response probability) in a pair in the categorical data 1-point item difficulty curve was effective in ensuring local independence. Additionally, to ensure local independence, the number of items should be reduced to 61 from 71, indicating that the 2PLM-IRT was an appropriate model. The ability of a person (θ) calculated by 2PLM-IRT suggested that seven training items could be estimated from 300 cases according to severity. This simulation made it possible to objectively estimate the training items according to the severity of paralysis in a sample of approximately 300 cases using this model.

Examining the Psychometric Integrity of the Social Skills Improvement System Teacher Rating Scale Scores for a Sample of Preschool-Age Children

The Social Skills Improvement System–Teacher Rating Scale (SSIS-TRS) has been widely used to measure the social skills and behaviors of children and adolescents that are challenging. Studies examining the psychometric properties of the SSIS-TRS have been conducted, but the dimensional structure and item properties of the SSIS-TRS have not been extensively examined with samples of preschool-age children at risk for social-emotional and behavioral difficulties. This current study was designed to examine (a) the dimensional structure of the Social Skills scale and Problem Behaviors scale of the SSIS-TRS and (b) the item function of the SSIS-TRS using item response theory analyses with data collected from teachers of a sample of 469 preschool-age children at risk for social–emotional and behavioral difficulties. A four-dimensional structure (i.e., Cooperation, Empathy and Relationship, Engagement and Interaction, and Self-Control) and a three-dimensional structure (i.e., Aggression and Defiance, Disruptiveness and Stereotypy, and Withdrawal) were identified for the Social Skills and Problem Behaviors scales, respectively. Item parameters of the SSIS-TRS were estimated using the generalized partial credit model. Item information curves were plotted for individual items; behavior indicators providing higher information for measuring corresponding social skills and problem behaviors constructs were identified. The limitations and implications for the present study are discussed.

Dental students' clinical and academic experience during placement in a UK tertiary care children's hospital.

There are well-recognized difficulties across UK dental schools in recruiting paediatric patients who are willing to attend, have manageable dental disease, and do not require the behaviour management skills of an experienced dentist. This presents a concern for the skill development of the future workforce. At the School of Dentistry in Liverpool, the challenge to enable students to develop these core skills is supported by attendance at a tertiary care children's hospital. The present study investigates whether attendance of final-year dental students at a children's hospital affects perceptions of their surgical experience, self-reported preparation for working independently as a dentist, and understanding of specialist care. A self-administered online survey was distributed to final-year dental students (2020-2021). Quantitative and qualitative data were gathered using mixed item formats for descriptive analysis. Questions addressed themes including experience of primary tooth exodontia, understanding of general anaesthetic dental care and multidisciplinary patient management. The response rate was 90% (n = 66). Attendance was beneficial to student learning and experience; responders reported increased surgical experience, self-confidence and understanding of multidisciplinary care. Students developed insight into future career pathways. The present study supports the use of external clinic rotations, known as outreach placements, for dental student training. The findings support existing literature demonstrating the value of outreach placements in providing an experience not available in dental school environments. Dental students' perceptions of their surgical experience, knowledge of specialist care, and preparedness for independent practice may be enhanced by attendance to outreach placements.

The effects of work task difficulty on health information searching behaviour

Information needs and information seeking processes depend on contextual factors. Identifying and paying attention to contextual factors such as work tasks can be helpful for personalization of information retrieval. This study aimed to determine the relationship between work task difficulty and interactive health information searching behaviour (HISB). The study was performed through an analysis of transaction logs to identify relation between the work task difficulty and HISB of postgraduate student health ambassadors (PSHB). Thirty participants were purposefully sampled and invited to complete four simulated work tasks. User perception of work task difficulty, satisfaction, and success of search process were measured using questionnaires. A total of 120 log files were analysed. The results showed that with increasing tasks difficulty, PSHB see more results pages, review more information items and finally save more documents. Also, with increasing difficulty, PSHB enter more and longer queries in information retrieval systems and, in addition to changing the query more, they use more keywords and longer queries to search. As the task difficulty increases, the rate of satisfaction and success, as well as the navigational speed decrease. Understanding how work task attributes affect HISB can be effective for designers of interactive information retrieval systems, and developers of personalized health information retrieval systems and recommendation systems based on contextual information.

Can EAT-10 Become EAT-5? Improving Measurement Efficiency of Dysphagia with Item Response Theory.

To assess: (1) the Eating Assessment Tool (EAT-10) with item response theory (IRT) to determine which individual items provide the most information, (2) the extent to which dysphagia is measured with subsets of items while maintaining precise score estimates, and (3) if 5-item scales have the differing discriminatory ability, as compared to the parent 10-item instrument. Prospectively collected data from 2,339 patients who completed the EAT-10 questionnaire during evaluation at a tertiary care otolaryngology clinic were utilized. IRT analyses provided discrimination and location parameters associated with individual questions. Residual item correlations were also assessed for redundant information. Based on these results, three 5-item subsets were further evaluated using item information function curves. Areas under receiver-operator characteristic curves (ROC-AUC) were also calculated to evaluate the discriminatory ability for dysphagia-related clinical diagnoses. Item discrimination parameter estimates ranged from 1.71 to 5.46, with higher values indicating more information. Residual item correlations were determined within item pairs, and location parameters were calculated. Based on these data, in combination with clinical utility, three 5-item subsets were proposed and assessed. ROC-AUC analyses demonstrated no significant difference between the EAT-5-Alpha subset and the original 10-item instrument for discriminating dysphagia as a primary diagnosis (0.88, 0.88). The EAT-5-Clinical subset outperformed the original 10 instruments in ROC-AUC for aspiration. The EAT-5-Range subset was significantly associated with problems with thin liquids. IRT analyses distinguished three proposed 5-item subsets of the EAT-10 instrument, supporting shorter survey options, while still reflecting the impact of dysphagia without significant loss of discrimination. 3 (Diagnostic testing with consistently applied reference standards, partial blinding). Laryngoscope, 133:3327-3333, 2023.

Item Banks for Measuring the Effect of Blood Pressure Dysregulation on Health-Related Quality of Life in Persons With Spinal Cord Injury

ObjectiveTo report on the development and calibration of the new Blood Pressure Dysregulation Measurement System (BPD-MS) item banks that assess the effect of BPD on health-related quality of life (HRQOL) and the daily activities of Veterans and non-Veterans with spinal cord injury (SCI). DesignCross-sectional survey study. SettingTwo Veteran Affairs medical centers and a SCI model system site. Participants454 respondents with SCI (n=262 American Veterans and n=192 non-Veterans; N=454). InterventionsNot applicable Main Outcome MeasuresThe BPD-MS item banks. ResultsBPD item pools were developed and refined using literature reviews, qualitative data from focus groups, and cognitive debriefing of persons with SCI and professional caregivers. The item banks then underwent expert review, reading level assessment, and translatability review prior to field testing. The items pools consisted of 180 unique questions (items). Exploratory and confirmatory factor analyses, item response theory modeling, and differential item function investigations resulted in item banks that included a total of 150 items: 75 describing the effect of autonomic dysreflexia on HRQOL, 55 describing the effect of low blood pressure (LBP) on HRQOL, and 20 describing the effect of LBP on daily activities. In addition, 10-item short forms were constructed based on item response theory-derived item information values and the clinical relevance of item content. ConclusionsThe new BPD-MS item banks and corresponding 10-item short forms were developed using established rigorous measurement development standards, which represents the first BPD-specific patient-reported outcomes measurement system unique for use in the SCI population.

Wildlife conservation and preserving biodiversity: impactful opportunities for veterinarians?

The world is losing wildlife species at an unprecedented rate. Habitat destruction, overexploitation, and pollution are the leading causes of biodiversity decline. As a threat multiplier, climate change exacerbates these processes as demonstrated by the death of several billion wild animals in the last few years from wildfires, floods, heatwaves, and other natural disasters. In the face of these challenges, veterinarians have unique and important skillsets to contribute to wildlife conservation and the preservation of biodiversity at many levels. Veterinarians can organize and train to mobilize wildlife extraction, rescue, and rehabilitation units during natural disasters as well as build relationships with rehabilitators to provide their services for general wildlife rehabilitation needs. They can work in transdisciplinary teams to provide veterinary expertise for ecosystem health and rewilding projects. They can become sustainability champions by providing pollinator and wildlife friendly habitats at their clinics and reducing clinic waste and energy consumption, and they can engage in science communication and advocacy. When provided with the necessary information, resources, and action items, veterinarians can increase their positive impact and personal well-being through purposeful, value-driven, community-building efforts to support wildlife conservation and biodiversity.

The temporal development of memory processes in source monitoring: An investigation with mouse tracking

The present study investigated whether we first remember an item (e.g., a word itself) and then its source (e.g., position on the screen) or whether the retrieval of item and source information can (partially) overlap. Participants were tested on the source either in immediate sequence to item recognition (as standard in source-monitoring research) or following as a separate block after full completion of the item recognition test to separate these processes in time, providing a baseline. Using the mouse-tracking procedure during the item and source tests, we analyzed how item and source decisions unfolded qualitatively over time. Despite no significant difference in the aggregated trajectory curvatures, more thorough analyses based on the individual trajectories revealed differences across the test formats. In the standard format, trajectories were less curved in the source than in the item test. In contrast, in the blocked format, this difference was in the other direction with source showing more curved trajectories than item. Alternative interpretations of mouse-trajectory curvatures on the source-monitoring paradigm and what their difference may imply for item and source processing are discussed.

How to Improve Cancer Patients ENrollment in Clinical Trials From rEal-Life Databases Using the Observational Medical Outcomes Partnership Oncology Extension: Results of the PENELOPE Initiative in Urologic Cancers.

To compare the computability of Observational Medical Outcomes Partnership (OMOP)-based queries related to prescreening of patients using two versions of the OMOP common data model (CDM; v5.3 and v5.4) and to assess the performance of the Greater Paris University Hospital (APHP) prescreening tool. We identified the prescreening information items being relevant for prescreening of patients with cancer. We randomly selected 15 academic and industry-sponsored urology phase I-IV clinical trials (CTs) launched at APHP between 2016 and 2021. The computability of the related prescreening criteria (PC) was defined by their translation rate in OMOP-compliant queries and by their execution rate on the APHP clinical data warehouse (CDW) containing data of 205,977 patients with cancer. The overall performance of the prescreening tool was assessed by the rate of true- and false-positive cases of three randomly selected CTs. We defined a list of 15 minimal information items being relevant for patients' prescreening. We identified 83 PC of the 534 eligibility criteria from the 15 CTs. We translated 33 and 62 PC in queries on the basis of OMOP CDM v5.3 and v5.4, respectively (translation rates of 40% and 75%, respectively). Of the 33 PC translated in the v5.3 of the OMOP CDM, 19 could be executed on the APHP CDW (execution rate of 58%). Of 83 PC, the computability rate on the APHP CDW reached 23%. On the basis of three CTs, we identified 17, 32, and 63 patients as being potentially eligible for inclusion in those CTs, resulting in positive predictive values of 53%, 41%, and 21%, respectively. We showed that PC could be formalized according to the OMOP CDM and that the oncology extension increased their translation rate through better representation of cancer natural history.

Assessing impact, needs and quality-of-life among informal carers of people with pancreatic cancer, a prospective study: the PAN-CARER study protocol

IntroductionApproximately 10 300 people are diagnosed with pancreatic cancer each year in the UK. The cancer and its treatment inflict a significant physical, functional and emotional burden on patients. Research...

Full-Scale Information Diffusion Prediction With Reinforced Recurrent Networks.

Information diffusion prediction is an important task, which studies how information items spread among users. With the success of deep learning techniques, recurrent neural networks (RNNs) have shown their powerful capability in modeling information diffusion as sequential data. However, previous works focused on either microscopic diffusion prediction, which aims at guessing who will be the next influenced user at what time, or macroscopic diffusion prediction, which estimates the total numbers of influenced users during the diffusion process. To the best of our knowledge, few attempts have been made to suggest a unified model for both microscopic and macroscopic scales. In this article, we propose a novel full-scale diffusion prediction model based on reinforcement learning (RL). RL incorporates the macroscopic diffusion size information into the RNN-based microscopic diffusion model by addressing the nondifferentiable problem. We also employ an effective structural context extraction strategy to utilize the underlying social graph information. Experimental results show that our proposed model outperforms state-of-the-art baseline models on both microscopic and macroscopic diffusion predictions on three real-world datasets.

Measurement precision across cognitive domains in the Alzheimer's Disease Neuroimaging Initiative (ADNI) data set.

To demonstrate measurement precision of cognitive domains in the Alzheimer's Disease Neuroimaging Initiative (ADNI) data set. Participants with normal cognition (NC), mild cognitive impairment (MCI), and Alzheimer's disease (AD) were included from all ADNI waves. We used data from each person's last study visit to calibrate scores for memory, executive function, language, and visuospatial functioning. We extracted item information functions for each domain and used these to calculate standard errors of measurement. We derived scores for each domain for each diagnostic group and plotted standard errors of measurement for the observed range of scores. Across all waves, there were 961 people with NC, 825 people with MCI, and 694 people with AD at their most recent study visit (data pulled February 25, 2019). Across ADNI's battery there were 34 memory items, 18 executive function items, 20 language items, and seven visuospatial items. Scores for each domain were highest on average for people with NC, intermediate for people with MCI, and lowest for people with AD, with most scores across all groups in the range of -1 to +1. Standard error of measurement in the range from -1 to +1 was highest for memory, intermediate for language and executive functioning, and lowest for visuospatial. Modern psychometric approaches provide tools to help understand measurement precision of the scales used in studies. In ADNI, there are important differences in measurement precision across cognitive domains. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Linking self-perceived cognitive functioning questionnaires using item response theory: The subjective cognitive decline initiative.

Self-perceived cognitive functioning, considered highly relevant in the context of aging and dementia, is assessed in numerous ways-hindering the comparison of findings across studies and settings. Therefore, the present study aimed to link item-level self-report questionnaire data from international aging studies. We harmonized secondary data from 24 studies and 40 different questionnaires with item response theory (IRT) techniques using a graded response model with a Bayesian estimator. We compared item information curves to identify items with high measurement precision at different levels of the self-perceived cognitive functioning latent trait. Data from 53,030 neuropsychologically intact older adults were included, from 13 English language and 11 non-English (or mixed) language studies. We successfully linked all questionnaires and demonstrated that a single-factor structure was reasonable for the latent trait. Items that made the greatest contribution to measurement precision (i.e., "top items") assessed general and specific memory problems and aspects of executive functioning, attention, language, calculation, and visuospatial skills. These top items originated from distinct questionnaires and varied in format, range, time frames, response options, and whether they captured ability and/or change. This was the first study to calibrate self-perceived cognitive functioning data of geographically diverse older adults. The resulting item scores are on the same metric, facilitating joint or pooled analyses across international studies. Results may lead to the development of new self-perceived cognitive functioning questionnaires guided by psychometric properties, content, and other important features of items in our item bank. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

YouTube as a Source of Information for Food, Diet-Related Items, and Advisory Comments for the Management of Inflammatory Bowel Disease.

Patients with inflammatory bowel disease (IBD) often use the Internet to seek information beyond that received from healthcare professionals. This study assessed the perceptions of YouTube presenters on the role of diet in the management of IBD. Videos discussing dietary aspects (food, diet-related items, and advisory comments [FODRIACs]) in the management of IBD were included. The perceptions of presenters toward each FODRIAC were labeled as positive, negative, or neutral/intermediate, and FODRIACs were classified according to their underlying role in the management of IBD (eg, symptom management, gut inflammation). Subgroup analysis was performed by type of video presenter (patients vs healthcare professionals), type of IBD (Crohn's disease vs ulcerative colitis), and reporting of scientific evidence supporting presenters' perceptions. We identified 122 FODRIACs within 160 videos. Patient videos received a higher number of likes (median 85 [interquartile range, 35-156]) than healthcare professional videos (median 44 [interquartile range, 16-1440]) (P = .01). Scientific evidence was cited in 2 (3%) of 76 patient videos compared with 25 (35%) of 71 healthcare professional videos (P < .001). Positive perceptions were expressed about avocadoes, salmon, bananas, white bread, and rice, whereas negative perceptions were reported for processed, high-fat and high-sugar foods and carbonated drinks. Fewer negative perceptions were expressed in videos supported by scientific evidence than in videos that lacked evidence (scientific: 4 positive, 0 negative vs nonscientific: 7 positive, 20 negative; P = .01). We have identified FODRIACs proposed as beneficial or detrimental in the management of IBD. The effect this information has on dietary practice as patients with IBD self-manage their condition needs further exploration.

Establishing meaning recall and meaning recognition vocabulary knowledge as distinct psychometric constructs in relation to reading proficiency

The purpose of this paper is to (a) establish whether meaning recall and meaning recognition item formats test psychometrically distinct constructs of vocabulary knowledge which measure separate skills, and, if so, (b) determine whether each construct possesses unique properties predictive of L2 reading proficiency. Factor analyses and hierarchical regression were conducted on results derived from the two vocabulary item formats in order to test this hypothesis. The results indicated that although the two-factor model had better fit and meaning recall and meaning recognition can be considered distinct psychometrically, discriminant validity between the two factors is questionable. In hierarchical regression models, meaning recognition knowledge did not make a statistically significant contribution to explaining reading proficiency over meaning recall knowledge. However, when the roles were reversed, meaning recall did make a significant contribution to the model beyond the variance explained by meaning recognition alone. The results suggest that meaning recognition does not tap into unique aspects of vocabulary knowledge and provide empirical support for meaning recall as a superior predictor of reading proficiency for research purposes.