Quality Assessment Instrument Research Articles

Strategies for reducing pain at dressing change in chronic wounds: protocol for a mapping review

IntroductionAlthough pain experienced at dressing change has been reported as the worst aspect of living with chronic wounds, UK guidance for their management is primarily tailored to wound healing and...

Key elements in the quality assessment of a type 3 medication review.

Background: Medication reviews are a structured evaluation of a patient's pharmacotherapy with the aim of optimizing medicines use and improving health outcomes. This entails detecting drug related problems and recommending interventions. A high level of quality is essential for the successful implementation of this service in community pharmacies but currently there is no instrument or tool to assess that overall quality. Aim: This study investigated the development of quality criteria of type 3 medication reviews (MR3s). Methods: After surveying the literature, an electronic questionnaire was developed to gather information about quality criteria for MR3. This survey, in Dutch, was distributed electronically. Four groups were queried: 1) pharmacists, mainly working in the Netherlands, involved in practice research and contacted through the PRISMA (Practice Research In Collaboration With Pharmacists) foundation, 2) Belgian pharmacy academics and pharmacists active in professional associations (APA), 3) Belgian pharmacists trained in medication review (MR) by the Royal Pharmacists Association of Antwerp (KAVA) and 4) Belgian pharmacy students. The survey included 57 criteria, divided into eight domains, which were ranked according to their importance by the participants. The results were analyzed statistically using the nonparametric Kruskal-Wallis test. Results: The survey was completed by 95 participants, including 42 PRISMA pharmacists, 19 APA pharmacists, 18 KAVA pharmacists and 16 pharmacy students. Opinions from participants from the different groups overlapped significantly. The use of simple and understandable language in the conversation with the patient was considered essential by the majority. Discussing the usefulness and purpose of a MR3 with the patient was also rated highly by all groups. Differences of opinion were present in aspects about laboratory values, the use of specific tools, and reporting to and consultation with the treating physician. The participants themselves formulated a limited number of additional assessment criteria. Conclusion: There was widespread agreement on the hierarchy of the quality assessment criteria for MR3s. Minor differences were related to the experience of the participants. With these results and a small number of suggested extra criteria, a quality assessment instrument for MR3 can be created.

Children’s Perceptions of their Involvement in Judicial Child Protection, Family and Criminal Proceedings

Abstract The present study synthesises published investigations into children’s involvement in the judicial child protection, family and, as victims and witnesses, in criminal proceedings, their perceptions and attitudes relative to their experience, and to each specific context in which they participated. Using the prisma Statement, we consulted five electronic databases (B-On, pbsc, asc, PsycInfo, and medline) to examine relevant studies (empirical, systematic reviews and meta-analyses), and we defined inclusion/exclusion criteria. We included 13 studies in the present review, published between 1992 and 2020 and carried out in different judicial contexts (criminal, protection, and family), to which we applied a methodological quality assessment instrument. From the main evidence of each study, we carried out an integrative synthesis. The findings identified children’s perceptions and attitudes towards the justice system, what they considered the most positive and the most negative aspects of their involvement, and the specificities of each judicial context. Implications for practice and further research were considered.

ANALISIS KUALITAS LAYANAN WEBSITE DISDUKCAPIL KABUPATEN SEMARANG DIUKUR MENGGUNAKAN INSTRUMEN WEBQUAL 4.0

The Department of Population and Civil Registration organizes and publishes all matters relating to population. The existence of a service information system is a method used by Disdukcapil Semarang Regency to implement e-government, namely through the website http://dukcapil.semarangkab.go.id. Testing is needed for website user satisfaction using Webqual 4.0 as a website quality assessment instrument. The goal of this study is to get an overview of the influence/impact of the three website quality dimensions: usability, information, and service interaction qualities on user satisfaction. This study used 60 data tested by validity, reliability, multiple linear regression, t-test, and F-test. The results showed that the usability and information qualities affects user satisfaction, but the service interaction quality does not. In addition, the research found that the three dimensions of website quality together did not affect user satisfaction. They affect 39.2% of user satisfaction, while other factors outside the variables studied influence the other 60.8%.

Stepwise development of a quality assessment instrument for the medicines’ pathway in nursing homes

BackgroundQuality of care in nursing homes (NHs), and especially the quality of the medicines’ pathway, remains a concern. ObjectivesTo develop a quality assessment instrument to support NHs to evaluate the quality of their medicines’ pathway, and to formulate recommendations for its implementation. MethodsA stepwise approach was used. First, a performance questionnaire for coordinating physicians, pharmacists and head nurses was developed, alongside a set of quality indicators (QIs). Next, a feasibility study regarding the QIs was performed in 4 NHs, followed by two pilot studies to optimize the instrument (in 14 and 9 NHs, respectively). Focus groups were held to formulate recommendations for instrument implementation. ResultsThe QI feasibility and first pilot study showed that the clarity and feasibility of QIs was insufficient. All QIs were therefore integrated in the performance questionnaire. The first pilot study also showed low response rates for certain questions in the performance questionnaire and resulted in a revision of questions with the aim to target the right type of healthcare professional, including quality coordinators and general practitioners. The final instrument targets all involved healthcare professionals (i.e. coordinating physicians, pharmacists, head nurses, general practitioners, and quality coordinators), and applies a sequential approach: a quick scan to set priorities, followed by a detailed scan to detect specific working points. The second pilot study showed appreciation for this approach. Last, five recommendations were made to promote the instrument's implementation. ConclusionsA series of feasibility and pilot studies allowed the stepwise optimization of a quality assessment instrument for the medicines' pathway in NHs and resulted in modifications to improve its clarity and feasibility. Participants’ recommendations will promote the successful implementation of the quality assessment instrument.

Effect of the COVID-19 pandemic on obesity and its risk factors: a systematic review

BackgroundCoronavirus disease (COVID-19) is a contagious disease caused by the severe acute new coronavirus called SARS-CoV-2. Devastating social, economic, and health service utilisation-related activities. Increased burden and lifestyle changes due to confinement.ObjectiveThis study aimed to investigate and determine the determinants of obesity during the coronavirus disease (COVID-19) pandemic from 2019 to 2023.MethodsObservational studies published between December 2019 and January 2023 were thoroughly searched using a PRISMA flow chart. PubMed, Google Scholar, Web of Science, HINARI, Scopus, and Embase databases were used. Two reviewers independently identified and critically evaluated the relevant literature. Studies that reported weight gain or involved BMI measurements of 25 kg/m2 or BMI z-scores for children during the COVID-19 lockdown were selected for inclusion. The Newcastle–Ottawa Scale (NOS) was used as a quality assessment instrument in nonrandomised studies to evaluate study quality. All the contributing determinants of weight increase were identified, gathered, and synthesised.ResultsThis systematic review identified 40 studies with a total population of 5,681,813 from 22 countries, of which 74.6% were male. The sample size from included articles ranged from 37 to 5,315,435. Of the 40 selected articles, 24 focused on adults, five on adolescents, three on children, and eight on children and adolescents. Physical inactivity, sedentary behaviour, bad eating habits, behavioural lifestyle, excessive stress, depression, anxiety, behavioural risk factors, sex, and ethnic minorities were associated with obesity during the COVID-19 pandemic lockdown.ConclusionDuring the COVID-19 pandemic, physical inactivity, sedentary lifestyle, and poor eating patterns were the most common risk factors for obesity. Additionally, unhealthy eating habits, excessive behavioural stress, depression, anxiety, low mood, age, gender, and ethnic minorities have been identified as risk factors for obesity during the COVID-19 pandemic.

Experiences with Cling Film and Dental Dam Use in Oral Sex: A Mixed-Methods Systematic Review

This study aimed to conduct a mixed-methods SR of the literature investigating the experiences (knowledge, attitudes, practices, and effects of use) concerning dental dam and cling film use. The SR methodology was informed by the Preferred Reporting Items for SRs and Meta-analysis framework, the Cochrane Handbook for SR of Interventions, the Joanna Briggs Institute guideline for conducting mixed-methods SRs, and the PICO (population, intervention (or exposure), comparison, and outcome) framework. Using a set of inclusion criteria, relevant studies in the literature were obtained for the review from 11 electronic databases, Teesside University Library, websites of multilateral health organisations, and reference lists of eligible literature. The included literature was appraised for quality using the Mixed Methods Appraisal Tool version 2018 and the AAOCDS Tool. Only those studies in the literature with sufficient quality were finally included for data extraction (using an adapted version of the JBI Quality Assessment and Review Instruments) and synthesis. Best evidence synthesis was performed for the quantitative data, while meta-aggregation was performed for the qualitative data. The synthesised data were then configured using the segregated approach. A total of 529 studies from the literature were obtained from the searched databases, while only four were obtained from the other sources. After de-duplication, screening, and quality appraisal, a total of 17 studies were found eligible and included in this review. Sixteen studies were non-grey literature while, one was grey literature, and only a few reported a finding on cling film and heterosexual populations. A total of 5516 adolescents and adults were investigated in the analysed literature. Overall, the reported knowledge of dental dams was generally poor, while no study reported knowledge of cling film. The attitudes towards dental dams/cling film were complex and predominantly negative, with very few participants using dental dams/cling film for oral sex. No study reported any finding on the effect(s) of dental dam/cling film use. In conclusion, there is a need for robust and strategic public health interventions for sexual health and safer oral sex practices.

THE OUTCOMES OF JOB SATISFACTION ON PUBLIC SECTOR ORGANIZATIONS’ EMPLOYEES ACROSS COUNTRIES: A SYSTEMATIC REVIEW

Background: Organizational leaders in public sector organizations must pay serious attention to employee job satisfaction because they provide community services. Ensuring employee job satisfaction in public entities is the key to improving service quality and maintaining their consistency in serving the community. Employees who are satisfied with their work will be willing to work hard to achieve organizational goals. Objectives: We aim to systematically review the empirical literature on employee job satisfaction outcomes in public sector organizations across countries. Design: We conducted a systematic review based on previous researchers’ protocols. Data sources: We use electronic databases, including Scopus Search, PubMed Search, Sciencedirect.com Search, and Google Scholar Search from 2010 to February 2022. Review methods: We include articles that examine the outcomes of employee job satisfaction in public sector organizations. The team independently reviewed and determined each study that met the inclusion criteria. Next, the rest of the team assessed the quality of the papers using a predetermined quality assessment instrument. Then to the included studies, data extraction was carried out. Finally, we conducted an in-depth content analysis to identify the outcomes of employee job satisfaction. Results: We have identified 33 outcomes of job satisfaction. We divided these outcomes into six categories: job attitude, performance, happiness, prosocial behavior, work motivation, and customer satisfaction. The team also found inconsistent research results, providing research gaps for other researchers to follow up

Availability and quality of assessment instruments on patient-centredness in older adults with multimorbidity: a systematic review.

Patient-centredness (PC) is central to the health care of older adults with multimorbidity, but knowledge about the psychometric quality of instruments measuring it in this group is scarce. Based on an integrative model of PC, we aimed to identify assessment instruments of PC for this particular group and evaluate their psychometric properties. We systematically searched six electronic databases (MEDLINE, CINAHL, EMBASE, PsycINFO, Web of Science and PSYNDEX), initially covering research published up to 2018 and updated later to include work up to July 2022. In evaluating the psychometric properties of identified instruments, we followed the COSMIN methodology. We identified 12 studies reporting on 10 instruments measuring PC in the health care of older adults with multimorbidity. For these instruments, structural validity and internal consistency were the psychometric properties reported most often. Based on the COSMIN criteria, eight instruments received favourable ratings for internal consistency with respect to methodological quality ('very good'), measurement property ('sufficient') and overall quality of evidence ('moderate'). Ratings of structural validity varied more largely, with three to seven instruments showing at least adequate methodological quality, sufficient structural validity or moderate quality of evidence. Similar to comparable previous reviews, evidence on the psychometric properties of instruments assessing PC in the health care of older adults with multimorbidity was rather limited. Informed by comprehensive models of PC, further research should aim at developing measures of PC that stand out on a broader range of psychometric properties.

Determinants of Job Satisfaction of Public Sector Organizations’ Employees in Six Continents: A Systematic Review

This article aims to systematically review the empirical literature on the determinants of employees’ job satisfaction in public sector organizations worldwide. This article conducted a systematic review referring to the protocol proposed by Lee & Cummings (2008). Data sources used electronic databases, including Scopus Search, PubMed Search, and Google Scholar Search from 2008 to February 2022. Review methods included articles that examine the determinants of employee job satisfaction in public sector organizations. Team members independently reviewed and determined each paper that met the inclusion criteria. Then we assessed the quality of the articles using a predetermined quality assessment instrument. Next, we perform data extraction. Finally, we conducted a comprehensive content analysis to categorize the factors related to employee job satisfaction. The results concluded that implementing appropriate leadership styles, prosocial behavior, rewards, organizational commitment, organizational justice, empowerment, emotional intelligence, and organizational communication can increase job satisfaction in public sector organizations. Toxic leadership style and job stress can reduce employee job satisfaction. In addition, we also revealed some inconsistencies in research results, which have provided research gaps for other researchers to follow up on the future.

Changes in the Experience of Stuttering Following Intensive Prolonged Speech and Non-Avoidance Treatments

Purpose: The main purpose of this study is to apply a multidimensional comprehensive instrument to evaluate the overall impact of stuttering (OASES-A) from the perspective of adults who stutter (AWS) who completed one of two intensive stuttering therapies: The La Trobe prolonged speech program and Van Riper’s non avoidance approach. Methods: The OASES-A was applied to evaluate participants’perceptions of their experience of stuttering with the specific aim of compare the changes in the experience of stuttering following two intensive treatments. An essential element in post-treatment evaluation are changes in the speaker’s self reported quality of life. Results: OASES-A group results regarding the La Trobe and Van Riper intensive treatment outcomes show positive changes in stuttering experience for 27 AWS in four sections: 1) general information on stuttering; 2) reactions to stuttering; 3) communication in daily situations; and 4) quality of life. Conclusions: The article represents the first English-language documentation of the Bulgarian results of OASES-A application of previously conducted intensive treatments. OASES-A outcomes show significantly greater overall improvement and changes in the four sections that relate to the experience of stuttering following two intensive treatments. As a research-based instrument for assessment of quality of life in AWS, the OASES-A was easy to administer and analyze. The OASES-A describes in substantial detail the experience and influence that stuttering exerts on quality of life from the client’s perspective. Its application was preferred because it assists speech-language pathology Master’s degree students to recognize the speech needs, abilities, preferences, and interests of AWS.

Classroom Assessment in Higher Education

Classroom assessment is the process of documenting the knowledge, skills, attitudes and beliefs of learners. It provides essential feedback to both instructors and students to improve their teaching methods for guiding and motivating students to be actively involved in their learning. Assessment drives learning. Formative assessments enable the instructor to guide the students to learn well. Summative assessments enable the measurement of levels of attainment of course outcomes and act as feedback to course design and curriculum improvement. This article presents the underlying principles of assessment through a discussion of assessment approaches and their purposes, types of assessment items, quality of assessment and summative assessment plans. Quality assessment instruments can be developed through an understanding of the quality attributes of assessment items, the process of designing assessment instruments, designing a variety of assessment items, and devising plans to evaluate them through rubrics. An approach is presented for creating a summative assessment plan that can also lead to the attainment of outcomes as per the requirements of programme accreditation.

A Quality Assessment Instrument for Systematic Literature Reviews in Software Engineering

Context: Systematic literature reviews (SLRs) have become standard practise as part of software engineering research, although their quality varies. To build on the reviews, both for future research and industry practice, they need to be of high quality. Objective: To assess the quality of SLRs in software engineering, we put forward an appraisal instrument for SLRs. The instrument is intended for use by appraisers of reviews, but authors may also use it as a checklist when designing and documenting their reviews. Method: A well-established appraisal instrument from research in healthcare was used as a starting point to develop a quality assessment instrument. It is adapted to software engineering using guidelines, checklists, and experiences from software engineering. As a validation step, the first version was reviewed by four external experts on SLRs in software engineering and updated based on their feedback. Results: The outcome of the research is an appraisal instrument for the quality assessment of SLRs in software engineering. The instrument intends to support the appraiser in assessing the quality of an SLR. The instrument includes 16 items with different options to capture the quality. The item is assessed on a two or three-grade scale, depending on the item. The instrument also supports consolidating the items into groups, which are then used to assess the overall quality of a systematic literature review. Conclusion: It is concluded that the presented instrument may be helpful support for an appraiser in assessing the quality of SLRs in software engineering.

Evidence for publicly reported quality indicators in residential long-term care: a systematic review

BackgroundAn increasing number of countries are using or planning to use quality indicators (QIs) in residential long-term care. Knowledge regarding the current state of evidence on usage and methodological soundness of publicly reported clinical indicators of quality in nursing homes is needed. The study aimed to answer the questions: 1) Which health-related QIs for residents in long-term care are currently publicly reported internationally? and 2) What is the methodological quality of these indicators?MethodsA systematic search was conducted in the electronic databases PubMed, CINAHL and Embase in October 2019 and last updated on August 31st, 2022. Grey literature was also searched. We used the Appraisal of Indicators through Research and Evaluation (AIRE) instrument for the methodological quality assessment of the identified QIs.ResultsOf 23′344 identified records, 22 articles and one report describing 21 studies met the inclusion criteria. Additionally, we found 17 websites publishing information on QIs. We identified eight countries publicly reporting a total of 99 health-related QIs covering 31 themes. Each country used between six and 31 QIs. The most frequently reported indicators were pressure ulcers, falls, physical restraints, and weight loss. For most QI sets, we found basic information regarding e.g., purpose, definition of the indicators, risk-adjustment, and stakeholders’ involvement in QIs’ selection. Little up to date information was found regarding validity, reliability and discriminative power of the QIs. Only the Australian indicator set reached high methodological quality, defined as scores of 50% or higher in all four AIRE instrument domains.ConclusionsLittle information is available to the public and researchers for the evaluation of a large number of publicly reported QIs in the residential long-term care sector. Better reporting is needed on the methodological quality of QIs in this setting, whether they are meant for internal quality improvement or provider comparison.

Pengembangan instrumen penilaian sikap sosial pada pembelajaran tematik sub tema aku anak mandiri kelas IV sekolah dasar

<p class="Abstract">The formation of students' social attitudes in thematic learning needs to be supported by quality assessment instruments. The purpose of this study is to (1) identify social attitudes in learning, (2) develop a social attitude assessment scale in learning, and (3) analyze the validity and reliability of the instrument. assessment of developed social attitudes. The study used the Research and Development (RnD) method. The research was carried out in Daerah Binaan IV Disdikbuk Muntilan District in the odd semester of the 2021/2022 academic year. The population in this study were 4th grade students of SD Daerah Binaan IV in the area of Desdikbud, Muntilan District. The sample used is grade 4 students at Daerah Binaan IV. The sampling technique used purposive sampling as many as 100 samples, namely the class that carried out observation activities in the thematic learning of the Let's Love the Environment sub theme. The data taken are the assessment instrument model for SD Daerah Binaan IV, the quality of the social attitude assessment scale developed rationally, and empirically. Internal consistency analysis of items was performed using IBM Statistics SPSS 21.0 for Windows. The results obtained are the product in the form of an honest, disciplined, hard-working and independent social attitude assessment scale. Likert scale model meets the criteria for being rationally and empirically feasible, the results of the validity test show that from 20 statements there is one statement that is rejected, namely statement number 6 because of the r value. the count is smaller than 0.195, which is 0.116, 20 items are declared reliable with -Cronbach 0.815 above the minimum standard of 0.6. Based on the results and discussion, it can be concluded that the social attitude assessment instrument developed is suitable for use in thematic learning, especially the Let's Love the Environment Sub-theme in Daerah Binaan IV Disdikbud Muntilan District.</p>

Quality analysis of quality control system in work units based on the Routine Data Quality Assessment of X Hospital in Semarang District

Background and purpose: An excellent process of hospital quality management system produces useful data for the management in the future decision-making. The problem obtained from the quality management system of X hospital was that the data collectors do not understand the procedure of data collection, thus the data became less complete and less accurate. Routine Data Quality Assessment (RDQA) instrument is recommended to measure the data quality. This study aims to analyze the data quality in the quality management system of X Hospital work unit in Semarang. Methods: Quantitative method was applied in this study using cross-sectional approach. RDQA instrument was used as a model of quality assessment of routine data that can be implemented to evaluate the quality of the collected data. Purposive sampling was used in the selection of informants. This study involved 22 quality managers at level I (the wards) as the informants who conducted the data selection, three quality managers at level II as data collectors, and one quality manager at level III as a data center. The data were analyzed both quantitatively and qualitatively. The work units assessed in this study include the outpatient, inpatient and critical units. Result: RDQA instrument was adapted by adjusting the substanceof RDQA with the standards of hospital accreditation in Indonesia. The development of indicator 2 focused on the understanding of data collection, while indicator 3 focused on the supervision of data collection, and indicator 5 focused on the staff understanding on the recommendation of quality achievement results. The application of RDQA articulated that the quality control systems did not optimally run, including the lack of understanding of the data collection procedure, non optimal supervision of quality management, not all quality manager conduct data verification properly, not all staff understand the recommendations of the quality achievement results. The highest percentage of the data quality was 93% and the lowest was 72%. In general, the system assessment was 1.5-2.5 which indicated that the data were partially complete/available/ operated. Conclusion: RDQA resulted that the data quality control on the hospital quality management system has not yet to be conducted optimally.

Valuing the Quality-of-Life Aged Care Consumers (QOL-ACC) Instrument for Quality Assessment and Economic Evaluation.

ObjectiveThis paper reports on the valuation of the classification system for the Quality-of-Life Aged Care Consumers (QOL-ACC) instrument using a discrete choice experiment (DCE) with duration with a large sample of older people receiving aged care services.MethodsA DCE with 160 choice sets of two quality-of-life state–survival duration combinations blocked into 20 survey versions, with eight choice sets in each version, was designed and administered through an on-line survey to older Australians receiving aged care services in home and via interviewer facilitation with older people in residential aged care settings. Model specifications investigating preferences with respect to survival duration and interactions between QOL-ACC dimension levels were estimated. Utility weights were developed, with estimated coefficients transformed to the 0 (being dead) to 1 (full health) scale to generate a value set suitable for application in quality assessment and for the calculation of quality-adjusted life-years for use in economic evaluation.ResultsIn total, 953 older people completed the choice experiment with valid responses. The estimation results from econometric model specifications indicated that utility increased with survival duration and decreased according to quality-of-life impairment levels. An Australian value set (range − 0.56 to 1.00) was generated for the calculation of utilities for all QOL-ACC states.ConclusionThe QOL-ACC is unique in its focus on measuring and valuing quality of life from the perspective of older people themselves, thereby ensuring that the preferences of aged care service users are the primary focus for quality assessment and economic evaluation.Supplementary InformationThe online version contains supplementary material available at 10.1007/s40273-022-01158-2.

Levels of Evidence, Quality Assessment, and Risk of Bias: Evaluating the Internal Validity of Primary Research.

Clinical decisions in human and veterinary medicine should be based on the best available evidence. The results of primary research are an important component of that evidence base. Regardless of whether assessing studies for clinical case management, developing clinical practice guidelines, or performing systematic reviews, evidence from primary research should be evaluated for internal validity i.e., whether the results are free from bias (reflect the truth). Three broad approaches to evaluating internal validity are available: evaluating the potential for bias in a body of literature based on the study designs employed (levels of evidence), evaluating whether key study design features associated with the potential for bias were employed (quality assessment), and applying a judgement as to whether design elements of a study were likely to result in biased results given the specific context of the study (risk of bias assessment). The level of evidence framework for assessing internal validity assumes that internal validity can be determined based on the study design alone, and thus makes the strongest assumptions. Risk of bias assessments involve an evaluation of the potential for bias in the context of a specific study, and thus involve the least assumptions about internal validity. Quality assessment sits somewhere between the assumptions of these two. Because risk of bias assessment involves the least assumptions, this approach should be used to assess internal validity where possible. However, risk of bias instruments are not available for all study designs, some clinical questions may be addressed using multiple study designs, and some instruments that include an evaluation of internal validity also include additional components (e.g., evaluation of comprehensiveness of reporting, assessments of feasibility or an evaluation of external validity). Therefore, it may be necessary to embed questions related to risk of bias within existing quality assessment instruments. In this article, we overview the approaches to evaluating internal validity, highlight the current complexities, and propose ideas for approaching assessments of internal validity.

Creation of an online inventory for choosing critical appraisal tools

Critical appraisal of evidence is performed to assess its validity, trustworthiness and usefulness in evidence-based practice. There currently exists a large number and variety of critical appraisal tools (also named risk of bias tools and quality assessment instruments), which makes it challenging to identify and choose an appropriate tool to use. We sought to develop an online inventory to inform librarians, practitioners, graduate students, and researchers about critical appraisal tools. This online inventory was developed from a literature review on critical appraisal tools and is kept up to date using a crowdsourcing collaborative web tool (eSRAP-DIY). To date, 40 tools have been added to the inventory (www.catevaluation.ca), and grouped according to five general categories: (a) quantitative studies, (b) qualitative studies, (c) mixed methods studies, (d) systematic reviews and (e) others. For each tool, a summary is provided with the following information: tool name, study designs, number of items, rating scale, validity, reliability, other information (such as existing websites or previous versions), and main references. Further studies are needed to test and improve the usability of the online inventory, and to find solutions to reduce to monitoring and update workload.

Evaluation of the quality and subsequent performance of manuscripts rejected by Clinical Rheumatology: a research report

To assess the quality and performance of manuscripts previously rejected by a rheumatology-focused journal. This was a cross-sectional, audit-type, exploratory study of manuscripts submitted to Clinical Rheumatology (CLRH) and rejected by one associate editor in 2019. We used a 36-item quality assessment instrument (5-point ordinal scale, 1 being worst). Performance variables included whether a rejected manuscript was published in another PubMed-listed journal, impact factor of the publishing journal (Scimago), number of citations (Web of Science), and social media attention (Altmetrics). Exploratory variables included authors' past publications, use of reporting guidelines, and text structure. Exploratory variables were assessed using non-parametric tests. In total, 165 manuscripts were rejected. Reporting guidelines were used in only five (4%) manuscripts. The mean overall quality rating was 2.48 ± 0.73, with 54% of manuscripts rated 2; 40-80% were rated < 3 on crucial items. Over a 26-month follow-up, 79 (48%) rejected manuscripts were published in other journals, mostly with lower impact factors; 70% of these had at least one citation, compared with 90.5% for manuscripts published in CLRH. Altmetrics was significantly lower for manuscripts published elsewhere than for those published in CLRH. As for text structure, the methods and results sections were shorter and the discussion longer than suggested. The corresponding authors' past experience and text structure were not associated with quality or acceptance. Research report quality is an area for improvement, mainly for items critical to explaining the research and findings. The use of reporting guidelines should be encouraged by journals. Key Points • The quality of research reports (in rejected manuscripts) is insufficient. • Guidelines for reporting are seldom used in rejected manuscripts. • A manuscript rejected by Clinical Rheumatology may subsequently be published in another journal with a lower impact factor and have fewer citations and less social media attention than accepted manuscripts.