Research Quality Assessment Research Articles

Chromatographic analysis of ponatinib and its impurities: method development, validation, and identification of new degradation product

BackgroundPonatinib, a third-generation tyrosine kinase inhibitor, is employed in the management of adult chronic myeloid leukemia. Nevertheless, the presence of process impurities and degradation impurities linked to ponatinib may potentially influence its effectiveness and safety. Therefore, the objective of this research was to establish a robust liquid chromatography method and systematically validate it for the detection of substances related to ponatinib.MethodsThe separation of ponatinib and its impurities was conducted using an Agilent 5HC-C18 chromatographic column (4.6 mm × 250 mm, 5 μm). The mobile phase A comprised a mixture of water and acetonitrile in a 9:1 ratio, with an aqueous solution of pH 2.4 containing 2 mM potassium dihydrogen phosphate and 0.4% triethylamine. Mobile phase B, consisting of acetonitrile, was eluted in a gradient fashion. The flow rate was set at 1.0 mL/min, detection wavelength at 250 nm, column temperature at 40°C, and injection volume at 10 μL.ResultsThe method demonstrated high specificity, sensitivity, solution stability, linearity, precision, accuracy, and robustness. Additionally, this research unveiled a novel compound, imp-B, generated via the oxidative degradation of ponatinib. The molecular structure of the newly discovered product was elucidated through the utilization of nuclear magnetic resonance (NMR) and high-resolution mass spectrometry (HRMS).ConclusionIn conclusion, the chromatographic method developed in this study has the potential to be utilized for the detection of ponatinib and its impurities, thereby offering significant insights for quality assessment in ponatinib research.

Automated Assessment of Reporting Completeness in Orthodontic Research Using LLMs: An Observational Study

This study evaluated the usability of Large Language Models (LLMs), specifically ChatGPT, in assessing the completeness of reporting in orthodontic research abstracts. We focused on two key areas: randomized controlled trials (RCTs) and systematic reviews, using the CONSORT-A and PRISMA guidelines for evaluation. Twenty RCTs and twenty systematic reviews published between 2018 and 2022 in leading orthodontic journals were analyzed. The results indicated that ChatGPT achieved perfect agreement with human reviewers on several fundamental reporting items; however, significant discrepancies were noted in more complex areas, such as randomization and eligibility criteria. These findings suggest that while LLMs can enhance the efficiency of literature appraisal, they should be used in conjunction with human expertise to ensure a comprehensive evaluation. This study underscores the need for further refinement of LLMs to improve their performance in assessing research quality in orthodontics and other fields.

ChatGPT as an effective tool for quality evaluation of radiomics research.

This study aimed to evaluate the effectiveness of ChatGPT-4o in assessing the methodological quality of radiomics research using the radiomics quality score (RQS) compared to human experts. Published in European Radiology, European Radiology Experimental, and Insights into Imaging between 2023 and 2024, open-access and peer-reviewed radiomics research articles with creative commons attribution license (CC-BY) were included in this study. Pre-prints from MedRxiv were also included to evaluate potential peer-review bias. Using the RQS, each study was independently assessed twice by ChatGPT-4o and by tworadiologists with consensus. In total, 52 open-access and peer-reviewed articles were included in this study. Both ChatGPT-4o evaluation (average of two readings) and human experts had a median RQS of 14.5 (40.3% percentage score) (p > 0.05). Pairwise comparisons revealed no statistically significant difference between the readings of ChatGPT and human experts (corrected p > 0.05). The intraclass correlation coefficient for intra-rater reliability of ChatGPT-4o was 0.905 (95% CI: 0.840-0.944), and those for inter-rater reliability with human experts for each evaluation of ChatGPT-4o were 0.859 (95% CI: 0.756-0.919) and 0.914 (95% CI: 0.855-0.949), corresponding to good to excellent reliability for all. The evaluation by ChatGPT-4o took less time (2.9-3.5 min per article) compared to human experts (13.9 min per article by one reader). Item-wise reliability analysis showed ChatGPT-4o maintained consistently high reliability across almost all RQS items. ChatGPT-4o provides reliable and efficient assessments of radiomics research quality. Its evaluations closely align with those of human experts and reduce evaluation time. Question Is ChatGPT effective and reliable in evaluating radiomics research quality based on RQS? Findings ChatGPT-4o showed high reliability and efficiency, with evaluations closely matching human experts. It can considerably reduce the time required for radiomics research quality assessment. Clinical relevance ChatGPT-4o offers a quick and reliable automated alternative for evaluating the quality of radiomics research, with the potential to assess radiomics research at a large scale in the future.

Quantifying Influence: Propensity Score Matching Unravels the True Effect Sizes of Learning Management Models on Students’ Analytical Thinking

<p style="text-align:justify">Analytical thinking is crucial for developing problem-solving, decision-making, and higher-order thinking skills. Many researchers have consistently developed learning management models to enhance students' analytical thinking, resulting in extensive knowledge but lacking clear systematic summaries. This study aims to: (a) explore the effect sizes and research characteristics influencing students' analytical thinking, and (b) compare the effect sizes of learning management models after adjusting for propensity score matching. In exploring 131 graduate research papers published between 2002 and 2021, the research utilized forms for recording research characteristics and questionnaires for assessing research quality for data collection. Effect sizes were calculated using Glass's method, while data analysis employed random effects, fixed effects, and regression meta-analysis methods. The findings indicate that (a) research on learning management models significantly impacts students' analytical thinking at a high level (d̅ = 1.428). Seven research characteristics, including year of publication, field of research, level, duration per plan, learning management process, measurement and evaluation, and research quality, statistically influence students' analytical thinking, and (b) after propensity score matching, learning through techniques such as KWL, KWL-plus, Six Thinking Hats, 4MAT, and Mind Mapping had the highest influence on students' analytical thinking. Recommendations for developing students' analytical thinking involve creating a learning management process that fosters understanding, systematic practical training, expanding thinking through collaborative exchanges, and assessments using learning materials and tests to stimulate increased analytical thinking.</p>

Experiences of Intensive Care Unit Patients as They Transition to the Ward: A Thematic Synthesis.

During the transfer of intensive care unit (ICU) patients to general wards, patients often experience transfer anxiety due to changes in the healthcare environment, staff and unfamiliarity with the new ward. However, the experiences of ICU patients during this transition period have received less attention. A systematic review and synthesis of the experiences of patients transitioning from the ICU to the ward. Thematic synthesis of qualitative studies. We searched the PubMed, Embase, CINAHL and Web of Science databases for qualitative research on the transition-to-ward experience of patients in ICUs for the year 2023 February. The quality of the literature was evaluated according to the qualitative research quality assessment criteria of the Joanna Briggs Institute, as outlined by the Australian Centre for Evidence-Based Healthcare. The data were then extracted from the studies, analysed and synthesised using a thematic synthesis approach. A total of 12 papers were included and the 32 findings were distilled and consolidated into three themes: emotional reactions; imperfections in the transition process; differences between wards and ICUs; and eight sub-themes: optimism; pessimism; emotionlessness; inadequate information; inadequate communication; physical condition; differences in care; differences in environment. The transfer from an ICU to a general ward is a major change of environment for the patient and can trigger upset and anxiety. Planning for turn-out, meeting patients' information needs and easing patients' emotions are critical in this process.

The women's cardiovascular disease risk perception after hypertensive disorders of pregnancy: A qualitative meta-synthesis

BackgroundHypertensive disorders of pregnancy is associated with increased risk of cardiovascular disease later in life, but studies suggest that women with previous hypertensive disorders of pregnancy are not aware of this. Little is known about how these women perceive the condition and the associated long-term risks. ObjectivesThis study aims to examine and synthesize qualitative evidence on the perceptions and awareness of women with hypertensive disorders of pregnancy following perceived cardiovascular disease risk. MethodsComputer searches of Pub Med, Embase, Web of Science, Cochrane Library, CINAHL, CNKI, Wanfang database, Vip and SinoMed for all qualitative studies that met the inclusion criteria. The time frame for the search was from the establishment of the database to April 2024. Literature quality was assessed using the Australian Joanna Briggs Institute Centre for Evidence-Based Health Care Qualitative Research quality assessment criteria, and results were summarised and integrated using a pooled integration approach. ResultsEleven studies that fulfilled the inclusion criteria and quality assessment were included in the meta synthesis. Three themes were identified during the analysis: (1)Factors affecting perceived cardiovascular risk in women with hypertensive disorders of pregnancy; (2)Women with hypertensive disorders of pregnancy use different strategies to cope with cardiovascular risk; (3)Needs and expectations for coping with cardiovascular disease risk. ConclusionsBoth women with hypertensive disorders of pregnancy and healthcare providers lack knowledge of the link between hypertensive disorders of pregnancy and cardiovascular risk. Healthcare professionals should establish a multidimensional support model, pay timely attention to postpartum women's psycho-emotional and risk awareness, and give individualised health education to promote health behaviour change. At the same time, professionals should be given standardised training and personalised follow-up services to reduce the incidence of cardiovascular disease in the future.

TCDM: Transformational Complexity Based Distortion Metric for Perceptual Point Cloud Quality Assessment.

The goal of objective point cloud quality assessment (PCQA) research is to develop quantitative metrics that measure point cloud quality in a perceptually consistent manner. Merging the research of cognitive science and intuition of the human visual system (HVS), in this article, we evaluate the point cloud quality by measuring the complexity of transforming the distorted point cloud back to its reference, which in practice can be approximated by the code length of one point cloud when the other is given. For this purpose, we first make space segmentation for the reference and distorted point clouds based on a 3D Voronoi diagram to obtain a series of local patch pairs. Next, inspired by the predictive coding theory, we utilize a space-aware vector autoregressive (SA-VAR) model to encode the geometry and color channels of each reference patch with and without the distorted patch, respectively. Assuming that the residual errors follow the multi-variate Gaussian distributions, the self-complexity of the reference and transformational complexity between the reference and distorted samples are computed using covariance matrices. Additionally, the prediction terms generated by SA-VAR are introduced as one auxiliary feature to promote the final quality prediction. The effectiveness of the proposed transformational complexity based distortion metric (TCDM) is evaluated through extensive experiments conducted on five public point cloud quality assessment databases. The results demonstrate that TCDM achieves state-of-the-art (SOTA) performance, and further analysis confirms its robustness in various scenarios.

Synthesis of Research on Science Learning Management Affecting Problem Solving Skills: Meta-Analysis

The rapidly changing world of the 21st century is complex and unpredictable. The researcher aimed to study the findings from a meta-analysis of 42 research studies related to the learning management of science that affects problem-solving skills during 2012–2022 from a database in Thailand called ThaiLIS. The findings revealed the variables that cause different mean effect sizes and the influence of research quality on the effect size. The instruments of this research were the research quality assessment form and the research characteristics assessment form. Statistics for data analysis were mean, standard deviation, one-way analysis of variance, and multiple regression analysis. The directional research hypothesis, multi-stage sampling, randomized control group post-test only design, PBL, and Weir's solution theory were discovered in the study to be the variables that caused the mean effect sizes to differ at the statistical significance level of .05. In addition, research quality had a positive influence on the effect size. The findings of this study will be useful to teachers who want to provide learning management of science that helps students develop problem-solving skills. This will develop skills more effective than traditional teaching.

Can AI be used to assess research quality?

Can AI be used to assess research quality?

Reflecting on the quality of a methodologically pluralist evaluation of a large-scale Indigenous health research collaboration in Australia

BackgroundIndigenous communities worldwide lead calls for all evaluations of research, programmes and policies affecting their communities to reflect the values, priorities and perspectives of the Indigenous peoples and communities involved....

Indoor Air Quality: Bibliometric Analysis of the Published Literature Between 2018 and 2023

ABSTRACTThis bibliometric study employs a rigorous approach to scrutinize and visually represent the existing body of literature on indoor air quality (IAQ). Utilizing the Scopus collection database, we conducted an exhaustive exploration of published research literature in the IAQ field. The study involves a thorough visual analysis using Harzing's Publish and Perish and VOSviewer software programs, examining parameters such as citations, publication year, journals, authors, research institutions, countries, and research topics. A total of 1729 pieces of literature related to IAQ research from 2018 to 2023 were retrieved. The dominant formats were articles and conference papers, underscoring their significance in IAQ documentation. Primary subject areas included “Engineering” and “Environmental Science,” highlighting the multidisciplinary nature of IAQ studies. The upward trend in IAQ publications, reaching 330 articles in 2023, emphasizes the growing importance of this field. However, citation impact varied, emphasizing the need to assess research quality alongside quantity. Global distribution identified leading countries, including the United States, China, and the United Kingdom, which were also top contributors in co‐authorship and country‐level analyses. The top journals were “Building and Environment” and “Sustainable Cities and Society,” showcasing varying publication and citation powers. Notable impactful articles in the IAQ domain were led by Agarwal et al. and Van Tran, Park, and Lee. Keyword co‐occurrence analysis identified thematic clusters, with keywords such as “Indoor Air Quality (IAQ),” “Air Quality,” and “Indoor Air Pollution” dominating the literature. Through a comprehensive analysis of published literature, this study provides a visual representation of studies with significant contributions to the IAQ field, offering insights into its development and changes from 2018 to 2023. The findings also guide future IAQ research directions.

Developing Students' Critical Thinking: Examining the Influence of Learning Management Approaches Through Meta-Analysis and Propensity Score Matching

Critical thinking is a skill that enables individuals to keep pace with changes and enhances crucial competencies for contemporary competitiveness. Many researchers have studied learning management approaches to develop students' critical thinking, resulting in a substantial body of knowledge but lacking clear systematic summaries. The researchers aimed to (a) examine the effect sizes and research characteristics influencing students' critical thinking, and (b) compare the effect sizes of learning management approaches after adjusting with propensity score matching from 108 graduate research published between 2002 and 2021. Data were collected using research characteristics recording forms and research quality assessment questionnaires. Effect sizes were calculated using Glass's method and analyzed through random effect, fixed effect, and regression meta-analysis. Findings revealed that (a) research on developing learning management approaches influences students' critical thinking at a high level (d ̅ = 1.669), with nine research characteristics, including the field of publication, courses, total duration, teacher learning process, learning media, measurement and evaluation, research design, research statistics, and research quality, statistically significantly influencing students' critical thinking, and (b) after adjustment, inquiry-based learning significantly influences students' critical thinking. Recommendations for developing students' critical thinking include learning activities that encourage problem exploration, expanding thinking through collaborative analysis, and applying diverse media and activity sheets tailored to context suitability.

Risk factors for arrhythmias occurred in cancer patients after chemotherapy: An evidence-based systematic review and meta-analysis

ObjectivesThis study aimed to summarize the existing literature on risk factors for arrhythmias after chemotherapy in cancer patients. To provide reliable evidence for treating arrhythmias after chemotherapy in oncology patients by assessing multiple biasing factors in the literature and quantifying the risk factors. MethodsThe risk factors for arrhythmia following tumor chemotherapy were systematically collected from various reputable databases, including PubMed, Cochrane Library, MEDLINE, EMBASE, and multiple Chinese databases, covering the period from inception to May 2023. Two independent reviewers performed rigorous article screening, data extraction, and assessment of research quality. Data analysis was conducted using Review Manager 5.4 software, ensuring a standardized and robust approach to evaluate the gathered evidence. ResultsThe analysis of chemotherapy-induced arrhythmias included 16 articles, encompassing 14,785 cancer patients. Among the patients, 3295 belonged to the arrhythmia group, while 11,490 were in the non-arrhythmia group. These studies identified 12 significant risk factors associated with arrhythmias following chemotherapy in cancer patients. The findings of the analysis are as follows. General patient characteristicsThe incidence of post-chemotherapy arrhythmias was 14.33 times higher in oncology patients aged ≥60 years compared to patients <60 years of age [OR = 14.33, 95%CI (8.51, 24.13), P＜0.00001]. Patients with a smoking history exhibited a 1.67-fold higher risk of arrhythmia after chemotherapy [OR = 1.67, 95%CI (1.24, 2.25), P = 0.0007]. However, there was no significant correlation between gender and body mass index (BMI) with arrhythmia after chemotherapy in oncology patients (P = 0.52; P = 0.19) Disease-related factorsPatients with a history of hypertension, diabetes, and cardiovascular disease had a 1.93-fold, 1.30-fold, and 1.76-fold increased risk of arrhythmia after chemotherapy, respectively [OR = 1.93, 95%CI (1.66, 2.24), P＜0.00001; OR = 1.30, 95%CI (1.10, 2.52), P = 0.002; OR = 1.76, 95%CI (1.51, 2.05), P＜0.00001]. Additionally, the incidence of arrhythmia increased 1.97 times in patients with electrolyte and acid-base balance disorders following chemotherapy [OR = 1.97, 95%CI (1.41, 2.76), P＜0.00001] Chemotherapy-related factorsSeven articles examined the association between chemotherapy drugs and post-chemotherapy arrhythmias. The results indicated that oncology patients were 3.03 times more likely to develop arrhythmias with chemotherapy drugs compared to non-chemotherapy drugs [OR = 3.03, 95%CI (2.59, 3.54), P＜0.00001]. Notably, anthracyclines and fluorouracil chemotherapy demonstrated a 2.98-fold and 3.35-fold increased risk of arrhythmia after chemotherapy, respectively [OR = 2.98, 95%CI (2.51, 3.03), P＜0.00001; OR = 3.35, 95%CI (2.20, 5.10), P＜0.00001]. The risk of arrhythmia after chemotherapy was 1.72 times higher in patients with chemotherapy cycles longer than 4 weeks than those with cycles shorter than 4 weeks [OR = 1.72, 95%CI (1.30, 2.28), P = 0.0001] ConclusionThe occurrence of arrhythmia after chemotherapy in cancer patients was significantly associated with the patient's age, history of smoking, history of hypertension, history of diabetes, history of cardiovascular disease, chemotherapy drug use, and cycle. However, further high-quality evidence is needed to support these results.

Conflicts of Interest in Nutrition: Categorical Thinking and the Stigma of Commercial Collaboration

There is a high level of concern about the possible influence of commercial organizations on food-related research and professional bodies, including regulatory and advisory panels. This has contributed to an increased emphasis on the declaration and management of conflicts of interest (CoI) in the reporting, evaluation, and application of research in nutrition science. However, common perceptions of CoI in nutrition, and procedures for declaring and managing these, often lack intellectual rigor and consistency. This commentary highlights 3 main issues related to CoI in nutrition, particularly the emphasis on industry-related CoI relative to other sources of conflict and bias. 1) Considerations of CoI in nutrition are largely limited to financial or collaborative links to the food industry, disregarding other important sources of influence such as intellectual allegiances or nonindustry financial and professional incentives. 2) Associations with industry incur ad hominem, often punitive stigmatization of individuals and their research, and inappropriate downgrading or exclusion of evidence. This disproportionately affects expertise in the food and agricultural sciences, in which commercial collaborations are widely encouraged. 3) These practices and related approaches to managing CoI are applied without due consideration of the nature of the conflicts and activities involved, the qualifications of individuals, or the availability of other, objective methods and guidance for assessing research quality and risks of bias. Overall, recognition of the nature and range of CoI in nutrition and approaches to their identification and management lack consistency and balance. A singular and strict focus specifically on industry-related CoI may paradoxically exacerbate rather than mitigate imbalance and bias in the field. This commentary outlines the underlying issues and the need for more comprehensive and nuanced approaches to the assessment, reporting, and management of CoI in nutrition.

A Systematic Literature Review of Islamic Inheritance in Malaysia

The study aims to expand the existing body of knowledge by highlighting and summarising current studies on Islamic inheritance. Thus, this study presented a map of the research interest and determined primary issues to demonstrate current trends, future research directions, and theory development. A systematic literature review (SLR) approach was employed using the four-step reporting standard for the Systematic Evidence Syntheses (ROSES) review: research question formulation, systematic searching, quality assessment, and data extraction. A total of 33 screened articles between 2008 and 2022 were retrieved from two primary databases (Scopus and Emerald and one supporting database, Google Scholar). The factors were categorised into three primary themes: general, motives and preference studies, and determinant analysis. The themes were subsequently divided into seven sub-themes. Notably, most studies examined unclaimed asset issues based on the determinant analysis. This study offered useful insights into the current research interest regarding the subject. The issues and domains in the current study contribute new knowledge and theory development for future directions in the field. This study addressed empirical gaps and presents an excellent reference relevant for regulators, policymakers, and researchers in comprehending the issues and existing solutions in Islamic inheritance.

Literature Review on The Use of Cloud-Based Learning for Islamic Religious Education

Cloud-based learning shows a significant impact on Islamic religious education, especially in the use of Google Classroom. Several studies have examined the effectiveness of cloud-based learning programs in developing reflective thinking skills and increasing student learning motivation in Islamic religious education. In addition, the application of Google Classroom for distance learning has overcome problems related to the number of students in Islamic religious education subjects. The research also explores the use of cloud technology and ICT tools to improve the teaching of Islamic religious education and support personalized learning trajectories for students. Overall, the literature highlights the transformative potential of cloud-based learning and technology to revolutionize the learning experience in Islamic religious education. This research uses a systematic and comprehensive literature study method to analyze books, scientific articles and related sources that are relevant to the topic of cloud-based learning in the use of Google Classroom for Islamic religious education. The methodological framework includes the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines for the identification and selection of eligible studies, as well as the use of well-known research quality assessment tools. Analysis results are synthesized to produce reports that are informative, well-organized, and context-rich.

Proteomic profiling of FFPE specimens: Discovery of HNRNPA2/B1 and STT3B as biomarkers for determining formalin fixation durations

Recent advancements in proteomics technologies using formalin-fixed paraffin-embedded (FFPE) samples have significantly advanced biomarker discovery. Yet, the effects of varying sample preparation protocols on proteomic analyses remain poorly understood. We analyzed mouse liver FFPE samples that varied in fixatives, fixation duration, and storage temperature using LC/MS. We found that variations in fixation duration significantly affected the abundance of specific proteins, showing that HNRNPA2/B1 demonstrated a significant decrease in abundance in samples fixed for long periods, whereas STT3B exhibited a significant increase in abundance in samples fixed for long durations. These findings were supported by immunohistochemical analysis across liver, spleen, and lung tissues, demonstrating a significant decrease in the nuclear staining of HNRNPA2/B1 in long-duration acid formalin(AF)-fixed FFPE samples, and an increase in cytoplasmic staining of STT3B in long-duration neutral buffered formalin-fixed liver and lung tissues and granular staining in all long-duration AF-fixed FFPE tissue types. Similar trends were observed in the long-duration fixed HeLa cells. These results demonstrate that fixation duration critically affects the proteomic integrity of FFPE samples, emphasizing the urgent need for standardized fixation protocols to ensure consistent and reliable proteomic data. SignificanceThe quality of FFPE samples is primarily influenced by the fixation and storage conditions. However, previous studies have mainly focused on their impact on nucleic acids and the extent to which different fixation conditions affect changes in proteins has not been evaluated. In addition, to our knowledge, proteomic research focusing on differences in formalin fixation conditions has not yet been conducted. Here, we analyzed FFPE samples with different formalin fixation and storage conditions using LC/MS and evaluated the impact of different fixation conditions on protein variations. Our study unequivocally established formalin fixation duration as a critical determinant of protein variation in FFPE specimens and successfully identified HNRNPA2/B1 and STT3B as potential biomarkers for predicting formalin fixation duration for the first time. The study findings open new avenues for quality assessment in biomedical research and diagnostics.

Post-radiotherapy stage III/IV non-small cell lung cancer radiomics research: a systematic review and comparison of CLEAR and RQS frameworks

BackgroundLung cancer, the second most common cancer, presents persistently dismal prognoses. Radiomics, a promising field, aims to provide novel imaging biomarkers to improve outcomes. However, clinical translation faces reproducibility challenges, despite efforts to address them with quality scoring tools.ObjectiveThis study had two objectives: 1) identify radiomics biomarkers in post-radiotherapy stage III/IV nonsmall cell lung cancer (NSCLC) patients, 2) evaluate research quality using the CLEAR (CheckList_for_EvaluAtion_of_Radiomics_research), RQS (Radiomics_Quality_Score) frameworks, and formulate an amalgamated CLEAR-RQS tool to enhance scientific rigor.Materials and methodsA systematic literature review (Jun-Aug 2023, MEDLINE/PubMed/SCOPUS) was conducted concerning stage III/IV NSCLC, radiotherapy, and radiomic features (RF). Extracted data included study design particulars, such as sample size, radiotherapy/CT technique, selected RFs, and endpoints. CLEAR and RQS were merged into a CLEAR-RQS checklist. Three readers appraised articles utilizing CLEAR, RQS, and CLEAR-RQS metrics.ResultsOut of 871 articles, 11 met the inclusion/exclusion criteria. The Median cohort size was 91 (range: 10–337) with 9 studies being single-center. No common RF were identified. The merged CLEAR-RQS checklist comprised 61 items. Most unreported items were within CLEAR’s “methods” and “open-source,” and within RQS’s “phantom-calibration,” “registry-enrolled prospective-trial-design,” and “cost-effective-analysis” sections. No study scored above 50% on RQS. Median CLEAR scores were 55.74% (32.33/58 points), and for RQS, 17.59% (6.3/36 points). CLEAR-RQS article ranking fell between CLEAR and RQS and aligned with CLEAR.ConclusionRadiomics research in post-radiotherapy stage III/IV NSCLC exhibits variability and frequently low-quality reporting. The formulated CLEAR-RQS checklist may facilitate education and holds promise for enhancing radiomics research quality.Clinical relevance statementCurrent radiomics research in the field of stage III/IV postradiotherapy NSCLC is heterogenous, lacking reproducibility, with no identified imaging biomarker. Radiomics research quality assessment tools may enhance scientific rigor and thereby facilitate radiomics translation into clinical practice.Key PointsThere is heterogenous and low radiomics research quality in postradiotherapy stage III/IV nonsmall cell lung cancer.Barriers to reproducibility are small cohort size, nonvalidated studies, missing technical parameters, and lack of data, code, and model sharing.CLEAR (CheckList_for_EvaluAtion_of_Radiomics_research), RQS (Radiomics_Quality_Score), and the amalgamated CLEAR-RQS tool are useful frameworks for assessing radiomics research quality and may provide a valuable resource for educational purposes in the field of radiomics.

Quality assessment of paediatric education and research in southwest China: A cross-sectional study.

Currently, there is a limited analysis of medical education research both domestically and internationally. To enhance, improve the quality of medical education, this study conducted a quantitative analysis of teaching project data from an affiliated hospital during the period 2016-2022. The results indicated that a total of 133 teaching projects were initiated during this period, with an average age of project leaders being 42.73±6.45 years. Regarding professional ranks and titles, municipal-level project leaders had a high concentration of seniors (48.15%), while at the university-level, most project leaders held the title of deputy seniors (58.82%). At the university-level, project leaders were mainly distributed between deputy senior titles (37.08%) and intermediate titles (38.20%). In terms of research content, nearly half of the studies (46.62%) focused on teaching methods and models. Further regression analysis revealed that professional ranks and titles were an independent factor influencing the project level (P<0. 05). These findings suggest the need for improvement in medical education research, including addressing the uneven distribution of research topics, enhancing the research capacity of junior and mid-career medical education teachers, and improving the dissemination of research results.

Responsible Research Assessment requires structural more than procedural reforms

In their target articles, Schönbrodt et al. (2022) and Gärtner et al. (2022) propose new metrics and their practical implementation to improve responsible research assessment. Generally, I welcome the inclusion of open science and scientific rigor into evaluating job candidates. However, the proposed reform mainly focuses on the first stage of selecting candidates who then continue towards a second stage of in-depth evaluation of research quality. Yet, this second selection stage is underdeveloped but likely more critical concerning responsible research assessment and hiring decisions. I argue that an adequate assessment of research quality at this second stage requires the representation of specific knowledge in the subfield of a discipline that the candidate should be hired for by the hiring committee. This is rarely achieved given the current structural organization of departments, especially in German-speaking countries, and potentially explains the reliance on suboptimal indicators such as h-index and Journal Impact factor. Therefore, I argue that responsible research assessment requires structural reform to ensure that institutions have several researchers in permanent positions with specific knowledge in different subfields to provide an adequate and responsible assessment of research quality by hiring committees at all evaluation stages.