Expert Scoring Research Articles

Using Rubrics to Enhance Accuracy of Peer Assessment and Self-Judgment in Biology Learning

Abstract This study investigated the potential of rubrics to enhance science learning outcomes and the accuracy of peer and self-assessments. We randomly divided 230 upper-secondary students from nine classrooms in public schools into two groups: rubric and non-rubric groups. The research concentrated on five open-ended items pertaining to cell biology and applied a pretest-posttest design. The students participated in online peer assessment activities, including independently scoring and providing feedback for five unique responses per question. The findings revealed that both groups displayed (1) a notable correlation between peer and expert scores and (2) learning improvement, with the rubric group outperforming the non-rubric group in terms of effect size, and that (3) male students in the rubric group demonstrated a significant reduction in overconfidence, although the regression results suggested that gender did not influence the learning outcomes. This research supports the claim that rubrics can elevate formative assessment by enhancing learning outcomes and facilitating more reliable judgments.

Wine ratings and commercial reality

Abstract Is the quality of a 91-point wine significantly different from that of an 89-point wine? Which wines are underpriced relative to their evaluation of quality? This paper addresses these questions by constructing a novel wine rating system based on scores assigned by a panel of wine experts to a set of wines. Wines are classified in ranked disjoint quality equivalence classes using measures of statistically significant and commercially relevant score differences. The rating system is applied to the “Judgment of Paris” wine competition, to data of Bordeaux en-primeur expert scores and prices, and to expert scores and price categories of a large database of Italian wines. The proposed wine rating system provides an informative assessment of wine quality for producers and consumers and a flexible rating methodology for commercial applications.

Based on AHP, The Ecological Environment of Fenhe River Basin Is Evaluated

he evaluation of the ecological quality of the Fenhe River Basin is of great significance for the high-quality development of the Yellow River Basin and Shanxi Province. In this paper, the analytic hierarchy process (AHP) is used to evaluate the ecological environment of Fenhe River Basin. Firstly, based on the relevant research literature, the ecological environment evaluation index is determined, and the influencing factors of the evaluation index are determined. Secondly, the weight of different influencing factors is determined based on AHP method, and the weight of evaluation index is obtained. Finally, the ecological environment of Fenhe River Basin in different years was analyzed by weight analysis results and expert scoring method. The results show that the ecological environment evaluation indexes of Fenhe River Basin are : water loss, soil loss, water pollution and vegetation reduction; the influencing factors of the evaluation index are : rainfall factors, soil and water conservation measures, reservoir construction, industrial water use, coal mining, engineering construction, solid waste pollution, urban development, industrial structure change, population change; from 2000 to 2020, the ecological quality of the Fenhe River Basin continued to improve, indicating that the policies and measures adopted for ecological management were effective. The ecological deterioration near the main stream and tributaries of the middle and lower reaches of the Fenhe River is related to the pollution of mine environment and industrial sewage.

The research on dance motion quality evaluation based on spatiotemporal convolutional neural networks

With the rapid development of artificial intelligence and computer vision technology, dance action recognition and quality assessment have become a challenging and important research field. Traditional dance movement recognition methods often rely on manual feature extraction and expert scoring, which have problems such as strong subjectivity, low efficiency, and difficulty in handling complex movements. To address these issues, this study proposes a dance action recognition and quality assessment method based on Spatio Temporal Convolutional Neural Network (ST-CNN). Specifically, it includes a feature extraction network based on 3D spatiotemporal description operators and a multi-scale aggregated long short memory network for extracting spatial features of single frame images and fusing video sequence features composed of all frames. This approach can effectively capture dynamic changes in dance movements by combining information from spatial and temporal dimensions, thereby achieving more accurate recognition and evaluation. In addition, to address the high storage and computational requirements of convolutional neural networks during training, we integrated dance video sequences into an IoT architecture to address parallel recognition and evaluation of multiple videos. Finally, we validated the proposed method on the public datasets NTU-RGB 60 and NTU-RGB 120, and the experimental results demonstrated the effectiveness of the method.

Application of big data and artificial intelligence in visual communication art design.

In the era of continuous development of computer technology, the application of artificial intelligence (AI) and big data is becoming more and more extensive. With the help of powerful computer and network technology, the art of visual communication (VISCOM) has ushered in a new chapter of digitalization and intelligence. How vision can better perform interdisciplinary and interdisciplinary artistic expression between art and technology and how to use more novel technology, richer forms, and more appropriate ways to express art has become a new problem in visual art creation. This essay aims to investigate and apply VISCOM art through big data and AI methods. This essay proposed the STING algorithm for big data for multi-resolution information clustering in VISCOM art. In addition, the convolutional neural network (CNN) in AI technology was used to identify the conveyed objects or scenes to achieve the purpose of designing art with different characteristics for different scenes and groups of people. STING is a multi-resolution clustering technique for big data, with the advantage of efficient data processing. In the experimental part, this essay selected a variety of design contents in VISCOM art, including logo design, text design, scene design, packaging design and poster design. STING and CNN algorithms were used to cluster and AI-identify the design elements 16 of the design projects might contain. The results showed that the overall average clustering accuracy was above 82%, the accuracy of scene element recognition mainly was above 80%, and the accuracy of facial recognition was above 80%; this showed that this essay applied AI and big data to the design of VISCOM, and had a good effect on the clustering and identification of design elements. According to expert scores, these applications' reliability and practicality scores were above 70 points, with an average of about 80 points. Therefore, applying big data and AI to VISCOM in this essay is reliable and feasible.

Validation of automated detection of REM sleep without atonia using in-laboratory and in-home recordings.

To evaluate the concordance between visual scoring and automated detection of REM sleep without atonia (RSWA) and the validity and reliability of in-home automated-RSWA detection in REM sleep behavior disorder (RBD) patients and a control group (CG). Sleep Profiler signals were acquired during simultaneous in-laboratory polysomnography in 24 isolated RBD patients. Chin and arm RSWA measures visually scored by an expert sleep technologist were compared to algorithms designed to automate RSWA detection. In a second cohort, the accuracy of automated-RSWA detection for discriminating between RBD and CG (n = 21 and 42, respectively) was assessed in multi-night in-home recordings. For the in-laboratory studies, agreement between visual and auto-scored RSWA from the chin and arm were excellent, with intra-class correlations of 0.89 and 0.95, respectively, and substantial, based on Kappa scores of 0.68 and 0.74, respectively. For classification of iRBD patients versus controls, specificities derived from auto-detected RSWA densities obtained from in-home recordings were 0.88 for the chin, 0.93 for the arm, and 0.90 for the chin or arm, while the sensitivities were 0.81, 0.81 and 0.86, respectively. The night-to-night consistencies of the respective auto-detected RSWA densities were good based on intra-class correlations of 0.81, 0.79 and 0.84, however some night-to-night disagreements in abnormal RSWA detection were observed. When compared to expert visual RSWA scoring, automated RSWA detection demonstrates promise for detection of RBD. The night-to-night reliability of chin- and arm-RSWA densities acquired in-home were equivalent.

Suitability matching evaluation of the low-carbon regional integrated energy system based on the “resource-demand” balance

The integrated energy system (IES) stands out due to its advantages of multi-energy complementarity, green and efficiency. This paper aims to provide a practical model for suitable region site selection of low-carbon regional IES based on the “resource-demand” balance. A “resource-demand” suitability matching analysis indicator system is established. By using prospect theory and variable precision rough set theory, the decision-making preferences and the cognitive fuzziness influence of expert scoring were corrected respectively, and reasonable subjective weights were obtained. Then, the objective weights are obtained using the entropy method, and the optimal combined weights are obtained through the game theory weighting method. Finally, this paper establishes a “resource-demand” suitability matching model consisting of three sub models: similarity matching degree, numerical matching degree, and suitability matching degree. An empirical study is conducted on 16 regions in Beijing, and the results show that the numerical matching degree of “resource-demand” gradually decrease from the central urban regions to the surrounding regions. The similarity matching degree in most regions reaches the highest range (0.776,1.00). There are 4 regions with a suitability matching rating of perfect, 7 regions with a rating of great, 1 region with a rating of good, and 4 regions with a rating of poor. The suitability matching model established in this paper can guide energy project decision-makers to select regions with greater potential for the development of IES. In addition, adjusting the similarity matching coefficient and numerical matching coefficient can meet the diversified needs of decision-makers for the similarity matching degree and numerical matching degree of the “resource-demand” balance, providing support for energy project planning decisions.

Quantification of biosecurity measures in Mediterranean European seabass and gilthead sea bream farms

In the Mediterranean region, aquaculture drives economic growth and food supply through the production of seabass and sea bream. However, the region faces disease risks attributable to aquaculture intensification. Biosecurity is crucial for maintaining fish health and sustaining the aquaculture industry. This study adopted a novel risk-based scoring tool, originally developed for terrestrial animals, to benchmark biosecurity levels in seabass and sea bream. The tool considers all relevant aspects of aquaculture biosecurity, subdivided into external and internal biosecurity, with an accompanying questionnaire subjected to expert scoring. Land-based hatcheries and pre-growing facilities exhibited higher preventative measures, achieving overall biosecurity scores of 73.0 % and 75.0 %, respectively. These scores stem from stringent external and internal preventative measures, contrasting with lower overall biosecurity scores in land-based on-growing (50.0 %) and sea-based on-growing (59.0 %) facilities. Maintaining biosecurity during on-growing phases seems demanding due to uncontrolled interactions with the seawater environment and potential water quality issues. This benchmarking tool allows farmers to audit their biosecurity programs and pinpoint areas for improvement. These include vaccination, establishing biosecurity programs and keeping records, given the low scores across farm types. Improving vaccination practices, enhancing record keeping for traceability, and implementing robust biosecurity programs are crucial for improvement. Ultimately, the study emphasizes the need for tailored measures that foster synergy between external and internal components and enhance overall biosecurity in Mediterranean aquaculture.

Multi-objective optimization design of steel cross section of integrated supports and hangers based on NSGA-Ⅱ and MDOS

The stability and safety of building Mechanical, Electrical, and Plumbing (MEP) systems are significantly influenced by the steel section design of integrated supports and hangers. Traditional design methods, reliant on empirical steel section selection, are often inefficient and can result in unnecessary material usage. This paper introduces a novel multi-objective optimization approach that enhances the section design process by minimizing material costs and maximizing bending performance of supports and hangers. Firstly, the Non-dominated Sorting Genetic Algorithm II (NSGA-II) is employed to identify an array of optimal cross-sectional designs that reconcile economic considerations with structural mechanical performance. Subsequently, in order to pinpoint the most suitable design from the resulting Pareto-optimal scheme, the Method of Determining the Optimal Scheme (MDOS) is proposed. MDOS harnesses expert scoring, the Continuous ordered weighted averaging (COWA) operator, game theory, and the Technique for Order Preference by Similarity to an Ideal Solution (TOPSIS) to objectively evaluate and prioritize design schemes according to stakeholder preferences and project-specific criteria. Finally, the optimization results are analyzed and the influence of different spacing of supports and hangers and different subjective weight factors on the selection of cross-section is studied. The findings reveal that the method can precisely determine all cross-section designs that adhere to the established constraints, achieving a 4.09-fold enhancement in design efficiency. It was observed that the two outlined objectives are predominantly affected by the height of the web. The distribution trend of the optimal solution value of the independent variable is almost the same under the condition of different values of the supports and hangers spacing. With the change of subjective weight, the cross section selection focuses on three optimal schemes. Therefore, the proposed method can be used as reference for similar steel design optimization.

The interaction of blockchain technology, audit process, and the International Financial Reporting Standards

Purpose This study aims to provide a framework for the interaction of blockchain technology, the audit process and International Financial Reporting Standards (IFRS). Design/methodology/approach This study was conducted in three phases. In the first phase, a meta-synthesis method was used until 2020. Out of 87 papers, a total number of 15 were selected, and 72 were excluded after an initial screening. In the second phase, 11 interviews were held with experts with sufficient experience and expertise in blockchain technology, accounting and auditing. These interviews were held between 2020 and 2021. The sampling was purposive (targeted) in type, along with snowball sampling. In the third phase, a combination of questionnaire-based method and the fuzzy Delphi method was used. The research population for this phase consisted of accounting professors, members of the Iranian Association of Certified Public Accountants and accounting and technology professionals. Following the selection of the Delphi panel, 35 questionnaires were collected between 2021 and 2022 for analysis. Findings The results showed that in line with the interaction of blockchain technology, audit process and IFRS, 52 indicators were confirmed in eight components. Moreover, “Verifiability,” “Timeliness” and “Predictive value” were the most influential factors, respectively, according to the conceptual model. In addition, higher average scores of experts’ views were related to “Transparency audit reports” and “Increasing the quality of the auditor’s judgment”, respectively. Originality/value Blockchain is a complex subject, and there has been very little published research on the intersection of IFRS and blockchain technology. It is crucial for the audit profession and technology professionals to focus on the interaction of blockchain technology with the qualitative characteristics of information. This is an area that has not been thoroughly researched yet. The interaction of blockchain technology, improvements in the audit process and adherence to IFRS is a significant development in accounting and auditing.

Analysis of landscape vegetation ecology and cellular structure in nature reserves based on an improved analytic hierarchy process

With the increasing severity of global environmental issues, natural reserves have become crucial areas for maintaining biodiversity and protecting natural ecosystems. The ecological status of landscape vegetation and the characteristics of cellular structures within these reserves have become focal points of research. However, traditional evaluation methods have limitations when dealing with the complex ecosystems of natural reserves, making it difficult to assess the relationship comprehensively and accurately between vegetation ecology and cellular structures. Therefore, this paper proposes an analysis of landscape vegetation ecology and cellular structure in natural reserves based on an improved Analytic Hierarchy Process (AHP). By incorporating fuzzy set theory and expert scoring mechanisms, the evaluation process is enhanced in terms of objectivity and precision. An evaluation index system for landscape vegetation ecology and cellular structure in natural reserves is constructed, covering aspects such as vegetation species richness, community structural complexity, and ecological functional stability. This systematic approach reflects the ecological status of vegetation and cellular structure characteristics, providing scientific support for targeted protection and management measures.

A novel FMECA method for CNC machine tools based on D-GRA and data envelopment analysis

Failure Modes, Effects, and Criticality Analysis (FMECA) is a commonly used method for analyzing system reliability. It is frequently applied in identifying weak points in the reliability of CNC machine tools. However, traditional FMECA has issues such as vague descriptions of risk factors, equal treatment of risk factors, and unclear directions for improving weak points. In response to the issue of vague descriptions of risk factors, this paper further expands severity (S) into machine hazard (M) and personal hazard (P), and subdivides detectability (D) into functional structural complexity (D1) and detection cost (D2). In addressing the issue of treating risk factors equally, this paper integrates Distance Analysis Method (DAM) and Grey Relational Analysis (GRA) to propose Distance-Grey Relational Analysis (D-GRA). Subsequently, based on the D-GRA method, the weights of each risk factor were determined by comprehensively considering expert system scores and actual economic loss indicators. In response to the issue of unclear improvement directions for weak points, this paper introduces the BCC model. It treats common failure modes of CNC machine tools as decision-making units within the BCC model, refines risk factors as input indicators, and evaluates the efficiency values of each decision-making unit based on various actual losses as output indicators. Through efficiency value analysis, it proposes improvement directions for weak points. Then, based on the weights of risk factors and the efficiency values of failure modes, a modified calculation method for the new Risk Priority Number (RPN) is proposed to amend the traditional RPN, This paper takes the electric spindle system of a certain machining center as an example, applies the proposed method to rank common failure modes with the new RPN, and compares it with other RPN calculation methods to verify the rationality of the proposed approach. Finally, it presents improvement directions for reliability enhancement.

Development of Virtual Reality Hydroelectric (VIRRIC) for teaching students about renewable energy

Understanding abstract physics theories, such as energy, can be challenging for students. Teachers also face the difficulty of meeting learning objectives within limited classroom time. The purpose of this research is to develop physics learning media to teach high school students about renewable energy. The learning media is presented as virtual reality, focusing on the energy conversion process in hydroelectric power plants. The goal is for students to apply their understanding of energy conversion concepts in hydroelectric power plants as one type of renewable energy source. The research process follows the ADDIE model, focusing on the analysis, design, and development stages. Data is collected through validation sheets completed by media experts, which provide valuable suggestions for revisions. The data was analyzed using descriptive statistical methods. It is known that at this level of education, the cognitive level required for understanding renewable energy material is C4 according to the revised Bloom's taxonomy. At the design stage, storyboards are used to frame the media development process, comprising a problem orientation scene and an exploration scene. After development, the VIRRIC media was validated based on visual aspects, interest, usefulness, accuracy, legitimacy, and structure. The final media expert validation score for the VIRRIC media is 0.87, categorized as highly valid. The lowest score was in the visual aspect, which was 0.77. This was due to some text information in the media being difficult to read. The text is observable when not using a gyro device, but becomes difficult to read when observed using a gyro device. Based on these results, the VIRRIC media is deemed suitable for testing in learning after making improvements.

Accident causation analysis of metal processing plants based on questionnaire and Bayesian network

Metal dust and metal waste from the process of metal processing are prone to fire and explosion, resulting in personal injury and property losses. It is necessary to explore the causes of fire and explosion in metal processing plants for the prevention and management of safety accidents. In this paper, the relevant information of fire and explosion accidents in metal processing plants is collected by questionnaire investigation. Then, three experts with authority in this field were chosen, and the experts’ weights were calculated. Secondly, Bayesian networks of metal processing plants were established according to accident information. In addition, questionnaire data and the expert score after fuzzing were applied to serve as probabilistic data for Bayesian networks. Finally, a safety management model was constructed based on the sensitivity analysis in the Bayesian network. It is shown that the probability of human and management errors is the largest in a plant. Compared to other factors, the probability of occurrence of an unsafe state of material is the smallest. Human errors and the ventilation system is not activated are the two factors that have the greatest influence on the accidents. This study provides assistance in improving safety in metal processing plants.

A system dynamics model based on ISM for risk perception in emergency by employees in chemical industrial parks

Risk perception is one of the factors that guide human behavior in the workplace. In accident prevention and emergency response, the risk perception of employees affects the safety behaviour and efficiency of emergency disposal. Besides, risk perception is a complicated process restricted by many influencing factors. The study aims to identify the most important factors affecting risk perception. This study had three phases. In the first, factors affecting the risk perception were extracted based on the questionnaire survey and the expert scoring. Then, the Interpretive Structure Model (ISM) was used to stratify the 14 influencing factors of risk perception and obtain a hierarchical structure chart. Finally, by analyzing the influence paths in the ISM, the system dynamics feedback loop diagram was constructed. The model took the state variable “risk perception→ risk response→ risk identification→ risk communication→ risk perception” as the main circular loop, and was supplemented and perfected by multiple feeder loop circuits. Research indicates risk experience is the most fundamental factor affecting risk perception. In the aspect of sensitivity analysis, the study shows that the risk perception of employees is related to the distance of the risk source. Its effectiveness in quantifying qualitative data, identifying influential factors, and establishing cause-effect relationships make it a valuable tool for enhancing risk perception in chemical industry park.

An operational risk assessment method for petrochemical plants based on deep learning

The petrochemical industry is an important guarantee for the development of people’s lives, and the operational risk assessment method of personnel in the operation of petrochemical enterprises is the most important. Based on a deep learning algorithm, a new method based on the micro-Doppler effect and fuzzy analytic hierarchy process is proposed to evaluate the operational risk of personnel in petrochemical enterprises. The original monitoring image of petrochemical equipment is invoked, and micro-Doppler analysis is performed based on the original image to identify the activity target of the personnel on the job site and generate the activity map of the petrochemical plant operators. Based on the analysis data of the micro-Doppler effect, the fuzzy function and hierarchical analysis method are combined. The fuzzy theory is introduced into the analytic hierarchy process, and the inherent expert evaluation scores are transformed into fuzzy numbers. It makes the expert evaluation of petrochemical plants more accurate in the subsequent coupling and improves the objectivity of the traditional analytic hierarchy process. The scheme proposed in this paper can monitor real-time operation safety and provide a guarantee for the personal safety of field operators. This method plays an important role in improving the safety of petrochemical plants.

Development of e-Booklets making nata de pina as a learning resource for Biology Technology Innovation material in the Merdeka Phase E curriculum in high school

Research Development of e-Booklet Making Nata De Pina Research-Based Research as a Learning Source of Biological Technology Innovation Material in the Merdeka Phase E Curriculum in High School aims to analyze the influence of the concentration of sprouts extract on the quality of thickness and weight of nata de pina, as well as analyzing the validity, feasibility, and readability of E-Booklet Making Nata De Pina Developed. The development research design uses the Addie model, which consists of 5 stages, namely analysis, design, development, implementation and evaluation. In this study the implementation stage was not implemented. The results of this study were the provision of sprouts in the process of making nata de pina had a significant effect on the thickness of thickness and weight of nata de pina. The best results of the five treatments for the concentration of sprouts extract tested are trial in the K4 treatment with a concentration of sprouts of 100 ml for 500ml of media. The e-Booklet of making Nata de Pina is considered very valid with the acquisition of material validation scores of 90.90% and the validation score of media experts of 93.53%. The e-Booklet making Nata de Pina was declared very feasible with the acquisition of the teacher response score of 96.66% and the student response was 89.52%. As well as the results of the e-Booklet readability test making Nata de Pina is considered high with the acquisition of the Rumpang test score of 98.38%.

Pengembangan Media Pembelajaran Teachmint pada Mata Pelajaran Korespondensi Kelas X Manajemen Perkantoran di SMK Tunas Pembangunan

This research aims to: (1) develop Teachmint learning media in the subject of Correspondence, (2) to obtain feasibility information from Teachmint learning media in the subject of Correspondence class X of Office Management at SMK Tunas Pembangunan. The type of research used is research and development (RnD) using the ADDIE (Analysis, Design, Development, Implementation, Evaluation) development method. This research took place at SMK Tunas Pembangunan which was carried out from May 2024 to July 2024. The data collection technique was collected by interviews with teachers of SMK Tunas Pembangunan. The feasibility of learning media is assessed by media experts and material experts. Data analysis was carried out by qualitative and quantitative analysis. Based on the research that has been carried out, Teachmint learning media on the subject of Correspondence has been developed. The results of expert validation are known that Teachmint learning media in the subject of Correspondence class X Office Management at SMK Tunas Pembangunan is very feasible to use with an average validation score of 86.3% for media experts with the category of "very feasible" as a learning medium. The average validation score of material experts is 97% with the category of "very feasible" as a learning media.

Design and Development of Diabestfriend Application for Digital Self Care Management of Type 2 Diabetes Mellitus Patients

Objective: The availability of the results of the Android-based Diabestfriend Application for digital self-care management of type 2 diabetes mellitus patients. Theoretical Framework: The numerous interventions that come under the more general term "self-care" and are helpful in understanding the self-care suite have been categorized into three domains: self-awareness, self-testing, and self-care. Methods: The ADDIE development model is used in this study in three stages. Ten patients with type 2 diabetes who completed questionnaires, along with validators from one media expert and one material expert, comprise the implementation stage, which is the application assessment stage. The questionnaires consist of three sections: a total of 16 questions for patient application assessment, 21 questions for media expert validation, and 25 questions for material expert validation. Results and Discussion: The validation score of media experts was 83.8 with the very good category, the validation score of the material experts was 81.6 with the very good category and the response score of diabetes mellitus patients was 88.95 with the very good category. Research Implications: Further research on the efficacy of the Diabestfriend Application as a digital self-care management tool in type 2 diabetes mellitus patients will provide insight into how the use of the application affects the patients' level of self-care management. Originality/Value: The Diabestfriend Application is appropriate for use as a digital self-care management tool for patients with type 2 diabetes mellitus, according to validation from media experts, material experts, and 10 diabetes patients.

Automated AI-based coronary calcium scoring using retrospective CT data from SCAPIS is accurate and correlates with expert scoring.

Evaluation of the correlation and agreement between AI and semi-automatic evaluations of calcium scoring CT (CSCT) examinations using extensive data from the Swedish CardioPulmonary bio-Image study (SCAPIS). In total, 5057 CSCT examinations were performed on one CT system at Linköping University Hospital between October 8, 2015, and June 12, 2018. AI evaluations were compared to semi-automatic CSCT results from expert reader evaluations rendered within SCAPIS. Pearson correlation, intraclass correlation coefficients (ICC), and Bland-Altman analysis were applied for Agatston (AS), volume (VS), mass scores (MS), number of lesions and lesion location. Agreement of Agatston score classifications into cardiovascular (CV) risk categories was evaluated with weighted kappa analysis. The evaluation included 4567 subjects, 2229 (48.8%) male, 2338 (51.2%) female, 50-64 years of age (mean 57.3 ± 4.4). The AS ranged from 0 to 2871 in the cohort, with 2846 subjects having an AS of 0. Mean and median AS were 51.4 and 0.0, respectively. Total AS, VS, MS and number of lesions ICCs were 0.994, 0.994, 0.994, 0.960 (p < 0.001), respectively. Bland-Altman analyses rendered mean differences ± 1.96 SD upper and lower limits of agreement for AS -0.04, -52.5 to 52.4, VS -0.44, -46.51 to 45.63, and MS -0.07, -9.62 to 9.48. Weighted kappa analysis for CV risk category classifications was 0.913, and overall accuracy was 91.2%. There was excellent correlation and agreement between AI and semi-automatic evaluations for all calcium scores, number of lesions and lesion location. High degrees of agreement and accuracy were found for the CV risk categorization. Question Can AI function as a tool for enhancing the efficiency and accuracy of Coronary Artery Calcium Score (CACS) evaluations in clinical radiology practice? Findings This study confirms the robustness of AI-derived CACS results across extensive datasets, though its generalizability is limited by data acquisition from a single CT system. Clinical relevance This study suggests that AI holds significant promise as a tool for enhancing the efficiency and accuracy of CACS evaluations, with implications for improving patient diagnostics and reducing radiologist workload in clinical practice.