Innovative Assessment Research Articles

The Impact of Script Concordance Testing on Clinical Decision-Making in Paramedic Education.

This study investigates the effectiveness of the Script Concordance Test (SCT) in enhancing clinical reasoning skills within paramedic education. Focusing on the Medical University of Lublin, we evaluated the SCT's application across two cohorts of paramedic students, aiming to understand its potential to improve decision-making skills in emergency scenarios. Our approach, informed by Van der Vleuten's assessment framework, revealed that while the SCT's correlation with traditional methods like multiple-choice questions (MCQs) was limited, its formative nature significantly contributed to improved performance in summative assessments. These findings suggest that the SCT can be an effective tool in paramedic training, particularly in strengthening cognitive abilities critical for emergency responses. The study underscores the importance of incorporating innovative assessment tools like SCTs in paramedic curricula, not only to enhance clinical reasoning but also to prepare students for effective emergency responses. Our research contributes to the ongoing efforts in refining paramedic education and highlights the need for versatile assessment strategies in preparing future healthcare professionals for diverse clinical challenges.

Finance as a critical component of successful implementation of creative innovations in the modern economic system

The article examines theoretical approaches to the interpretation of certain concepts of the innovation economy in the context of modern transformations, as well as the effectiveness of financing creative innovations. The authors highlighted the problems of innovation transfer and intellectual property management. The paper analyzed the main innovation activity indicators in selected world countries for 2010-2022. It reveals the correlation between innovation financing and economic performance at the macro level. In addition, the authors summarized the essence of the "creative innovations" and "transfer of innovations" categories. They proposed criteria for assessing the effectiveness of innovation potential and defined their nature. The evaluation testing confirmed the possibility of using the proposed criteria. In particular, the key aspects of the formation of adequate financing of creative innovations include financial analysis of investments and risk assessment, marketing strategy and transfer of innovations, as well as monitoring and evaluation of the results of innovation implementation. The authors developed practical approaches to increase the effect of innovation implementation. These approaches allow economic systems to ensure a high level of transfer organization and implementation.

Legislative Innovations in Pre-trial Investigation and Judicial Examination of Criminal Cases

The article is dedicated to the analysis and assessment of legislative innovations introduced into the procedures of pre-trial investigation and judicial examination of criminal cases. A comprehensive analysis of the regulatory framework governing this area is conducted, taking into account recent changes and amendments.
 The article discusses key changes aimed at enhancing the efficiency of pre-trial investigation and judicial examination of criminal cases, as well as safeguarding the rights and legitimate interests of participants in the criminal process. Special attention is given to innovations designed to expedite case proceedings, ensuring, transparency and justice in the administration of justice.
 Within the scope of the conducted research, prospects for implementing the aforementioned legislative novelties into the practice of investigation and adjudication of criminal cases are identified. The authors provide well-founded recommendations for further potential directions in refining legislation in this area to enhance the efficiency and fairness of criminal justice.
 The article aims to determine optimal strategies and practical measures to support the integration of positive changes into the judicial system, particularly by incentivizing ethical conduct among pre-trial investigation bodies and the prosecution.
 The conclusions of the article not only help identify shortcomings in legislation but also offer constructive recommendations for overcoming challenges in the field of justice, contributing to the development of legislation for the effective protection of citizens’ rights in contemporary conditions.
 This article serves as a significant contribution to understanding and discussing the impact of innovations on the criminal process, and it may be valuable for practicing lawyers, researchers, and legislators interested in the field of criminal law and procedure.

Progress Testing in UK Medical Education: Evaluating Its Impact and Potential.

This comprehensive review critically examines the UK medical curriculum, with a particular focus on progress testing as an innovative assessment strategy. The curriculum, evolving from foundational sciences to practical applications, is encapsulated in the integrated curriculum model (ICM). This model adeptly combines theoretical knowledge with clinical practice, fostering cognitive, affective, and psychomotor skills among medical students. Central to this review is an exploration of progress testing. This method, grounded in constructivist learning theories, emphasises continuous assessment and professional development. Progress testing's regular, comprehensive examinations are instrumental in guiding students through the progressive stages of competence, as outlined in Miller's pyramid, from foundational knowledge to clinical proficiency. The review also addresses the broader impacts of progress testing on teaching approaches, student feedback, academic and pastoral support, and quality assurance. By aligning with the dynamic requirements of 21st-century medical training, progress testing not only nurtures well-rounded professionals but also ensures compliance with regulatory bodies like the General Medical Council. Its emphasis on continuous evaluation aligns with the practical realities of a medical career, driving curricular innovation and aligning with regulatory standards. The implementation of progress testing marks a significant advancement in medical education. Its continuous, holistic nature benefits both students and educators, nurturing a more engaged learning attitude and meeting evolving medical needs. The adoption of this assessment strategy is seen as pivotal in shaping competent medical professionals, ready to face the challenges of modern medical practice.

The ethical implications of using generative chatbots in higher education

Incorporating artificial intelligence (AI) into education, specifically through generative chatbots, can transform teaching and learning for education professionals in both administrative and pedagogical ways. However, the ethical implications of using generative chatbots in education must be carefully considered. Ethical concerns about advanced chatbots have yet to be explored in the education sector. This short article introduces the ethical concerns associated with introducing platforms such as ChatGPT in education. The article outlines how handling sensitive student data by chatbots presents significant privacy challenges, thus requiring adherence to data protection regulations, which may not always be possible. It highlights the risk of algorithmic bias in chatbots, which could perpetuate societal biases, which can be problematic. The article also examines the balance between fostering student autonomy in learning and the potential impact on academic self-efficacy, noting the risk of over-reliance on AI for educational purposes. Plagiarism continues to emerge as a critical ethical concern, with AI-generated content threatening academic integrity. The article advocates for comprehensive measures to address these ethical issues, including clear policies, advanced plagiarism detection techniques, and innovative assessment methods. By addressing these ethical challenges, the article argues that educators, AI developers, policymakers, and students can fully harness the potential of chatbots in education, creating a more inclusive, empowering, and ethically sound educational future.

Diagnosing homo digitalis: towards a standardized assessment for digital tool competencies.

In the 21st century, digital devices have become integral to our daily lives. Still, practical assessments designed to evaluate an individual's digital tool competencies are absent. The present study introduces the "Digital Tools Test" ("DIGI"), specifically designed for the evaluation of one's proficiency in handling common applications and functions of smartphones and tablets. The DIGI assessment has been primarily tailored for prospective use among older adults and neurological patients with the latter frequently suffering from so-called apraxia, which potentially also affects the handling of digital tools. Similar to traditional tool use tests that assess tool-selection and tool-action processes, the DIGI assessment evaluates an individual's ability to select an appropriate application for a given task (e.g., creating a new contact), their capacity to navigate within the chosen application and their competence in executing precise and accurate movements, such as swiping. We tested the implementation of the DIGI in a group of 16 healthy adults aged 18 to 28 years and 16 healthy adults aged 60 to 74 years. All participants were able to withstand the assessment and reported good acceptance. The results revealed a significant performance disparity, with older adults displaying notably lower proficiency in the DIGI. The DIGI performance of older adults exhibited a correlation with their ability to employ a set of novel mechanical tools, but not with their ability to handle a set of familiar common tools. There was no such correlation for the younger group. In conclusion, this study introduces an innovative assessment tool aimed at evaluating common digital tool competencies. Our preliminary results demonstrate good acceptance and reveal expected group differences. For current cohorts of older adults, the results seem to indicate that the ability to use novel tools may aid digital tool use. In the next step, the psychometric properties of the DIGI assessment should be evaluated in larger and more diverse samples. The advancement of digital tool competency assessments and rehabilitation strategies is essential when we aim at facilitating societal inclusion and participation for individuals in affected populations.

Оцінювання інноваційності та креативності в діяльності металургійного підприємства

The article summarizes the issues of assessing the innovation and creativity of the real sector of the economy. The main purpose of the study is a scientific and theoretical substantiation of the assessment of innovation and creativity on the example of enterprises in the metallurgical industry. The systematization of literature sources and approaches to solving the problem of assessing innovation and creativity shows that there is no single assessment methodology, as well as approaches to the criteria and indicators of assessment. The relevance of solving this scientific problem is that innovation and creativity is a competitive factor in the activities of the metallurgical enterprise PJSC "Zaporizhstal Iron and Steel Works", which represents an industry that is budgetary for the country, so scientific research on effective management, including on the basis of evaluation principles, continues. The study of the topic... in the paper is carried out in a logical sequence from theoretical and methodological approaches to a comparative assessment of creativity and innovation of the enterprise and the formation of conclusions and proposals. The methodological tools of the research methods were the definition of components and indicators of the integrated assessment of creativity and innovation of the enterprise, the calculation of indicators and a comparative analysis of their values during 2020 and 2022. The object of the study is the selected enterprise PJSC "Zaporizhstal Iron and Steel Works" because it is one of the market leaders and its ways of overcoming challenges will be applicable to other economic entities. The article presents the results of an empirical analysis of creativity and innovativeness of an enterprise, which shows that despite a slight downward trend in certain indicators of creativity and innovativeness, it remains a means of developing the enterprise's economy and realizing competitive advantages in the market. The study empirically confirms and theoretically proves that creativity and innovation are the driving force behind the development of response to security challenges and the implementation of transformational changes. The results of the study may be useful for researchers and management practitioners.

Creating teaching dynamics with In-house Faculty conclaves – a longitudinal study

Abstract— Faculty conclaves serve as critical platforms for academic discourse and networking, making them pivotal in shaping the future of educational institutions. These conclaves enable the sharing of best practices and introduction of innovative academic practices. The method of conduct of the faculty conclaves plays important role in their impact on the participants. Hence, it is mandatory to do an impact analysis of these conclaves to analyse the changes created in teaching learning practices. This research paper presents a comprehensive analysis of two consecutive faculty conclaves held in 2022 and 2023 in our institution, aiming to discern the evolving dynamics in teaching among the teachers participated in the same. This study employs a quantitative analysis incorporating surveys and observations to investigate the dynamic created by the faculty conclaves over time. In the first conclave (2022), we identified several prominent themes including Technology enabled Active & Collaborative learning, Experiential learning, innovative assessment, and virtual lab conduct. These discussions laid the foundation for the subsequent year's conclave (2023) with more focused theme of Project Based Learning (PBL), innovative assessment and new initiatives in lab conduct. Our findings reveal a shift towards more collaborative and technologically oriented discussions in the second conclave, emphasizing the importance of adaptability and innovation in higher education. This research highlights the importance of faculty conclaves as spaces for continuous improvement in higher education institutions and underscores their role in responding to the ever-changing educational landscape. Furthermore, the paper discusses the recommendations received in specific teaching areas and thereby creating an insight for the next conclave in year 2024. Keywords— Faculty conclave; New Pedagogy ; Teaching dynamics; Faculty expertise; Collaboration.

Critical Thinking: The Code to Crack Computer Science Education

Aim/Purpose: This paper explores the potential value of critical thinking in computer science education and discusses strategies for its integration across the curriculum. Background: As technology rapidly evolves and becomes increasingly integrated into society, there is a growing need for computer science graduates who can think critically about the ethical, societal, and technical implications of their work. Methodology: This study employs a conceptual analysis approach, reviewing existing literature on critical thinking in computer science education and synthesising insights from various sources. The analysis focuses on identifying challenges in implementing critical thinking instruction and proposing practical solutions. Contribution: This paper provides an overview of the current discourse on integrating critical thinking into computer science curricula. It explores the distinction between critical thinking and computational thinking, discusses various pedagogical approaches, and offers insights into potential challenges of implementation. Findings: The paper identifies six key challenges in embedding critical thinking into computer science education. It proposes initial steps to address these challenges, including curriculum redesign, innovative assessment methods, and faculty development strategies. Recommendations for Practitioners: Educators should adopt a balanced approach that complements technical education with critical thinking exercises, using diverse teaching methods such as dialogue-based teaching and authentic instruction. Recommendation for Researchers: Future research should focus on empirical studies to assess the effectiveness of the proposed solutions and develop standardised tools for evaluating critical thinking skills in computer science. Impact on Society: By enhancing critical thinking skills in computer science education, we can produce graduates who are better equipped to address complex technological challenges and their societal implications. Future Research: Further investigation is needed into the most effective pedagogical approaches for teaching critical thinking in computer science, with a focus on multidisciplinary perspectives.

Recognising a beacon of teaching and learning leadership in Australian chemistry

This Highlight article considers key contributions made by Professor Brian Yates to the Australian chemistry academic community in recognition of his seminal leadership that led to the establishment of the Chemistry Threshold Learning Outcomes (CTLOs) as national assessment standards. These CTLOs currently underpin the Royal Australian Chemical Institute (RACI) process of the professional accreditation of chemistry majors in Australian tertiary institutions and, hence, provide benchmarks of learning in our discipline. Examples of contemporary assessment approaches in chemistry are presented to inform academics who are seeking to assess learning outcomes beyond threshold standards and to inspire future innovative assessment approaches.

A CM-BWM Approach to Determinants of Open Innovation in Small and Medium-Sized Enterprises

Open innovation has gradually gained greater importance over time as commitment to a culture of constant innovation has become increasingly indispensable for organizations' long-term survival. This trend has made understanding the factors that affect innovation capacity and success imperative. Given the wide range of determinants already identified, researchers seeking to analyze these factors face difficult, extremely complex challenges in terms of determining their effects on small and medium-sized enterprises (SMEs). The existing literature mentions limitations arising from how criteria have been selected for evaluation systems and how these determinants' relative weights have been defined. This article develops an analysis system that combines cognitive mapping—based on the jointly understanding, reflecting, and negotiating strategy making approach—and the best-worst method. The two main aims are to identify the most significant criteria for evaluations of SME propensity to engage in open innovation and to calculate these factors' relative weights. This article focuses on promoting realistic, comprehensive analyses that foster clearer and more conscious decision making based on a holistic view of open innovation assessment.

A Serious game for programming in higher education

Programming is a highly difficult skill which is a constituent of many undergraduate programmes at Higher Education (HE) level. With the advancement of games technology there is an increasing opportunity for educators to provide innovative assessment tools for students on their courses which are highly immersive and graphically indicative of the times. This could potentially be in a supplementary capacity or to a greater extent inextricably linked to the learning outcomes and assessment outcomes. Notably serious games and Games-Based Learning (GBL) have received high levels of attention from educationalists due to being motivational, novel learning approaches. This paper will outline two empirical studies conducted to develop a game to teach programming at HE level. The first study will gauge the acceptability of a computer game for teaching programming and formulating content integration development requirements. The second study will outline the evaluation of the developed game being placed in a module as a formative assessment tool to assist learners to revise for their formal class test. Study one showed that acceptability of the game was high with 61 participants completing an acceptability/content integration questionnaire. The game was designed to consolidate knowledge on rudimentary and advanced programming concepts, data structures and algorithms. 48 participants evaluated the game in study two with the results generally indicating that they enjoyed playing the game as a revision alternative with 14% of participants rating it as very effective and 51% of participants as effective for allowing them to prepare for their class test. The majority of participants also believed that games could be utilised in a formative and summative assessment capacity on courses for independent study.

INNOVATIVE COMPONENT OF ECONOMIC SUSTAINABILITY OF REGIONAL ENTERPRISES

In modern conditions, innovation and innovation activity are becoming increasingly important for the economic development of the country and for the successful financial and economic activities of commercial organizations, being one of the basic elements of an effective strategy and an important tool for creating and maintaining competitive advantages. The importance of innovation activity as a driving factor of stable economic growth remains. The impact of these trends is further strengthened by the military situation, which has aggravated the need to use intensive ways of development and aggravated by the general scientific, technical and technological backwardness of many domestic industries. Significant difficulties in the practical application of the existing theoretical provisions of the analysis and evaluation of innovations are caused by the lack of methodological developments in the field of internal control of innovation activity and assessment of its overall efficiency for the enterprises of the region. The underdevelopment of the system of special analytical indicators and approaches to the assessment of innovations, taking into account their economic nature and content, in some cases negatively affects the validity of decisions made by financial managers of organizations. Changes in tax legislation also have a certain significance for the enterprises of the region and economic analysis and financial and economic control. An additional stimulus for the study of innovation activity problems is actively occurring nowadays processes of globalization and internationalization of the economy Entering the world stock markets, attracting foreign investment and preventing capital outflow are directly related to the mastering by economic entities of modern technologies in the field of production management, marketing and finance, with their accounting and reporting in accordance with international standards. In this regard, there is a growing need for methodological developments in the areas of analysis and control, including in the least developed area of innovation activity analysis. The need for periodic adaptation and improvement of analytical methodologies also gives rise to changes in other normative and legislative acts that form the legal basis for innovation activities.

Assessment of Innovativeness of the EU Candidate Countries Based on the European Innovation Scoreboard

Innovation is seen as a key capability for maintaining a competitive advantage, creating value for customers, and capturing a larger share of the market. In the contemporary world economy, understood as a set of mutual connections and interdependencies, innovations are crucial for economic growth and competitiveness. Internationalization and globalization processes in the world economy also concern the innovativeness of economies, and are visible in international use of technologies developed within national innovation systems, globalization of the creation and implementation of innovations, international (global) cooperation in research and development and innovation activities, international (global) protection of intellectual property. The aim of the article is to assess the level of innovativeness of the economies of selected European Union candidate countries based on the Summary Innovation Index (SII) and its components, as well as to estimate the innovation gap between these countries and the EU average of the Summary Innovation Index in 2023. The analysis was limited to Turkey (TR), Serbia (RS), Albania (AL), Montenegro ME), North Macedonia (MK), Bosnia and Herzegovina (BA) and Ukraine (UA) due to the availability of data describing the Summary Innovation Index, provided for all the EU candidate countries surveyed in the European Innovation Scoreboard. The paper formulates a research thesis assuming that the surveyed EU candidate countries are characterized by a lower level of innovativeness of economies than the EU average of the Summary Innovation Index and its components. Therefore, they show an innovation gap compared to the average for European Union countries in 2023. The results of the analysis only partially confirm this thesis. The article reviewed the literature on the innovation and innovativeness of economies and the innovation gap. The applied methods include descriptive analysis, statistical data analysis and comparative analysis along with statistical data from the European Innovation Scoreboard 2023.

Hemşirelik Öğrencilerinin İlk Klinik Uygulamalarının Değerlendirilmesine İlişkin Çok Kaynaklı İncelemeler ve 360-Derece Değerlendirmeye ilişkin Öngörüler: Nitel Bir Çalışma

Aim: This study was conducted to explain the current situation regarding the assessment of nursing students during their first clinical practice and to determine the views on 360-degree assessment, an innovative approach, from a multi-source perspective. Material and Methods: In this qualitative case study, individual interviews were conducted with nine instructors, focus group interviews were conducted with twenty-three nursing students, and documents were examined. Data were collected between 7 August 2019–22 November 2020. The data were analyzed in line with the descriptive analysis approach. Results: While reflections on the current situation were generated in line with the findings obtained from three data sources, the context of predictions on 360-degree assessment was generated in line with the findings obtained from interviews with students and instructors. Reflections on the current situation context are analyzed under assessors, competencies, methods and tools, feedback, challenges, and suggestions themes. Predictions on 360-degree assessment context are analyzed under assessors, frequency, tools, setting, benefits, and challenges themes. Conclusion: According to the results of the data triangulation, the most important issues regarding the assessment of nursing students during first clinical practice were the high student/instructor ratio and the fact that only instructors are officially assessors. Instructors and students approached positively to the 360-degree assessment, but they also shared some concerns.

Techno-economic analysis of solar-powered membrane distillation system with circulated permeate gap

This study investigates a novel integration of a circulated permeate gap membrane distillation (C-PGMD) module with flat plate solar collectors. The investigation is performed through a comprehensive performance study and techno-economic analysis, revealing unique insights and findings. The development of mathematical models enables the anticipation of system production and energy efficiency, capturing the employment of single and multistage C-PGMD modules under diverse design and operational conditions. Additionally, an innovative assessment of different powering modes, including solar-only, electrical-only, and hybrid solar-electrical is performed, which offers a unique perspective on system control and unit production costs. Results showed that circulating the permeate gap has significant effects on the permeate flux and the temperature of the solar tank such that the circulation rate controls the operation of the system. The revelation that increasing solar collector numbers amplifies productivity while reducing costs stands out as a noteworthy breakthrough. Cooling the system using a water source at ambient temperature is much recommended compared to cooling with chilled water. The pinnacle of this research lies in the proposal of a well-designed pilot hybrid-power 30-stage C-PGMD system, showcasing a remarkable achievement in reducing production costs to approximately 0.03 USD/Liter for 24-hour operation, predominantly powered by renewable energy sources. These novel findings redefine the landscape of integrated solar membrane distillation and pave the way for more sustainable and economically viable water desalination solutions.

Outcome-Based Education Scoring System Utilizing Modular Object-Oriented Dynamic Learning Environment

The dynamic nature of education necessitates inventive approaches to assessment and evaluation. This study concentrates on formulating a Scoring System aligned with Outcome-Based Education (OBE) principles, utilizing the Modular Object-Oriented Dynamic Learning Environment (MOODLE) platform. OBE prioritizes showcasing specific learning outcomes, cultivating a student-centric approach. The proposed system seeks to improve assessments through a flexible framework accommodating diverse learning objectives, employing a modular and object-oriented design. Integration with MOODLE, a widely-used e-learning platform, explores seamless implementation and user-friendly interaction. The Scoring System aids educators in efficiently evaluating student performance against predefined outcomes, fostering transparency and accountability.Key features include customizable assessments, progress tracking, and timely feedback. The study also examines the system's impact on student engagement, motivation, and overall learning outcomes, contributing valuable insights to innovative assessment methodologies in contemporary education. In conclusion, the research introduces a Scoring System harmonizing OBE principles with MOODLE's flexibility, benefiting educators, students, and institutions. The study's outcomes provide valuable implications for educators and technologists aiming to enhance assessments in the evolving education landscape.

PP128 A Transparent Methodology To Assess Innovativeness Of Health Technologies At Marketing Authorization Time

IntroductionDefining drug innovation can be challenging and there is no consensus on what a truly “innovative” medicine is. The Italian Medicine Agency (AIFA) has established an approach to assess innovativeness based on therapeutic need, added therapeutic value, and quality of evidence. However, judgment can be subjective and may not be adequate for assessment at the time of marketing authorization, when only preliminary evidence – often from non-comparative or non-randomized trials – are available. We developed a transparent methodology for early assessment of innovativeness at the time of marketing authorization, based on AIFA guidelines.MethodsSince the perspective was the marketing authorization date, only data available at agency’s Medical Review or pivotal trial publications were considered. AIFA criteria were revisited, using oncology medicines approved in the last 10 years as a base case. Impact of preliminary evidence and inadequate study design was considered.ResultsEach assessment should refer to the first approved specific indication and predefined clinically relevant outcomes. When more than one study was presented, best methodological quality, larger sample and/or longer follow-up was selected. Four domains were established: Therapeutical need: existence and clinical benefits of alternative therapies; Clinical benefit added when compared to those alternatives; Suitability of study design considering adequate comparator group, relevant outcome assessed and randomization; Risk of bias. For each domain, clear and specific criteria were defined in consensus by a group of experts in health technology assessment (HTA) and were applied to all cancer drugs evaluated.ConclusionsEfficacy evidence available for marketing authorization are often based on preliminary data, arising from single randomized clinical trials or even non-comparative studies, which difficult early assessments of innovativeness. For this reason, transparent and reproducible methodologies can be useful not only to HTA bodies, but also for other key stakeholders in the pharmaceutical market, such as investors, researchers, doctors, and governments.

An innovative assessment of memory for shapes and colors in high school students: Understanding brain neuronal circuits

An innovative assessment of memory for shapes and colors in high school students: Understanding brain neuronal circuits

Влияние точности оценки успеваемости на эффективность обучения в вузе

Progress control is an essential component of the educational process in universities. Assessment influences students’ motivation and learning strategies, as well as curriculum development. Errors in assessment cause distortions in the feedback of the student-teacher system and lead to a decrease in the effectiveness of teaching. The paper examines the influence of the accuracy and reliability of academic performance assessment on the effectiveness of learning at the university. The methodological basis of the study was the methods of conceptual modeling, analysis of scientific publications and generalized practical experience. A conceptual model of the impact of grades on students’ learning has been proposed and researched. It is shown that with a positive systematic shift in the average teacher error, the quality of learning decreases. The impact of inaccurate assessments on students’ motivation is also considered. Ways to increase the objectivity of academic performance assessment are proposed: formalization of grading criteria, a grade-rating system, the use of standard test programs and collegiate assessment methods. It is anticipated that future research in this area will focus on innovative assessment methods, the impact of technology on assessment accuracy, and the role of collegiate and self-assessment in improving reliability.