Quality Assurance Framework Research Articles

Challenges and opportunities for effective assessments within a quality assurance framework for MOOCs

In the extant literature of MOOCs’ quality issues, assessment has been largely neglected. This study developed a quality assurance (QA) framework for examining MOOCs’ assessments, from two comprehensive and widely adopted QA frameworks of online learning programs. This framework was applied to compare a set of MOOCs and on-campus courses, both provided by a university faculty of hospitality. Findings show that assessments of this MOOC program are generally comparable to the offline QA framework. However, differences also exist. These differences reflect three challenges: namely, (1) the insufficient hurdle role of MOOC assessments in qualification verification, (2) their inadequacies in training and assessing higher-order practical competencies, and (3) the unfulfilled role of learners as co-creators and co-assessors. These challenges can be converted into opportunities for better positioning of MOOCs as valuable educational offerings in hospitality and tourism.

The implementation of self-accreditation policy in Taiwan higher education and its challenges to university internal quality assurance capacity building

ABSTRACTIn 2012, the Taiwanese Ministry of Education launched a new quality assurance policy entitled ‘self-accreditation’, aimed at enhancing institutional autonomy, as well as establishing its internal quality review mechanism. In the self-accreditation policy, higher education institutions are encouraged to develop their own quality assurance frameworks based on strategic direction and institutionally specific features. The study adopts qualitative and quantitative approaches to explore the impacts and challenges of the 2012 Ministry of Education self-accreditation policy over Taiwanese universities and accrediting bodies. There are three major findings. 1. Self-accreditation policy had positive consequences and outcomes on university’s internal quality assurance capacity building. 2. Inappropriate selection processes of reviewers, arbitrary elimination of standards and indicators, inconsistency across review decisions are the challenges that self-accrediting universities encountered. 3. Under the new quality assurance policy, the roles and responsibilities of external quality assurance agencies should be redefined.

Quality Assurance Framework Development Based on Six New ECV Data Products to Enhance User Confidence for Climate Applications

Data from Earth observation (EO) satellites are increasingly used to monitor the environment, understand variability and change, inform evaluations of climate model forecasts, and manage natural resources. Policymakers are progressively relying on the information derived from these datasets to make decisions on mitigating and adapting to climate change. These decisions should be evidence based, which requires confidence in derived products, as well as the reference measurements used to calibrate, validate, or inform product development. In support of the European Union’s Earth Observation Programmes Copernicus Climate Change Service (C3S), the Quality Assurance for Essential Climate Variables (QA4ECV) project fulfilled a gap in the delivery of climate quality satellite-derived datasets, by prototyping a generic system for the implementation and evaluation of quality assurance (QA) measures for satellite-derived ECV climate data record products. The project demonstrated the QA system on six new long-term, climate quality ECV data records for surface albedo, leaf area index (LAI), fraction of absorbed photosynthetically active radiation (FAPAR), nitrogen dioxide (NO2), formaldehyde (HCHO), and carbon monoxide (CO). The provision of standardised QA information provides data users with evidence-based confidence in the products and enables judgement on the fitness-for-purpose of various ECV data products and their specific applications.

Quantification accuracy for dynamic contrast enhanced (DCE) CT imaging: phantom and quality assurance framework

PurposeStandardization and protocol optimization is essential for quantification of Dynamic Contrast Enhanced CT as an imaging biomarker. Currently, no commercially available quality assurance (QA) phantoms can provide for testing a complete set of imaging parameters pertaining to routine quality control for contrast-enhanced (CE) CT, as well as spatiotemporal accuracy. The purpose of this work was, therefore: (a) developing a solid calibration phantom for routine CE CT quality assurance; (b) investigating the sensitivity of CECT to organ motion, and (c) characterizing a volumetric CT scanner for CECT. MethodsCECT calibration phantom consisting of an acrylic uniform cylinder containing multiple capsules of varying diameters and orientations was designed and built. The capsules contain different solid density materials mimicking iodine contrast enhancement. Sensitivity and accuracy of CECT measurements on all capsules was performed using a 320-slice CT scanner for a range of scan parameters both with and without phantom motion along the transaxial axis of the scanner. ResultsRoutine commissioning tests such as uniformity, spatial resolution and image noise were successfully determined using the CECT phantom. Partial volume effect and motion blurring both contribute to a general decrease in contrast enhancement and this was further dependent on capsule orientation (least pronounced for the transaxial orientation). Scanning with a rotation time of less than 0.5 s, the effect of blurring is less than 3% for all orientations and phantom speeds. ConclusionA new robust contrast calibration phantom was developed and used to evaluate the performance of a 320-slice volumetric CT scanner for DCE-CT.

Report: The University Health Clinic: Definition, educational practices and outcomes

Introduction: Increasingly, universities are allocating substantial resources and efforts towards developing their own student-led clinical services (SLCS) within university health clinics (UHCs). For that reason, under the umbrella of the Australian and New Zealand Association for Health Professional Educators (ANZAPHE), clinical educationalists from 12 Australian universities have come together as a hot topic action group (HTAG) to collaboratively explore and enhance learning outcomes from this setting. Context: SLCS within UHCs increase placement capacity to meet growing demand. Moreover, SLCS within UHCs have the potential to provide an outstanding learning opportunity through high-quality supervision and activities designed to develop clinical competencies. However, the benefits of providing clinical education experiences for health and medical students in this setting has not been formally assessed. Typically, SLCS within UHCs are developed through consultation between universities and local health providers and are purposefully designed clinical placements with a focus on clinical educational activities for pre-registration students. UHCs may be located on or off campus and offer SLCS or other services to university staff, students and/or the wider community. In SLCS, students’ delivery of health services is supervised by university employed health professionals. Scope: The work of the HTAG to date is presented in this paper, which defines the setting and outlines assumptions, aspirations, challenges and enablers. The next phase of work for the HTAG is to formally explore the educational value for health professional students’ of SLCS delivered in UHCs and to develop resources and a quality assurance framework to guide the evaluation of these services.

Process analytical technology for cheese manufacture

SummaryRecent research on the development and application of process analytical technology (PAT) for cheese manufacture is reviewed in this article. PAT is a framework for innovative process manufacturing and quality assurance, which has been widely investigated for dairy processing applications, where particular processing challenges arise due to the variations in the physiochemical properties of milk. Cheese manufacturers are increasingly considering the adoption of a PAT approach to facilitate manufacture of cheese with enhanced product quality, safety and process efficiency. However, to date adoption of PAT in the dairy industry has been limited due to challenges associated with development and validation of calibration models, instrument variability, sanitary design and compatibility with processing environments. New technical developments in PAT tools, advances in chemometric modelling, robust data management tools and improved understanding of critical product and process parameters will facilitate further adoption of a PAT approach in cheese manufacture.

Development and implementation of online Dutch L2 courses in adult education: educators’ and providers’ perceptions of constraints and critical success factors

ABSTRACTThis study examines educators’ and providers’ perceptions of constraints and critical success factors of the development and implementation of online L2 learning. The focus is on Dutch L2 learning in adult education in Flanders. Semi-structured interviews with seven educators (shaping pedagogies/curricula) and six providers (organizing/offering language programmes) were conducted. Consequently, a focus group consisting of 12 teachers of Dutch (L2) and teacher trainers was run. The findings show that the main perceived constraints of the design and implementation of an online curriculum are negative beliefs about the effectiveness of online language learning, costs, a lack of technical and pedagogical support and insufficient teacher ICT-skills. The perceived major critical success factors are course design, technological facilities, (technical, financial and pedagogical) support, learner skills and attitudes, and competencies of instructional designers. Although many literature references were found concerning the importance of assessment, teacher skills and the role of the faculties, these were hardly mentioned during the interviews. The findings of this study call for a better financial framework, more collaboration among different stakeholders in the field, a focus on online teacher skills, adequate pedagogical and technical support and for a framework for quality assurance in online language learning.

Asian Care Certificate (ACC): a care quality assurance framework

PurposeQuality assuring elderly care through a viable and feasible standard framework is a major challenge for Asian governments. Although several attempts have been made to tackle foreign care worker (FCW) shortage, assuring the quality of the care they provide has been overlooked. The original framework allowed a better control over service quality to assure the elderly about their care according to the agreed standards. The paper aims to discuss these issues.Design/methodology/approachThrough several Japanese Governmental meetings, a new Asian Care Certificate (ACC) program is discussed based on the Japanese Care Certificate (JCC). The governments’ representatives adopted the JCC to form the ACC, which enables the ACC board to evaluate care workers and to intervene whenever the desired quality level is not achieved.FindingsThe author describes a new program. The findings of this paper will be confirmed when the ACC is implemented.Practical implicationsUsing the ACC framework, the challenge in providing a high-quality care service using FCWs across Asia would be partly resolved. FCWs’ quality of life might also gradually improve especially regarding to their human rights.Originality/valueThe ACC provides a new framework. Its value is recognized if one considers that many Asian populations are rapidly aging and many governments compromise quality by employing overseas workers to solve care worker shortages.

Restructuring quality assurance frameworks

PurposeThe purpose of this paper is to examine how the Japanese and Taiwanese national quality assurance (QA) agencies, National Institution for Academic Degrees and Quality Enhancement (NIAD-QE) and Higher Education Evaluation and Accreditation Council of Taiwan (HEEACT), transform their respective frameworks in response to social demands, and analyze and compare the respective approaches for the key concepts of autonomy, accountability, improvement and transparency.Design/methodology/approachUsing a qualitative document analysis approach, this paper initially examines the higher education system, major policies and QA developments, after which the methods associated with the QA restructuring transformations are outlined in terms of motivations, expectations and challenges. Finally, the NIAD-QE and HEEACT evaluation policies and frameworks are compared to assess how each has prepared to respond to emerging challenges.FindingsDuring the QA framework restructuring, both the NIAD-QE and HEEACT struggled to achieve autonomy, accountability, improvements and transparency. While the new internal Japanese QA policy is assured through the external QA, the Taiwanese internal QA, which has a self-accreditation policy, is internally embedded with university autonomy emphasized. The QA policies in both the NIAD-QE and HEEACT have moved from general compliance to overall improvement, and both emphasize that accountability should be achieved through improvements. Finally, both agencies sought transparency through the disclosure of the QA process and/or results to the public and the enhancement of public communication.Originality/valueThis study gives valuable insights into the QA framework in Asian higher education institutions and how QA has been transformed to respond to social needs.

Consensus guidelines for the uniform reporting of study ethics in anatomical research within the framework of the anatomical quality assurance (AQUA) checklist.

Unambiguous reporting of a study's compliance with ethical guidelines in anatomical research is imperative. As such, clear, universal, and uniform reporting guidelines for study ethics are essential. In 2016, the International Evidence-Based Anatomy Working group in collaboration with international partners established reporting guidelines for anatomical studies, the Anatomical Quality Assurance (AQUA) Checklist. In this elaboration of the AQUA Checklist, consensus guidelines for reporting study ethics in anatomical studies are provided with in the framework of the AQUA Checklist. The new guidelines are aimed to be applicable to research across the spectrum of the anatomical sciences, including studies on both living and deceased donors. The authors hope the established guidelines will improve ethical compliance and reporting in anatomical research. Clin. Anat. 31:521-524, 2018. © 2018 Wiley Periodicals, Inc.

Self-study of Innovation in Quality Assurance at the Zimbabwe Council for Higher Education

This paper presents a self-study of the innovative policies, practices, methods, systems and instruments that have been used by the Zimbabwe Council for Higher Education to assure quality in the constantly changing higher education environment. The aim of the paper is to provide information to countries still developing quality assurance frameworks. The author underscore the role of motivation in creating fertile ground for innovation and creativity.

Taking stock of changes in quality assurance in Portuguese higher education between 2007 and 2015

This article documents the changes that occurred in Portugal after the adoption of the new higher education quality assurance framework in 2007. The most obvious results of the new higher education evaluation and accreditation agency’s actions can be observed primarily at the level of teaching‑program provision. Accreditation activities resulted in a 40% reduction in the supply of the courses on offer between 2009 and 2015 (Sin et al., 2016). This reduction was felt mainly in private institutions, which confirms that substandard programmes were more common in the private sector. Another consequence was that institutions started to take a more formal and systematic approach to quality by implementing internal quality assurance systems. These systems were driven by a logic of accountability rather than by genuine self‑reflection aiming to engage all those involved and which would have led to improvement. Therefore, it appears that most academics perceive internal quality assurance to have had negative effects on teaching and learning, mainly because of increased bureaucracy, while the positive effects are still perceived as being relatively modest.

National Coronial Information System: Epidemiology and the Coroner in Australia.

The National Coronial Information System (NCIS) is the world's first national Internet-based database of coronial information. It was established in Australia following the recognition by coroners that their mandate for public health and safety could be improved if they could identify previous similar deaths. The NCIS is funded from state, territory, and commonwealth government agencies and overseen by the NCIS Board of Management. A team of ten staff manage the day-to-day operation of the system. The NCIS enables the rapid identification of up-to-date information on deaths investigated by the coroners' jurisdictions in Australia (from July 2000) and New Zealand (from July 2007). It is accessible to death investigators (coroners; forensic, medical, and scientific staff; and police) to assist with death investigation and approved third parties (e.g., researchers). The NCIS contains demographic information about the deceased, contextual information about the circumstances in which the death occurred, the cause and manner of death, and four full text reports generated during the investigation. The NCIS contains information on over 328 000 completed coroners' death investigations across Australia and New Zealand. Approximately 350 death investigators are registered to access the data for their ongoing death investigations, and 235 third party users are registered to utilize the data set in their research. In addition to the utility of the NCIS, this paper describes the rationale and governance structure of the NCIS, the information technology infrastructure, data set, quality assurance framework, and contribution to death and injury prevention.

Recognition of Prior Learning (RPL) as pedagogical pragmatism

This case study is located within a joint venture between a University and a College of Further Education, with an explicit mission to bring into Higher Education under-represented groups, including mature learners and to promote part-time education. Our case study provides a review and evaluation of the successful development of an undergraduate programme in leadership and professional development for experienced learners, two-thirds of which is awarded through the Recognition of Prior Learning (RPL). The case study demonstrates how the research-informed RPL design has enabled the recognition of prior learning in a way that is both true to the students’ experience and works within the parameters of quality assurance frameworks. The term used is pedagogical pragmatism i.e. a process that rests on particular combinations of both technical rationality (e.g adherence to a Learning Outcome focused output which is static and a given) and professional artistry (differential judgements made about the efficacy of approaches to RPL). The practices are contextual, however we would argue that sharing the conditions that underpin RPL as a specialised pedagogic practice is an important part of moving this agenda forward in the sector.

РАЗРАБОТКА ПРАВИЛ НАДЛЕЖАЩЕГО ПРОИЗВОДСТВА БИОМЕДИЦИНСКИХ КЛЕТОЧНЫХ ПРОДУКТОВ

The article presents the essence of draft of the Guidance of good manufacturing practices of biomedical cell products (BMCP) (GMP/GTP guideline) harmonized with the international requirements, which contains the basic quality and safety standards of clinical application of these products. These regulations prescribe the requirements for institutions engaged in one or more stages of BMCP production and allow to avoid any risk of contamination of cells, tissues and finished product. The aim of this work is to develop a methodology for BMCPs' quality assurance framework. Materials and methods. The main subjects of research are national and international laws and regulations, publications on quality assurance systems of cell products, problems of BMCP manufacturing and validation. Results. The draft Guidance of good manufacturing practices of BMCP (GMP/GTP guideline), including specific requirements to donor determination, biomaterial sampling and its transportation to the manufacture, to risk management system, traceability system, to processing, definition of minimally manipulated BMCP, requirements to incoming control, continuous in-process control and control of finished BMCP, to pharmacovigilance system were developed. Specific features of the manufacture of test products for non-clinical and clinical studies are described. Assessment elements for certification prior to release of each batch of test BMCP were clarified. Recommendations on the introduction of a product coding system according to ISBT 128 Standard are given in this work.

DATA QUALITY IN REMOTE SENSING

Abstract. The issue of data quality (DQ) is of growing importance in Remote Sensing (RS), due to the widespread use of digital services (incl. apps) that exploit remote sensing data. In this position paper a body of experts from the ISPRS Intercommission working group III/IVb “DQ” identifies, categorises and reasons about issues that are considered as crucial for a RS research and application agenda. This ISPRS initiative ensures to build on earlier work by other organisations such as IEEE, CEOS or GEO, in particular on the meritorious work of the Quality Assurance Framework for Earth Observation (QA4EO) which was established and endorsed by the Committee on Earth Observation Satellites (CEOS) but aims to broaden the view by including experts from computer science and particularly database science. The main activities and outcomes include: providing a taxonomy of DQ dimensions in the RS domain, achieving a global approach to DQ for heterogeneous-format RS data sets, investigate DQ dimensions in use, conceive a methodology for managing cost effective solutions on DQ in RS initiatives, and to address future challenges on RS DQ dimensions arising in the new era of the big Earth data.

A case study comparing research integrity, governance and ethics frameworks to facilitate collaboration between Bristol and Kyoto University

Researchers and non-commercial institutions negotiate complex legislation and guidance when planning and conducting research studies. The documents and processes required differ across nations and their regulatory bodies and it can be challenging to conduct an international study, especially for non-commercial organisations. In this study, colleagues from Japan and the UK worked closely together focusing on the legislation, organisations, trial processes, ethics review and quality assurance frameworks of clinical trials in two countries, the UK, demonstrated on the model of practices in the University of Bristol and University Hospital Bristol NHS Foundation Trust, and Japan, based on the model in Kyoto University Hospital. Although the ICH tripartite guidelines (ICH-GCP) were developed with participation from both the EU and Japan the set-up and approval processes for clinical trials are different between the two countries while the expectations for quality assurance are similar. We will argue that the framework in the UK is well-developed for performing multi-centre trials both, commercially and non-commercially sponsored. Japan has an excellent infrastructure to conduct early phase trials and commercially sponsored trials. Multi-centre investigator led trials are currently a challenge due to the complex and resource intense approval systems. A good model for collaboration between Bristol and Kyoto might be where early translational studies are set-up in Japan and later phases of the studies are conducted in the UK.

IMRT QA using machine learning: A multi-institutional validation.

PurposeTo validate a machine learning approach to Virtual intensity‐modulated radiation therapy (IMRT) quality assurance (QA) for accurately predicting gamma passing rates using different measurement approaches at different institutions.MethodsA Virtual IMRT QA framework was previously developed using a machine learning algorithm based on 498 IMRT plans, in which QA measurements were performed using diode‐array detectors and a 3%local/3 mm with 10% threshold at Institution 1. An independent set of 139 IMRT measurements from a different institution, Institution 2, with QA data based on portal dosimetry using the same gamma index, was used to test the mathematical framework. Only pixels with ≥10% of the maximum calibrated units (CU) or dose were included in the comparison. Plans were characterized by 90 different complexity metrics. A weighted poison regression with Lasso regularization was trained to predict passing rates using the complexity metrics as input.ResultsThe methodology predicted passing rates within 3% accuracy for all composite plans measured using diode‐array detectors at Institution 1, and within 3.5% for 120 of 139 plans using portal dosimetry measurements performed on a per‐beam basis at Institution 2. The remaining measurements (19) had large areas of low CU, where portal dosimetry has a larger disagreement with the calculated dose and as such, the failure was expected. These beams need further modeling in the treatment planning system to correct the under‐response in low‐dose regions. Important features selected by Lasso to predict gamma passing rates were as follows: complete irradiated area outline (CIAO), jaw position, fraction of MLC leafs with gaps smaller than 20 or 5 mm, fraction of area receiving less than 50% of the total CU, fraction of the area receiving dose from penumbra, weighted average irregularity factor, and duty cycle.ConclusionsWe have demonstrated that Virtual IMRT QA can predict passing rates using different measurement techniques and across multiple institutions. Prediction of QA passing rates can have profound implications on the current IMRT process.

Systematic review: Lost-time injuries in the US mining industry.

The mining industry is associated with high levels of accidents, injuries and illnesses. Lost-time injuries are useful measures of health and safety in mines, and the effectiveness of its safety programmes. To identify the type of lost-time injuries in the US mining workforce and to examine predictors of these occupational injuries. Primary papers on lost-time injuries in the US mining sector were identified through a literature search in eight health, geology and mining databases, using a systematic review protocol tailored to each database. The Critical Appraisal Skills Programme (CASP), Framework of Quality Assurance for Administrative Data Source and the Cochrane Collaboration 'Risk of bias' assessment tools were used to assess study quality. A total of 1736 articles were retrieved before duplicates were removed. Fifteen articles were ultimately included with a CASP mean score of 6.33 (SD 0.62) out of 10. Predictors of lost-time injuries included slips and falls, electric injuries, use of mining equipment, working in underground mining, worker's age and occupational experience. This is the first systematic review of lost-time injuries in the US mining sector. The results support the need for further research on factors that contribute to workplace lost-time injuries as there is limited literature on the topic. Safety analytics should also be applied to uncover new trends and predict the likelihood of future incidents before they occur. New insights will allow employers to prevent injuries and foster a safer workplace environment by implementing successful occupational health and safety programmes.

Quality assurance of chemical ingredient classification for the National Drug File – Reference Terminology

The National Drug File – Reference Terminology (NDF-RT) is a large and complex drug terminology consisting of several classification hierarchies on top of an extensive collection of drug concepts. These hierarchies provide important information about clinical drugs, e.g., their chemical ingredients, mechanisms of action, dosage form and physiological effects. Within NDF-RT such information is represented using tens of thousands of roles connecting drugs to classifications. In previous studies, we have introduced various kinds of Abstraction Networks to summarize the content and structure of terminologies in order to facilitate their visual comprehension, and support quality assurance of terminologies.However, these previous kinds of Abstraction Networks are not appropriate for summarizing the NDF-RT classification hierarchies, due to its unique structure. In this paper, we present the novel Ingredient Abstraction Network (IAbN) to summarize, visualize and support the audit of NDF-RT’s Chemical Ingredients hierarchy and its associated drugs. A common theme in our quality assurance framework is to use characterizations of sets of concepts, revealed by the Abstraction Network structure, to capture concepts, the modeling of which is more complex than for other concepts. For the IAbN, we characterize drug ingredient concepts as more complex if they belong to IAbN groups with multiple parent groups. We show that such concepts have a statistically significantly higher rate of errors than a control sample and identify two especially common patterns of errors.