Expert Appraisal Research Articles

Analisis Pengembangan Bahan Ajar Ekonomi dengan App Inventor2 Terhadap Kemandirian Belajar

The development of technology has penetrated to various aspects of life including in the field of education. Teachers have been using technology to facilitate the learning process that aims to improve the quality of education. These conditions underlie the conduct of various studies related to learning technology. This study aims to develop teaching materials on economic subjects by using APP INVENTOR2 then the development results are used to analyze student learning independence. As research development or Research and Development (R & D), this research uses ADDIE development model which consists of five stages: 1) Analysis, 2) Design, 3) Development, 4) Implementation ), and 5) Evaluation. From these five stages, this study only reached the fourth stage and did not perform the fifth stage of evaluation phase. The result of the analysis shows that the level of feasibility of APP INVENTOR2 teaching materials based on the expert material's appraisal is very good category, the expert of the teaching materials with the excellent category and the economic learning practitioners with very good category. Student learning independence on average shows a high degree of independence ≥ 70%. Meanwhile, for the students response to the teaching materials when tested on average showed a positive response with a percentage of ≥ 70% on each indicator. Thus the development of teaching materials on economic subjects with APP INVENTOR2 is feasible to use.

Метод поліпшення узгодженості оцінок експертів у ході діалогу

Improving the quality of recommendations for decision-makers in weakly structured domains is affected largely by the reliability of results of appraisals carried out during the construction of models of weakly structured systems based on which recommendations for decision-makers are generated. The result of every group expert appraisal is a rating obtained through the aggregation of individual expert estimates. Usually, aggregation is justified when the consistency rate achieves a certain level (threshold of consistency), otherwise the result would be unreliable. It is offered a non-statistical approach to the evaluation of consistency, using which an expert estimates are compared in pairs (simplest case). A rate of consistency between the expert estimates sufficient for their aggregation has been identified. The evaluation of this threshold value is based on a statistical approach, triangular distribution and distribution function. A method has been developed for improving the consistency between expert estimates: it is based on a spectral approach where a set of estimates is presented as spectrum elements on a discrete or a continuous positive scale. The method offered for dialogue with experts minimizes tensions put on them, and thus allows raising the consistency between their estimates to a sufficient level and increases significantly the probability of successful completion of appraisal. The technique offered allows optimizing the task of raising the rate of consistency both thanks to using more reliable algorithms for evaluating such consistency and thanks to the developed step-by-step procedure of improvements through questions asked to experts, allowing at the same time to minimize the impact of the subjectivity of their estimates on the reliability of research. The method uses optimization allowing for automatic identification of the shortest path for improving consistency. This allows addressing each expert only once, without putting tensions on him/her by indicating the desired direction in changing his/her estimate. The methods and procedures offered have been implemented in a web-distributed system of support for decision-making and have been approved in practical appraisals.

Critical appraisal of RCTs by 3rd year undergraduates after short courses in EBM compared to expert appraisal.

Introduction: An essential aim of courses in evidence-based medicine (EBM) is to improve the skills for reading and interpreting medical literature adequately. Regarding the conceptual framework, it is important to consider different educational levels.Aim: Our primary aim was to investigate the applicability of different instruments for the assessment of methodological study quality by 3rd grade students after short courses in EBM. Our secondary outcomes were agreement with expert assessments and student’s knowledge and competences.Methods: We conducted four short courses in EBM of 90 minutes each for health care management and medical students focused on critical appraisal of the literature. At the end, the students assessed five publications about randomized controlled trials (RCTs) using five different instruments; the results were compared to expert assessments.Results: In total, 167 students participated in our EBM courses. Students’ assessments showed a non-systematic over- and underestimation of risk of bias compared to expert assessments with no clear direction. Agreement with expert assessments ranged between 66% to over 80%. Across RCTs, evidence was found that the choice of instrument had an impact on agreement rates between expert and student assessments (p=0.0158). Three RCTs showed an influence of the instrument on the agreement rate (p<0.05 each). Discussion: Our results contrast sharply with those of many other comparable evaluations. Reasons may be a lack of students’ motivation due to the compulsory courses, and the comparison to a reference standard in addition to self-ratings causing objectivity.Conclusion: Undergraduates should become familiar with the principles of EBM, including research methods, and the reading of scientific papers as soon as possible. For a deeper understanding, clinical experience seems to be an indispensable precondition. Based on our results, we would recommend an integration of lectures about EBM and critical appraisal at least twice during studies and with greater intensity shortly before graduation.

Modernization of Vibration Analyzers Based on Identification Measurements

A technology is described for revamping vibration analyzers by introducing an additional intelligent unit for analyzing temporal characteristics of measurement signals. The unit flowchart includes a database, storing expert appraisals, and a knowledgebase, constructed based on the method of identification measurements of the regularity/chaoticity properties in the characteristics of vibration signals using the technique of scales. A computer-aided device has been developed for studying the applicability of the proposed techniques. Results of the vibrodiagnostics of a pumpjack with this device are presented.

ПРОГРАМНО-ІМІТАЦІЙНІ КОМПЛЕКСИ ДЛЯ ФОРМУВАННЯ ЕКОНОМІЧНИХ КОМПЕТЕНТНОСТЕЙ СТУДЕНТІВ ТЕХНІЧНИХ СПЕЦІАЛЬНОСТЕЙ: КРИТЕРІЇ Й ПОКАЗНИКИ ДОБОРУ

The article describes criteria of selection of business simulations to use as the learning tools for the formation of economic competence of technical specialties students. The results of selection of available business simulations, using criterions developed in the research are being presented. Appropriate indicators have been developed for each criterion. The following criteria are defined for business simulations: design-didactical, technological and organizational. As the result of the first phase of the expert appraisal the list of business simulations to choose the most efficient using defined criteria was selected. Business simulations to use as the learning tools for economic competence of technical specialties students formation were selected in the second phase of the research using expert appraisal method.

Escala de incertidumbre en la enfermedad–forma padres/hijos: validación de la adaptación al español

ObjectiveTo analyze the psychometric properties of the Parents’ Perception of Uncertainty in Illness Scale, parents/children, adapted to Spanish. MethodA descriptive methodological study involving the translation into Spanish of the Parents’ Perception of Uncertainty in Illness Scale, parents/children, and analysis of their face validity, content validity, construct validity and internal consistency. ResultsThe original version of the scale in English was translated into Spanish, and approved by its author. Six face validity items with comprehension difficulty were reported; which were reviewed and adapted, keeping its structure. The global content validity index with expert appraisal was 0.94. In the exploratory analysis of factors, 3 dimensions were identified: ambiguity and lack of information, unpredictability and lack of clarity, with a KMO=0.846, which accumulated 91.5% of the explained variance. The internal consistency of the scale yielded a Cronbach alpha of 0.86 demonstrating a good level of correlation between items. ConclusionThe Spanish version of “Parent's Perception of Uncertainty in Illness Scale” is a valid and reliable tool that can be used to determine the level of uncertainty of parents facing the illness of their children.

The Validity of the earth and space science learning materials with orientation on multiple intelligences and character education

Validation of the Earth and Space Science learning the material in the chapter of the Earth's Protector based on experts (media & content expert and practitioners) and junior high school students' responses are presented. The data came from the development phase of the 4D method (Define, Design, Develop, Dissemination) which consist of two steps: expert appraisal and developmental testing. The instrument employed is rubric of suitability among the book contents with multiple intelligences activities, character education, a standard of book assessment, a questionnaires and close procedure. The appropriateness of the book contents with multiple intelligences, character education and standard of book assessment is in a good category. Meanwhile, students who used the book in their learning process gave a highly positive response; the book was easy to be understood. In general, the result of cloze procedure indicates high readability of the book. As our conclusion is the book chapter of the Earth's Protector can be used as a learning material accommodating students’ multiple intelligences and character internalization.

Grounded Theory Research Design: An Investigation into Practices and Procedures

ABSTRACTWe engaged in a 3-phase meta-methodology review of grounded theory research design and practices referenced in the literature, which were validated by an expert sample. Following an initial scoping review of qualitative literature and a 15-year evidence map, we used an embedded quantitative approach to examine expert appraisal of grounded theory construct relevance. The results postulate a unique format in which grounded theory research is conceptualized and created.

Study of promises for the use of ultrasound in the technology of secondary benefication of processing wastes

The results of the study, aimed at designing of benefication technology of mine processing wastes of Voznesenskiy ore district, are presented in this paper. By the expert appraisals, the amount of tailings dumps of the Yaroslavskaya Mining Company is estimated to be more than 30 million tons. Sample testing has shown that fluorite content varies from 13% to 23%, calcite - up to 14%, and zinc - in the range of 0.4-0.6%. The research was conducted with tailing samples containing 20.7% of CaF2 and 10.2% of CaCO3. Mineral grains of the secondary raw material were examined for their surface state and a package of necessary preliminary operations, which provide an efficient material - flotation reagents interaction, was determined. It has been established that extraction of fluorite to concentrates that would match existing requirements is possible in principle. The use of ultrasonic treatment of material in its preparation for flotation is conditioned by an effective desorption of films of different nature from mineral particles. The suggested scheme of fluorite flotation involves preliminary treatment of raw material by ultrasound with dumping of released mud fractions. The optimal operating regime allows obtaining concentrates of higher quality than it is under usual technology without the ultrasonic exposure. In this process, the extraction of fluorite to a concentrate with 94.47% of CaF2 increases up to 61.11%, which is higher by 2.96% against the original studies.

Risk in Implementing New Electronic Management Systems at Universities

Rapid development of using information technology in higher education contributes not only into its efficiency but also may cause a variety of risks affecting implementation of some other educational process aspects. Understanding the significance of the risks and their subsequent study and assessment allows for timely adjustments in implementation of certain informational and educational technologies in the educational process. The paper focuses on the issues related to identification of the major risks while introducing and implementing educational innovations, and those related to introduction of the learning management system (LMS) in higher education institutions, their impact assessment and influence on the efficiency throughout the entire educational process. The results of the study have been summarized using risk mapping and sensitivity analysis methods. These methods allowed us to visualize the level of each risk distinguished in the study according to the degree of its influence on the educational process and probability of its occurrence. The study was based on the survey findings and students’ interviews and aimed to identify whether they understand and realize the difficulties and complexities in the procedure of innovative technologies implementation by their university. The authors have developed a list of risks occurring while introducing and implementing innovations in the educational process which in their turn will reflect the peculiarities of the higher education institution using modern learning techniques. Moreover, the paper discusses the risk sensitivity study results. They are presented as an expert appraisal of risks related to their influence on the resultant as integrated assessment, i.e. the Wheel Model of risk management. In the course of the study it has been found that, despite the difficulties of innovation implementation, the innovative programs having been introduced improve the educational process and ensure appropriate quality of human capital, or workforce. Reasonable conclusions from the experience of the state-of the art innovation introduction into university teaching-learning process confirm its practical significance, its ability to encourage university students and increase their participation and independence in learning, thus contributing to development of their skills that meet the requirements of an economist position and in future will help them be successfully engaged into innovation economics. These students’ skills and competencies meet the requirements of innovative processes in the economy, despite the fact that the process involves certain risks. The paper materials may be of practical value to professionals involved in the development and implementation of innovative educational technologies at universities.

Defining the actinic keratosis field: a literature review and discussion.

Despite the chronic and increasingly prevalent nature of actinic keratosis (AK) and existing evidence supporting assessment of the entire cancerization field during clinical management, a standardized definition of the AK field to aid in the understanding and characterization of the disease is lacking. The objective of this review was to present and appraise the available evidence describing the AK cancerization field, with the aim of determining a precise definition of the AK field in terms of its molecular (including genetic and immunological), histological and clinical characteristics. Eight European dermatologists collaborated to conduct a review and expert appraisal of articles detailing the characteristics of the AK field. Articles published in English before August 2016 were identified using PubMed and independently selected for further assessment according to predefined preliminary inclusion and exclusion criteria. In addition, a retrospective audit of patients with AK was performed to define the AK field in clinical terms. A total of 32 review articles and 47 original research articles provided evidence of sun-induced molecular (including genetic and immunological) and histological skin changes in the sun-exposed area affected by AK. However, the available literature was deemed insufficient to inform a clinical definition of the AK field. During the retrospective audit, visible signs of sun damage in 40 patients with AK were assessed. Telangiectasia, atrophy and pigmentation disorders emerged as 'reliable or very reliable' indicators of AK field based on expert opinion, whereas 'sand paper' was deemed a 'moderately reliable' indicator. This literature review has revealed a significant gap of evidence to inform a clinical definition of the AK field. Therefore, the authors instead propose a clinical definition of field cancerization based on the identification of visible signs of sun damage that are reliable indicators of field cancerization based on expert opinion.

Food crisis as factor of future value of the agricultural land

At the present stage of human development, food is one of the most acute problems. Over the past 30-40 years, the growth rate of population in many countries of the world is ahead of the growth rate of agricultural production, which leads to acute shortage of food. This is especially true of developing countries, which accounts for the overwhelming majority of the population of the planet that is under-eating and starving. According to FAO (Food and Agriculture Organization), in the world now about half a billion people are constantly hungry and twice asleep. Insufficient consumption affects children in particular. Nearly 300 million children in Asia, Africa and Latin America are lagging behind in physical and mental development as a result of poor nutrition. Every day from hunger there are about 12 thousand people dying. According to FAO, food products around the world are produced in general enough to feed the entire population of the Earth. However, the main reason for the global food crisis is not that products are distributed among countries irrelevant to the population, although such a problem exists. Researchers believe that the food crisis is caused by the coincidence of demographic, environmental and energy problems with the effects of adverse weather conditions, as well as a colossal increase in military spending. Investigated the interconnection between the dynamics of population growth and world food production volumes with the areas of agricultural land and the possible influence of projected changes in agricultural land use on increasing the cost of agricultural land is substantiated. It was investigated that the average national land rent in Ukraine would increase by 25.5%. This in turn will lead to an increase in the value of agricultural land in Ukraine. Keywords : land cost, expert appraisal, agricultural land, deficiency, world food production.

A Collaborative Approach to Identifying Social Media Markers of Schizophrenia by Employing Machine Learning and Clinical Appraisals.

BackgroundLinguistic analysis of publicly available Twitter feeds have achieved success in differentiating individuals who self-disclose online as having schizophrenia from healthy controls. To date, limited efforts have included expert input to evaluate the authenticity of diagnostic self-disclosures.ObjectiveThis study aims to move from noisy self-reports of schizophrenia on social media to more accurate identification of diagnoses by exploring a human-machine partnered approach, wherein computational linguistic analysis of shared content is combined with clinical appraisals.MethodsTwitter timeline data, extracted from 671 users with self-disclosed diagnoses of schizophrenia, was appraised for authenticity by expert clinicians. Data from disclosures deemed true were used to build a classifier aiming to distinguish users with schizophrenia from healthy controls. Results from the classifier were compared to expert appraisals on new, unseen Twitter users.ResultsSignificant linguistic differences were identified in the schizophrenia group including greater use of interpersonal pronouns (P<.001), decreased emphasis on friendship (P<.001), and greater emphasis on biological processes (P<.001). The resulting classifier distinguished users with disclosures of schizophrenia deemed genuine from control users with a mean accuracy of 88% using linguistic data alone. Compared to clinicians on new, unseen users, the classifier’s precision, recall, and accuracy measures were 0.27, 0.77, and 0.59, respectively.ConclusionsThese data reinforce the need for ongoing collaborations integrating expertise from multiple fields to strengthen our ability to accurately identify and effectively engage individuals with mental illness online. These collaborations are crucial to overcome some of mental illnesses’ biggest challenges by using digital technology.

Реализация международных обязательств, принятых государствами-членами в рамках Евразийского экономического союза

The article explores the issues related to the fulfillment of international obligations accepted by the member states within the framework of the Eurasian Economic Union, on the basis of an analysis of international legal and domestic legal acts.&#x0D; The purpose of the article is to develop scientifically grounded recommendations and proposals on improving the legal mechanisms for the fulfillment by Member States of international obligations arising from international legal acts operating within the framework of the Eurasian Economic Union.&#x0D; Tasks of the article: analysis of the provisions of the Treaty on the Eurasian Economic Union of May 29, 2014, concerning the application and implementation of decisions adopted by the bodies of the Eurasian Economic Union; an analysis of the regulatory legal acts of the member states of the Eurasian Economic Union affecting the implementation of international obligations arising from international treaties and decisions of international organizations; comparative legal analysis of the provisions of the constitutions of the member states of the Eurasian Economic Union on the place of international treaties in national legal systems; development of proposals on the improvement of legal mechanisms for the implementation of international obligations adopted within the framework of the Eurasian Economic Union.&#x0D; Among the methods used in the preparation of the article, it is necessary to distinguish the dialectical method, the philosophical method, the formal logical method, the system-structural method, the historical method, the formal legal method, the method of interpreting the law, the comparative legal method, the method of expert appraisal, the method Legal modeling and forecasting.&#x0D; In the article, based on the results of the study of international legal acts, legislative and by-laws of the member states of the Eurasian Economic Union, as well as scientific developments, proposals were made to improve the legislation of the Russian Federation in the field of fulfilling international obligations, the source of which are decisions of international organizations, including the Eurasian Economic Union.

Developing the immunologybook for animal and human physiology subject

The objective of the study was to develop an immunology book for Animal and Human Physiology subject. This book was developed based on the Thiagarajan development model which was modified of: Define, Design, Develop, dan Disseminate (4D). The data expert validation instrument was questionnaire using Likert scales, comments, and recommendation sheets. Expert appraisal was done by material expert and media and design learning expert. The developmental testing was conducted using questionnaire to test the readibility. The expert validation was conducted by material expert as well as design and media learning expert validator; meanwhile, the field test was done to measure the readability. The validity test results were: the material expert state that the material is valid (97.14%), as well as the design and learning media expert (84.88%) and field test by students (88.17%).

Developing a Learning Package Covering a Topic on Cells and Tissues Based on Guided-Inquiry Model and Integration of Local Knowledge

: This study aims to develop a learning package covering a topic on cells and tissues on the basis of guided-inquiry learning model and integration of local knowledge. The package manifests in a syllabus, lesson plans, and a module. The developmental model proposed by Dick and Carey (2009) was employed and adapted in the study. The instructional testing was carried out through three stages, namely, expert appraisal, small group test and main field test. The results of the study showed that the research produced a learning package with high validity, practicality, and efficacy. It was evidenced by the results of expert validation and developmental testing that reached 88.42% indicating high validity. With regard to its efficacy and utility in Biology learning, the gain score reached 0.78 attesting its merits.

Evaluation of a CAT Database and Expert Appraisal of CATs Developed by Students.

Five steps have been recommended to provide evidence-based patient care: formulating a clinical question, searching for literature, evaluating the validity and applicability of results, implementing results into practice, and assessing if the new evidence has led to improved health care. Students can be trained in these steps by the development of knowledge summaries such as critically appraised topics (CATs). The aim of the present project was the development, use, and evaluation of a German-language CAT database and an appraisal of the quality of CATs developed by students. A total of 153 fifth-year veterinary medical students (in 21 groups) were enrolled in the project. Each group developed a CAT and most students participated in a survey. To learn more about the quality of the CATs, we asked experts to appraise the texts written by the students. The CATs were indexed with key words and assigned to specific fields corresponding to the European Colleges of Veterinary Specialisation. Currently, 57 CATs have been developed. The majority of students stated that writing CATs is a good exercise and that "it is important to teach the assessment of scientific information." In total, 13 experts completed the questionnaires, out of which 9 graded the CAT they appraised as good. In addition to English-language CAT databases, German tools should also be available for students and practitioners.

A set of indicators to better characterize beef carcasses at the slaughterhouse level in addition to the EUROP system

The EUROP classification system that is used in European slaughterhouses to characterize beef carcasses includes only a small number of general indicators (category of animal, conformation score, fat score and hot carcass weight). Consequently, the interests of stakeholders in the production chain (breeders, slaughterers and retailors) are not considered. The aim of this study was to propose a set of indicators, in addition to the EUROP system, to characterize beef carcasses in slaughterhouses in a more precise way that considers the interests of the different stakeholders in Europe. To this end, all of the key variables used in the scientific literature (n = 142 articles from 2010 to 2015) were considered as candidate indicators to characterize beef carcasses. An exhaustive list was used to identify eighty-nine candidate indicators that were organized according to a hierarchical structure to identify the elements underlying the characterization of a carcass. These elements were the animal, carcass and tissue characteristics and the technological and economic values. Indicators were selected based on the hierarchical structure according to their citation ranking in the literature and by ensuring that they were not redundant to the EUROP system. In addition, an expert appraisal was performed to ensure their relevance and feasibility in the European context. Finally, a set of 5 indicators was proposed: hindquarter weight, meat colour, retail-cut yield, rib-eye area and marbling score. Three of these (‘meat colour’, ‘rib-eye area’ and ‘marbling score’) are already used in several current classification grids and may thus be fully implementable. The other two can be obtained by measurement or estimation. This set of indicators is the first step in developing a new way to assess the overall quality of beef carcasses in Europe.

The Cancer Care Treatment Outcomes Ontology (CCTO): A computable ontology for profiling treatment outcomes of patients with solid tumors.

e18137 Background: Systematic enhancement of knowledge about outcomes of cancer therapy is a central goal for oncology research, practice and audit. However, there is no resource standardizing the disparate vocabulary used to describe treatment outcomes, which prevents translating the data acquired into value-adding information for better cancer care. Methods: To build an application ontology that organizes high-level concepts describing treatment outcomes in solid tumors, provisionally named Cancer Care Treatment Outcomes (CCTO), we extracted all trial endpoints listed in ClinicalTrials.gov, queried it using the keyword ‘cancer’, followed by an expert appraisal. Term definitions and synonyms were automatically imported from the National Cancer Institute thesaurus, and extra terms were imported from Common Toxicity Criteria for Adverse Events. Logical relationships between concepts were represented by forward chaining rules, aiding conversion between concepts. The coverage of CCTO was tested against MEDLINE abstracts, and the applicability of 1825 rules was tested in a case of metastatic colon cancer (index case). Results: After removing duplicated terms from 54705 trial entries, an ontology (CCTO), holding 1145 terms and organized into 13 concept groups (including but not limited to efficacy, safety, and quality of life), was built. CCTO not only captures a comprehensive taxonomic hierarchy (through is_a relationships) but also an evaluative hierarchy ( is_assessed_by) to aid the acquisition of treatment outcome data. At least one CCTO term was mentioned in 29493 of 29951 (98%) MEDLINE abstracts on phase 1-3 cancer trials; concepts about efficacy were mentioned in 7208 (79%) phase 1, 15051 (92%) phase 2, and 3884 (86%) phase 3 trials. We show that, by applying the relationship rules in an expert system shell, the event sequence of the index case can be readily converted into a comprehensive profile that incorporates survival measures, treatment responses, and adverse events. Conclusions: CCTO efficiently captures and categorizes high-level concepts of treatment endpoints in oncologic practice and enables rapid profiling of clinical outcomes for cancer patients.

Согласование экспертных оценок при диагностике текущего технического состояния высоковольтного электрооборудования

Согласование экспертных оценок при диагностике текущего технического состояния высоковольтного электрооборудования