Peer Review Method Research Articles

Peer review declaration

All papers published in this volume of Journal of Physics: Conference Series have been peer reviewed through processes administered by the Editors. Reviews were conducted by expert referees to the professional and scientific standards expected of a proceedings journal published by IOP Publishing. • Type of peer review: Double-blind • Conference submission management system: CMT • Number of submissions received: 84 • Number of submissions sent for review: 71 • Number of submissions accepted: 39 • Acceptance Rate (Number of Submissions Accepted / Number of Submissions Received X 100): 55% • Average number of reviews per paper: 2 • Total number of reviewers involved: 27 • Any additional info on review process: Each paper was peer-reviewed by 2 reviewers. The conference took double-blind peer review method. Only papers meet the requires below will be considered for accepting. If the paper needs revising, it should be resubmitted for peer review again. Manuscript requirements: 1. Manuscripts must be written in English, in accordance with the standard of template; 2. The topics of paper should be relevant to conference topics; 3. Plagiarism and duplicate submission are prohibited; 4. Innovation and scientific value is a must. • Contact person for queries: Yury Yu (yury@apise.org)

Toward assessing clinical trial publications for reporting transparency

ObjectiveTo annotate a corpus of randomized controlled trial (RCT) publications with the checklist items of CONSORT reporting guidelines and using the corpus to develop text mining methods for RCT appraisal. MethodsWe annotated a corpus of 50 RCT articles at the sentence level using 37 fine-grained CONSORT checklist items. A subset (31 articles) was double-annotated and adjudicated, while 19 were annotated by a single annotator and reconciled by another. We calculated inter-annotator agreement at the article and section level using MASI (Measuring Agreement on Set-Valued Items) and at the CONSORT item level using Krippendorff’s α. We experimented with two rule-based methods (phrase-based and section header-based) and two supervised learning approaches (support vector machine and BioBERT-based neural network classifiers), for recognizing 17 methodology-related items in the RCT Methods sections. ResultsWe created CONSORT-TM consisting of 10,709 sentences, 4,845 (45%) of which were annotated with 5,246 labels. A median of 28 CONSORT items (out of possible 37) were annotated per article. Agreement was moderate at the article and section levels (average MASI: 0.60 and 0.64, respectively). Agreement varied considerably among individual checklist items (Krippendorff’s α= 0.06–0.96). The model based on BioBERT performed best overall for recognizing methodology-related items (micro-precision: 0.82, micro-recall: 0.63, micro-F1: 0.71). Combining models using majority vote and label aggregation further improved precision and recall, respectively. ConclusionOur annotated corpus, CONSORT-TM, contains more fine-grained information than earlier RCT corpora. Low frequency of some CONSORT items made it difficult to train effective text mining models to recognize them. For the items commonly reported, CONSORT-TM can serve as a testbed for text mining methods that assess RCT transparency, rigor, and reliability, and support methods for peer review and authoring assistance. Minor modifications to the annotation scheme and a larger corpus could facilitate improved text mining models. CONSORT-TM is publicly available at https://github.com/kilicogluh/CONSORT-TM.

Awareness of Source of Radiation, Its Hazards and Protection among Final Year MBBS Students: A Cross-sectional Observational Study

Introduction: Increase availability of multi-detector high speed CT scan, digital radiography and various image guided interventional procedures has increased the total number of radiation related examinations in current era. These have lead to increase radiation exposure to patients as well as the radiologist. This situation has raised the concern about the potential side effects to patients, like radiation-related cancer and death. Aim: Evaluation of awareness of source of radiation, radiation hazards and radiation protection among final year medical students in Tertiary Care Medical College Hospital. Materials and Methods: This was a cross-sectional observational type of study in which total 136 final MBBS students were issued a questionnaire consisting of 12 multiple choice questions including demographic data, awareness about source of radiation, radiation hazard, protection issues and knowledge about radiation dose levels of common radiological examinations. All questions were multiple choice types with answers containing 2 to 9 choices having only one correct answer. The questionnaire was prepared by authors and their answers were validated by various faculties of Department of Radiodiagnosis by peer review methods. This questionnaire was given in a physical form. The obtained data were analysed using statistical software (descriptive statistics used). As homogenous group of final year medical students were analysed, no scoring and no statistical test were needed. Results: In present study 87.5 % (n=119) of students considered radiation knowledge important for them. Out of eight specific questions for checking their knowledge about radiation awareness, five questions were regarding safe radiation practice, radiation exposure, and radiation dose in common and radiological examination. Among these questions “Rule of 10”- question was correctly answered by 113 (83.1%) of students. Questions regarding “Radiological examination of pregnant patient”- was correctly answered by 114 (83.8 %) of students and “Radiation exposure to patients during diagnostic radiology” question was correctly answered by 115 (84.6%) of students. Conclusion: Medical students have good awareness about radiation protection, with a specific gap of knowledge concerning source of radiation, biological effect of radiation and radiation hazards. Undergraduate teaching curriculum must include comprehensive knowledge about radiation hazards and radiation safety.

The challenges of peer-review process

The peer-review method is an important pillar for publication. Peer review is designed to measure the validity, quality, and often the authentication of articles for publication. The purpose of peer review is to improve the quality of manuscripts and to identify suitable manuscripts for the journal. However, this process has many challenges too. Therefore, I aim to discuss different challenges of the peer review process through analyzing secondary data.

Editorial

The scientific journal Nordisk Politiforskning or the Nordic Journal of Studies in Policing (NJSP) will soon reach seven years of publishing activity. Many traditional scientific journals have been publishing for hundreds of years and the peer review method became more common during the 20th century. Although the journal is still fresh, it has managed to develop its own profile in the Nordic context.

University Transformation Model: Theory and Practice

This article considers the identification of the VUCA-world influence as a modern reality on the transformation of University on the example of Norilsk State Industrial Institute, its internal development space. The research relies on various methods: case-method, foresight, design method, depth interviews with the most important stakeholders, theoretical and empirical methods, logical and system analysis, methods of description, forecast and peer review. The theoretical basis of the study is the methodology within the VUCA-Prime strategy. The way to build the inner space of University development starts with the definition of reference points and development of university transformation mechanisms in conditions of VUCA world, which is a significant context of modern reality. This reality is characterized by volatility, uncertainty, complexity, ambiguity. The authors present a model that has the potential to reduce uncertainty and transform qualitatively the inner space of the University.

Digital teacher competencies and their indicators

The implementation of the national program “Digital Economy of the Russian Federation”, the use of distance technologies in the educational process require teachers to have digital competencies. At the moment in the Russian Federation, there are no formulations of digital competencies of a teacher. Although different models of digital competencies and skills have been created, they are rather complementary to each other. An organization can integrate a ready-made model, but it may not fully meet all the characteristics of the organization, its architecture and internal structure. In Russia, in the field of education, the formulation of digital competencies is spontaneous. In Russian science, digital competence refers to the use of digital technologies in professional activities, training, and social communications. Digital competencies are skills for effectively solving problems of a professional, social, personal nature using various types of information and communication technologies. Using the Delphi peer review method, the authors developed the teachers digital competencies and their indicators. The value of the results obtained lies in the fact that when conducting competitive procedures for filling vacant teacher positions, it is possible to assess the level of formation of digital competencies.

Improving accounting student writing skills using writing circles

An ongoing debate exists as to whether writing should be taught in accounting classes. We took on this challenge and found accounting student writing can be improved without overburdening faculty members, requiring very little class time. This article proposes using a peer review method, called writing circles (WCs), that takes 15 min to teach and can improve the quality of student writing. WCs require three or four individuals to meet regularly to give each other feedback on writing projects using a prescribed methodology that evaluates key sentences. Given the call to improve accounting students’ writing skills, we tested WCs in our classes, collecting empirical evidence to measure its effectiveness in three studies. After attending WCs, we found student writing improved allowing us to concentrate on grading content instead of grading writing. We administered the WCs in four different accounting classes at three different universities – two accounting information systems (AIS) classes, a tax class, and an advanced accounting class. At University A, we compared the writing between students in WCs and those tutored at the university learning center (LC) and found comparable results except for students going to WCs scored higher in grammar. At University B, we found that WCs helped students improve the writing of their one-page tax research memos, mainly in focus and style. Surprisingly, a methodology designed to improve writing also sparked classroom debates about solutions, which helped students write richer solutions through socially constructed knowledge. At University C, we found that WCs again helped students better organize and focus their papers. As a result of our studies, we believe WCs can move a number of students along the writing continuum to better writing. At all the universities, students expressed above-average satisfaction with their overall writing experience, except for a few students with advanced writing skills who preferred the help of writing tutors. Finally, we provide step-by-step instructions and rubrics so you can adopt WCs for your classes.

Peer review of third trimester abdominal circumference measurements.

Third trimester growth scans represent a significant proportion of the workload in obstetric ultrasound departments. The objective of these serial growth scans is to improve the antenatal detection of babies with fetal growth restriction. The aim of this paper is to describe a method of peer review for third trimester abdominal circumference measurements which is realistic within busy obstetric ultrasound departments in the UK. Twenty-two, third trimester, measured abdominal circumference images were randomly selected. Images were assessed subjectively by 12 sonographers using the image Criteria Achieved Score. For quantitative assessment, termed the Inter-operator Variability Score, three of the abdominal circumference (AC) images were blindly remeasured. Following this, a questionnaire was used to ascertain which image criteria sonographers considered most important and to reach an agreement on correct caliper placement. The least frequently met image criteria with the lowest Criteria Achieved Score related to an oblique abdominal circumference section. These included fetal kidney present (Criteria Achieved Score 24.6%), multiple oblique ribs (Criteria Achieved Score 39.4%) and oblique spine (Criteria Achieved Score 37.5%). Caliper placement was also identified as inconsistent. This study demonstrates that the perfect AC section is not always possible and sonographers use their professional judgement to determine whether an image is acceptable. Seventy-three percent of the images reviewed were of an acceptable standard. There can be inconsistencies in sonographer opinion regarding what is an acceptable third trimester abdominal circumference image. These differences need to be addressed to maximise the effectiveness of the third trimester ultrasound examination. Peer review can be used to monitor scan quality and identify areas of inconsistency.

Data journals: types of peer review, review criteria, and editorial committee members’ positions

Purpose: This study analyzed the peer review systems, criteria, and editorial committee structures of data journals, aiming to determine the current state of data peer review and to offer suggestions.Methods: We analyzed peer review systems and criteria for peer review in nine data journals indexed by Web of Science, as well as the positions of the editorial committee members of the journals. Each data journal’s website was initially surveyed, and the editors-in-chief were queried via email about any information not found on the websites. The peer review criteria of the journals were analyzed in terms of data quality, metadata quality, and general quality.Results: Seven of the nine data journals adopted single-blind and open review peer review methods. The remaining two implemented modified models, such as interactive and community review. In the peer review criteria, there was a shared emphasis on the appropriateness of data production methodology and detailed descriptions. The editorial committees of the journals tended to have subject editors or subject advisory boards, while a few journals included positions with the responsibility of evaluating the technical quality of data.Conclusion: Creating a community of subject experts and securing various editorial positions for peer review are necessary for data journals to achieve data quality assurance and to promote reuse. New practices will emerge in terms of data peer review models, criteria, and editorial positions, and further research needs to be conducted.

ОРГАНІЗАЦІЙНО-ПЕДАГОГІЧНІ УМОВИ УДОСКОНАЛЕННЯ СИСТЕМИ ПРОФЕСІЙНОЇ ПІДГОТОВКИ МАЙБУТНІХ МАГІСТРІВ ПОЧАТКОВОЇ ОСВІТИ ДО ІННОВАЦІЙНОЇ ДІЯЛЬНОСТІ

У статті узагальнено різні наукові підходи до розуміння сутності понять «професійна підготовка», «професійна готовність до інноваційної діяльності», «умова», «організаційно-педагогічні умови». Обґрунтовано організаційно-педагогічні умови удосконалення системи професійної підготовки майбутніх магістрів початкової освіти до інноваційної діяльності.

Development of Evaluation System for Iranian Health Research Networks: Challenges and Lessons Learned

Health research networks (HRNs) are critical components of large-scale systems of production and validation of scientific evidence. As evaluation of research systems is a reliable process to measure efficiency and effectiveness of their activities, we aimed to report the processes of development of evaluation indicators' for Iranian health research networks and the results of conducted assessment. In 2017, for the first time, aim to develop the evaluation framework for national HRNs, following the qualitative approach to assess the quality of research we designed the peer review method as one of the most important tools. This qualitative method was conducted according to experts' views in specific fields. Key policy makers and stakeholders collaboratively developed a number of criteria for evaluation of research performance of Iranian HRNs. Following the review of conducted studies, benefitting from published guide line, these indicators were defined under 4 main axes of governance and leadership; infrastructures; research products and research impact. Based on requirements of developed protocol for evaluation of HRNs in Iran, 18 HRNs completed the processes of evaluation. Results show a progressive need for more attention to precise planning of HRNs for achieving to goals. Another point to consider is the attention to documenting processes. The observational system for researches for detection of latest research priority was the most important issues that need to be more addressed by all of networks. Research evaluation of Iranian HRNs more over creating of constructive positive competition provide an overview of the shortcomings and research challenges could be used for better planning and promotion of the health research system.

INDEXING – A BIRDS EYE VIEW

Indexing is a quality determining factor. The concept is almost similar to registering, recording, etc. Indexing in a general context is a process to create indexes for record collection, which allows the researchers to search for the records of specific individuals. The main purpose of indexing is discovering the truth by building on previous discoveries, which enables the growth of faster learning, acknowledgement, interconnections and reputations of people involved in this. This article tries to create an understanding about indexing, its history, the types of indexing, the parameters involved and also discusses about the peer review method.

Reviewer Blinding in Peer Review

Reviewer Blinding in Peer Review

Experience in Teaching Mathematical Disciplines Using E-learning and Distance Learning Technologies during the COVID-19 Pandemic

The experience of e-learning (EL) with distance learning technologies (DLT) implementing for teaching of Numerical in the Mathematics and Computer Science department of V.I. Vernadsky Crimean Federal University during COVID-19 pandemic period from March to May 2020 is studied in the article. 107 students from third course that learn in the direction of 01.03.01 Mathematics, 01.03.02 Applied Mathematics and Computer science, 01.03.04 Applied Mathematics are participated in the experiment. As the main platform, the social network VKontakte (VK) with Discord, Youtube and HP Reveal platforms are used. The author's video lecture is the main type of educational content in the developed e-learning model. The students feedback is realized through discussion in the text and voice chats, video presentations of programming code for numerical methods realization, the tasks results demonstration in hand-written form (photo of problems decision) or in print format, in screenshots or video explanations including elements of the augmented reality technologies. The effectiveness of the developed methodological approach is confirmed by the results of students questionnaires (81,7% of the students that participate in the anonymous questionnaire estimate the quality of the numerical methods teaching as excellent) and the academic performance growth based on the tests results using the peer review method (the growth of the academic performance on average is 32,2%). It is confirmed that for e-learning organizing for mathematical disciplines teaching in the educational process planning, training contents and tests preparing the teachers need to use the interactive learning and multimodality principles, as well as web accessibility requirements. The best method of new learning content presentation is the author's screencast video lecture (the choice of 83,7% students) accompanied with subtitles and detailed explanations of the lecturer (audio descriptions) and text analogue (the lecture notes or verbatim report). The new e-learning model can be transferred to the MOOC format without significant logical changes or time costs.

Preface

International Conference on Advances in Energy Industry and Power Generation AdvEnGen-2020 The International Conference on Advances in Energy Industry and Power Generation was held in Almetyevsk, Republic of Tatarstan, Russian Federation on 12-14 February 2020. Almetyevsk State Oil Institute participated as an initiator and an organizer of the event.The three days’ conference was attended by several delegations from leading Russian petroleum engineering and power engineering institutions: Ufa State Petroleum Technological University (Ufa, Republic of Bashkortostan), Gubkin Russian State University of Oil and Gas (Moscow), Kazan State Power Engineering University (Kazan, Republic of Tatarstan). Attendees from several oil and electrical companies took part in the discussion as well: Belorusneft (Rechitsa, Republic of Belarus), Tatneft (Almetyevsk, Republic of Tatarstan), Tatenergo (Kazan, Republic of Tatarstan). Also seven individual guest researchers from Russia and Vietnam participated in the sessions.More than fifty studies related to the following topics were reported at the conference• Electrical machinery and drilling equipment,• Automation for oil and gas engineering,• Engineering mathematics application,• Power generation and distribution.All the received manuscripts were reviewed by an editor and invited referees to qualify the most significant ones for publication. The single-blind peer-review method was applied.We express our appreciation and deep gratitude to all the participants and the organizing committee for their contribution to preparing the AdvEnGen 2020 proceedings. With the best regards, Editor, prof. Akhmetsalim S. Galeev, Almetyevsk State Oil Institute

The Learning Method of Peer Review in College English Writing Course

Peer review is an important teaching method of writing. College English has a large vocabulary, complex situations and high degree of specialization, which are difficult points in teaching. Through peer review, students can benefit a lot, such as enhancing interest in college English reading and writing through the exchange of reading and evaluation, enhancing initiative in writing and improving their abilities to identify errors and appreciate English articles. In this paper, the applications of the learning method of peer review in college English teaching were investigated, and it was found that teacher’s behavior, time arrangement and student’s behavior were all particularly important and needed to be arranged in a scientific way. On the other hand, a student-oriented teaching model of “trinity” was also presented, which covered three target elements: ability, knowledge and education. In this paper, a fuzzy comprehensive evaluation method was used to evaluate the learning outcomes of peer review, and an evaluation indicator system for students’ learning ability and the weights thereof were established. According to the actual situation of the evaluated objects, four evaluation grades were selected, that is, excellent, good, fair and poor. Our teaching experiment showed that through this learning model, students have improved their English writing ability and reading comprehension ability to a certain degree, as well as their self-learning ability, which is beneficial to the consolidation of their learning effect.

Knowledge economy in a self-learning organization

Introduction. Changing the priorities of forming the development strategy of modern business is to some extent related to the development of the knowledge economy based on the optimal combination of existing knowledge and the development of new one. The competitiveness of the organization in the market largely depends on the level of efficiency of investing in knowledge. At the same time, insufficient attention is paid to knowledge management issues in Ukrainian organizations, which enhances the relevance of the chosen topic. Given this, the purpose of the article is to generalize approaches to the formation and development of a knowledge economy to provide opportunities for realizing the values оf a self-learning organization.Methods. To achieve this goal and perform certain tasks, modern research methods are used, in particular: historical and logical analysis − to reveal the process of formation and development of the knowledge economy; system analysis − to determine the essence of the basic categories; analysis and synthesis − to study the existing system of knowledge economy; peer review and index method − to evaluate the model of a self-learning organization. Results. The provisions and conclusions of the article are related to an important scientific and practical problem bound to the development of a system of measures aimed at developing the organization’s ability to develop the competencies of its employees, the ability to timely produce, accumulate and efficiently apply new knowledge of employees in the process of manufacturing an innovative product. It is proved that in the conditions of the knowledge economy, the study of the processes of creation and development of knowledge, due to which the organization receives a significant competitive advantage in the market, is relevant. The problems that inhibit the development of the knowledge economy in Ukraine are identified and ways to solve them are outlined. The results of a sociological study conducted among «MagneticOne» employees are presented and analyzed to assess the availability and prospects of expanding innovative forms and methods of knowledge management in domestic IT companies. Based on this, recommendations were made on the frequency of educational events at IT companies, which contribute to the self-development of employees and the improvement of the effective construction of internal communications. It is established that new knowledge is the intellectual basis of the management and functioning of the organization, the most important component of the formation of intellectual capital. Knowledge is the result of the creative work of people, with the help of which the company forms its values аnd develops. Prospects. Considering the relevance of this topic and the existing scientific achievements, it is advisable to deepen research in the field of society’s transition to a knowledge economy, increase the innovative activity of a self-learning organization.

A benchmark assessment of ecosystem health indicator species groups at Bali Barat National Park

Bali Barat National Park was assessed for its suitability to receive RFS Protected Area CreditsTM. Part of the requirement is to select indicator groups from among 5 terrestrial taxa, within the eligible forest in the park boundaries, (1) insects - butterflies, (2) amphibian, (3) reptiles, (4) birds, and (5) mammals that can serve as r indicators for the overall ecosystem health of the TNBB. To select indicator groups, a biodiversity survey was conducted for during August-September 2015 in 3 study sites within Bali Barat National Park, Lebak Buah, Megatransect, and Brumbun. Different taxa were surveyed using peer-reviewed methods. The best indicator species within each taxa group (plants, butterflies, herpetofauna, birds and mammals) were defined based on their abundance and distribution in the eligible forest of the project area using Indicator Value method. Potential animal and plant indicator species were then assessed empirically for their cost-effectiveness based on survey effort and cost during the initial survey. Then they were evaluated for generality, functional importance, available scientific knowledge, and cross-taxon representation. Our results suggested that birds would be the best indicator species group, followed by butterflies, and plants. Such indicator is important surrogate for ecosystem health which can be used for conservation management priorities within protected area.

Forty-One Million RADPEER Reviews Later: What We Have Learned and Are Still Learning.

ACR RADPEER® is the leading method of radiologic peer review in the United States. The program has evolved since its inception in 2002 and was most recently updated in 2016. In 2018, a survey was sent to RADPEER participants to gauge the current state of the program and explore opportunities for continued improvement. A total of 26 questions were included, and more than 300 practices responded. In this report, the ACR RADPEER Committee authors summarize the survey results and discuss opportunities for future iterations of the RADPEER program.