Multimedia Information Systems Research Articles

Research on the Application of Multimedia Image Processing Technology in Sports Sociology Education

In order to cope with sports events, it is difficult for cameras to accurately extract exciting moments during the competition. This article constructs a multimedia information system for sports sociology education. In terms of methodology, low-density architectures are used to measure and encode sparse signals, and the signal is reconstructed at the receiving end. By calculating the marginal probability distribution of each variable node, the reconstructed image is obtained. The experimental results show that this method performs well in detecting lens mutations and gradients, with a higher recall rate than other algorithms. The accuracy, recall rate, and F-value indicators have significantly improved, reaching 6.328%, 4.27%, and 6.012%, respectively. This method is superior to existing game shot extraction methods and lays the foundation for further detecting exciting events in sports competitions. In summary, this study has important guiding significance for the application of multimedia image processing technology in the field of sports sociology education.

TYPOLOGY OF METHODS OF MARKING ARCHITECTURAL AND URBAN PLANNING HERITAGE

The article deals with the problem of presenting objects of architectural and urban planning heritage in the modern environment. Most of such objects are unknown to society, not researched, their state of preservation is critical or they are only partially preserved, but at the same time, the value and uniqueness of such objects are the property of the entire nation. Therefore, it is necessary to carry out measures to preserve and protect valuable historical architectural and town-planning complexes, as well as to identify them with the help of a set of measures developed individually for each object. The article develops a typology of methods of identification of architectural and urban planning heritage. Among the options for identification methods: planar and three-dimensional tracings, information signs-symbols, exposure of ground and underground fragments of the object, model three-dimensional compositions, interactive and multimedia infoboxes, information and navigation systems, 3D reconstructions of lost objects, etc. In the process of finding and developing options for identification of Ukrainian heritage, options for identification of partially and completely lost valuable historical ensembles and complexes in the world were researched and analyzed.

PEMANFAATAN SISTEM INFORMASI MULTIMEDIA GUNA MENINGKATKAN PEREKONOMIAN MASYARAKAT

Graphic design is an activity that aims to produce usable and aesthetic work for various types of media including multimedia information systems and the delivery process not only in text form, but also using various other visual forms. The development of graphic design is increasingly significant, this can be seen from the various designs on the market. The presence of a graphic design information system can be used to start community economic activities and ultimately improve the community's economy. However, the use of graphic design among the general public is still low, so this research aims to convey knowledge and benefits of graphic design in general and to improve the community's economy in particular.

Criterion-based Heterogeneous Collaborative Filtering for Multi-behavior Implicit Recommendation

Recent years have witnessed the explosive growth of interaction behaviors in multimedia information systems, where multi-behavior recommender systems have received increasing attention by leveraging data from various auxiliary behaviors such as tip and collect. Among various multi-behavior recommendation methods, non-sampling methods have shown superiority over negative sampling methods. However, two observations are usually ignored in existing state-of-the-art non-sampling methods based on binary regression: (1) users have different preference strengths for different items, so they cannot be measured simply by binary implicit data; (2) the dependency across multiple behaviors varies for different users and items. To tackle the above issue, we propose a novel non-sampling learning framework named C riterion-guided H eterogeneous C ollaborative F iltering (CHCF). CHCF introduces both upper and lower thresholds to indicate selection criteria, which will guide user preference learning. Besides, CHCF integrates criterion learning and user preference learning into a unified framework, which can be trained jointly for the interaction prediction of the target behavior. We further theoretically demonstrate that the optimization of Collaborative Metric Learning can be approximately achieved by the CHCF learning framework in a non-sampling form effectively. Extensive experiments on three real-world datasets show the effectiveness of CHCF in heterogeneous scenarios.

Developing Digital Competence of Future Teachers in the Modern Digital Learning Space

The article is devoted to the problem of formation of future teachers’ digital competence in the modern learning space. The purpose of the article is to determine the essence and content of a teacher’s digital competence on the basis of scientific literature analysis, to analyze the possibilities of formation of digital competence of students of pedagogical specialties in the modern learning space.
 The purpose realization involves the following tasks: to define and compare different definitions of the term “digital competence” by scientists; to reveal the essence and content of future teachers’ digital competence; to identify and characterize the ways, methods, forms, and means of formation of digital competence among the students of pedagogical specialties.
 Methodology. To achieve the purpose a complex of theoretical and empirical research methods was used. The theoretical methods included: analysis, comparison, generalization, systematization of scientific works and regulatory documents to determine the key concepts of the research and clarify the authors’ point of view regarding the essence of a teacher’s digital competence. In addition to the specified theoretical methods, empirical methods of scientific knowledge were used: the study of future teachers’ professional training, questionnaires, interviews with those who received pedagogical education, expert evaluation – in order to study the process of future teachers’ digital competence formation.
 Results. The analysis of international legal documents and scientific works of various scientists proves that the concept of “digital competence” is interpreted ambiguously. In particular, the first European framework of teachers’ digital competence states that digital competence is a specialist’s personal formation that integrates the following components: professional involvement, working with digital resources, teaching and learning with the use of these resources, evaluation of results, expansion of students’ opportunities, the development of digital competence in subjects of education. The formation of digital competence of students of pedagogical specialties is provided in various ways: teaching special courses, involving future teachers in educational activities based on the use of various digital tools, organizing students’ work with digital textbooks, reference sources and multimedia information systems, electronic simulators, digital laboratory tools, encouraging specialists to receive non-formal education.
 Conclusions. In the article, a future teacher’s digital competence is understood as a personal formation that integrates relevant motives, values, attitudes, knowledge of various digital resources, means, tools, technologies, as well as the ability to apply them in practical pedagogical activities on the basis of critical analysis and evaluation. The formation of future teachers’ digital competence involves a systematic combination of various methods and forms of education, constant rethinking of approaches to the organization and content of this process, ensuring an organic combination of methods of formal, non-formal and informal education.

Development and deployment of Computer-aided Real-Time feedback for improving quality of colonoscopy in a Multi-Center clinical trial

Background and ObjectiveThe quality of colonoscopy has been a subject of interest in the gastroenterology community for over two decades. High-quality colonoscopy leads to high polyp detection rates, reducing mortality associated with colorectal cancer. Methods: This paper describes the development and deployment of Endoscopic Multimedia Information System (EMIS), computer-aided software that provides real-time feedback on colonoscopy quality such as the endoscopist’s techniques in inspecting the colon. On the contrary, most other software in this field aims to recognize polyps. The deployed version of EMIS includes new analysis components using Convolutional Neural Networks and new types of visual feedback. EMIS gives feedback only when an important change in the quality of the examination occurs. We present first-hand technical and operational challenges faced during our three-center trial and current solutions. Results: This work provides valuable information for others attempting to implement real-time feedback in routine colonoscopy screening.

Образы культурного ландшафта утраченного Златоустова монастыря в центре Москвы для отражения в атласной информационной системе

Zlatoust Monastery is a lost cultural heritage monument of regional significance, which received the status of a sightseeing place from the Moscow Department of Cultural Heritage in 2019. It existed in the center of Moscow, in the White City, since the 14th cent. until 1918, when the monastery was closed; all its buildings were demolished by 1936, and a residential complex was built on the site of the monastery. All that remains of the architectural ensemble of the monastery is a two-story building built in 1862, fragments of walls and a decorative fence turret, which is in poor condition. On the territory of the monastery, historical research and archaeological work are carried out in the cultural layer, reaching in some places up to 4–5 m. Zlatoust Monastery is depicted on ancient maps of various times, scales, projections, content and methods of depiction. This cartographic information, as well as existing experience in reconstructing the cultural landscape in artistic, photographic and video formats, is considered. The presence of a large amount of information of various types (maps, infographics, photos, videos, works of art) requires the development of methods for their coordination, processing and storage in a multimedia atlas information system (MAIS), the main part of which are maps. In the process of research, a map of the cultural landscape for the modern period was compiled, showing preserved, lost and hidden natural and anthropogenic elements. The legend and methods of depiction with artistic signs are developed on the basis of previous studies, maps and architectural drawings reflecting real images of lost temples. The experience is interesting for studying the “historical background” of the modern cultural landscape. An idea of the main natural and anthropogenic elements of the cultural landscape of the landmark site (architectural, hydrological, plant, etc.) was obtained and systematized. Further development of the topic is seen in the creation of a series of maps of the cultural landscape of the Zlatoust Monastery for different historical periods, as well as the interaction of the monastery with the surrounding areas.

Retraction Note: Scene art design based on human-computer interaction and multimedia information system: an interactive perspective

Retraction Note: Scene art design based on human-computer interaction and multimedia information system: an interactive perspective

Design and Implementation of Interactive Platform for Operation and Maintenance of Multimedia Information System Based on Artificial Intelligence and Big Data.

In order to cope with the challenges that operators face after the impact of diversified social channels in the field of interactive services, we actively build a new generation of intelligent interactive systems based on artificial intelligence technology, a semantic understanding, and intention recognition, covering rich media content, omnichannel coverage, high-frequency knowledge updates, consistent service response, high-quality, and low-cost intelligent interactive solutions is proposed. The solution provides overall business modeling for scenario design and a scenario-based knowledge expression system, with the function of fragmented knowledge processing. With complete text and voice information, combined with pictures, text, audio, video, and other multimedia, we intelligently interact with users, allowing users to obtain required information and solve problems in a pleasant and relaxing interaction. Therefore, the research and exploration of the intelligent interactive system architecture based on artificial intelligence is a useful practice and strong support for operators to redefine the connotation and elements of “smart service” in the process of building “smart operation.” Through repeated tests, it can be seen that the language similarity has reached 0.75549, which is very close to 1.0000. It can be seen that the design of this platform has been successful.

Living Actively with Cancer - Recommendations for a Healthy Life Style: Needs Assessment and Design of Multimedia Patient Information

The positive effects of a healthy lifestyle on the holistic physical condition and quality of life of cancer survivors is scientifically proven. The National Comprehensive Cancer Network (NCCN) Guidelines for Survivorship specifically highlight the need for support in these areas. The lack of specialised offers for cancer patients in predominantly rural areas, however, represents a high level of assistance needed in terms of the development and implementation of a healthy lifestyle. Following a needs assessment, our aim was to conceptualise and design an easily accessible multi-media patient information system on the basis of a social-cognitive process model on health behaviour (Health Action Process Approach - HAPA). A higher level of health literacy represents, inter alia, the basis for informed choice and, as such, forms an important resource for the aftercare of cancer patients. Further studies are recommended on the acceptance, use and effects of patient information with regard to intended longer-term changes of health behaviour.

News Video Classification Model Based on ResNet-2 and Transfer Learning

A large amount of useful information is included in the news video, and how to classify the news video information has become an important research topic in the field of multimedia technology. News videos are enormously informative, and employing manual classification methods is too time-consuming and vulnerable to subjective judgment. Therefore, developing an automated news video analysis and retrieval method becomes one of the most important research contents in the current multimedia information system. Therefore, this paper proposes a news video classification model based on ResNet-2 and transfer learning. First, a model-based transfer method was adopted to transfer the commonality knowledge of the pretrained model of the Inception-ResNet-v2 network on ImageNet, and a news video classification model was constructed. Then, a momentum update rule is introduced on the basis of the Adam algorithm, and an improved gradient descent method is proposed in order to obtain an optimal solution of the local minima of the function in the learning process. The experimental results show that the improved Adam algorithm can iteratively update the network weights through the adaptive learning rate to reach the fastest convergence. Compared with other convolutional neural network models, the modified Inception-ResNet-v2 network model achieves 91.47% classification accuracy for common news video datasets.

Coursevo: A Multimedia Online Learning Platform to Support Onlife Communities and its Extension with Gamification Facilities

Coursevo (http://coursevo.com/) is a multilingual multimedia information system for managing courses, supporting learning processes and learning communities through the Web. Its multi-tenant architecture supports multiple instances of the underlying server infrastructure using the same core to serve the needs of multiple communities. An advantage of Coursevo in comparison with other eLearning systems is the emphasis that is given in the use of multimedia as a powerful learning means. Learning activities using multiple media can be more effective than doing it through a single medium (such as text), but what is important is combining media effectively. Coursevo is used in several vocational training and life-long-learning initiatives to establish and continuously support Onlife Communities. An Onlife Community is an aggregation that emerges in hyperconnected spaces when humans engage with other humans as well as with machines and natural entities in mindful interactions with sufficient human feeling to form webs of personal relationships. The paper presents how Coursevo is extended with gamification facilities to enable game-based learning scenarios within the context of the GAME IT project and beyond.

DIRECTIONS AND FEATURES OF USING INFORMATION EDUCATIONAL TECHNOLOGIES IN THE PROCESS OF PROFESSIONAL FINE ARTS TEACHER TRAINING

This article exposes the theoretical and methodological aspects of the problem of using information educational technologies (IET) in the process of professional future fine arts teacher training. According to the results of pedagogical experience, it was presented the main directions and features of the use of IET in the educational process of applicants for the specialty ‘Secondary Education (Fine Arts)’ at Poltava V. G. Korolenko National Pedagogical University.
 It was opened the possibilities and advantages of the information and communication components involvement in educational and methodical maintenance of educational components of artistic direction.
 The types of specially designed information and educational resources are presented, such as hypertext electronic textbooks and manuals, multimedia manuals, reference and information systems, training programs for knowledge consolidation, control programs. The peculiarities of the use of audiovisual means (educational software and pedagogical tools and films, documentaries), licensed software, and pedagogical tools developed by companies-representatives of foreign multimedia publishing houses and Ukrainian electronic publishing houses are highlighted. It is taken into account that the involvement of IET can occur only at certain stages of the educational process organization for certain disciplines, which in their specificity are practical courses.
 The expediency of introducing into the process of future fine arts teacher training disciplines aimed at mastering the capabilities of computer graphics programs and artistic and aesthetic development of virtual reality technologies is substantiated. These are the educational components ‘Computer Design of Art Products,’ ‘Computer Design of Decorative Products,’ ‘Virtual Art Space.’ The purpose and results of educational activity in such disciplines are covered; attention is focused on the specifics of their content. Approximate topics of practical tasks are given.
 It was determined that for the formation of a positive attitude to IET in achieving professional success, future professionals in the learning process are faced with the task of active use, as well as the creation of their IET.
 It was established the positive dynamics in the organization of the educational process of future fine arts teachers in the areas of use of IET presented in the article.

Robust Lightweight Privacy-Preserving and Session Scheme Interrogation for Fog Computing Systems

Session Initiation Protocol (SIP) is a communication protocol of multimedia systems providing IP signaling to initiate instant messaging. The rapid growth of wireless communication has gained momentum for the development of value-added services such as voice, data, and video ubiquitously. Continuous development has emerged in various application domains such as healthcare, surveillance, and automation that integrate the sources of multimedia to support real-time analysis. In mHealth, it has a dedicated multimedia information system (MIS) to support diagnosis, treatment, medicare, and report preparation. It may enable the user to collect the diagnostic information over smart devices. On the other hand, it may eliminate the geographical restriction between users and medical experts to manage medical emergencies. It uses a packet-switched network to cooperate with the wireless infrastructure to provide a standard interface that serves as a data transmission network. However, the communication interface such as real-time transport protocol is still challenging to authenticate the network services, key exchanges, and session blockage in the multimedia systems. Thus, this paper proposes a technique of session scheme interrogation (SSI) and robust lightweight privacy-preserving (RLPP) to resolve the major issues of LTE-A networks. In this paper, the session adaptive strategy is mathematically driven to adopt the session probing in multimedia clients that detects the session blocks proficiently to mitigate the session overheads. Besides, a real-time system has been designed and developed for the analysis of quality metrics such as call success rate, call setup time, end-to-end session delay, RTP utilization, bandwidth consumption, and flooding attack detection rate. The examination results prove that the proposed RLPP and SSI achieve better efficiencies than other existing schemes.

Multimedia Information System (MIS) for Knowledge Generation and ICT Policy Framework in Education

The digital characteristics of the 21st century business and academic environment had become increasingly dependent on the software system and ICT policy configuration to maintain smart operations as the global world is increasingly becoming internet-driven and computer database centred. The role of the information system otherwise regarded as the federated multimedia digital library, ICT policy framework implementation, and e-learning education in the academic sustainability of the developing nations such Nigeria and Africa is to ensure free circulation of knowledge within digital information ecosystem. As the global world evolve into digital economy with ever increasing possibility of software technology (information system) taking greater percentage of the entire world existence in the near future for educational automation. This current paper is of the opinion that educational investment in the 21st century should embrace technological innovation, software consolidation, and ICT infrastructure in transforming education and making it flexible for easy management.

Recurrent Self-Structuring Machine Learning for Video Processing using Multi-Stream Hierarchical Growing Self-Organizing Maps

The emergence of IoT and advanced multimedia information systems have undoubtedly created a proliferation of video sensor data. Although diverse machine learning approaches are utilized to extract useful insights from these data, limitations occur when processing and accommodating the large volumes of video data, which are unlabeled and have previously unseen data structures. This brings out the importance of using self-structuring intelligence that can adapt to the nature of the data and with the ability to learn from multi-modal, spatiotemporal and unstructured data. Encompassing these advances, we propose a recurrent self-structuring machine learning approach for video processing using multi-stream hierarchical recurrent growing self-organizing maps (RGSOM) architecture. We have designed, implemented and evaluated the said approach using a human activity recognition video dataset (Weizmann dataset), achieving state-of-the-art accuracy of 93.5% in the unsupervised domain. We used both spatial and temporal data from the video as separate input feature streams, where RGSOMs were used to self-structure the video data in multi-streams for visual exploratory analysis and video classification. As potential implications, this study can contribute to the existing literature in advancing self-adaptation techniques for video sensor data processing.

Preface

CMVIT 2020 was held in Sanya during Feb. 20th-22nd, 2020. 2020 4th International Conference on Machine Vision and Information Technology (CMVIT 2020) is organized by Asia Pacific Institute of Science and Engineering. The conference provides a useful and wide platform both for display the latest research and for exchange of research results and thoughts in Machine Vision and Information Technology and other topics. The participants of the conference were from almost every part of the world, with background of either academia or industry, even well-known enterprise. The success and prosperity of the conference is reflected high level of the papers received.The proceedings are a compilation of the accepted papers and represent an interesting outcome of the conference. This book totally includes 83 papers and covers 5 chapters: 1. Systems, Models, and Algorithms; 2. Multimedia Information Systems with Human Centered Computing; 3. Computer Vision: Theory and Applications; 4. Signal, Image, and Video Process; 5. Ubiquitous Communications, 5G Technologies and Internet of Things.We would like to acknowledge all of those who supported CMVIT 2020. Each individual and institutional help were very important for the success of this conference. Especially we would like to thank the organizing committee for their valuable advices in the organization and helpful peer review of the papers.We sincerely hope that CMVIT 2020 will be a forum for excellent discussions that will put forward new ideas and promote collaborative researches. We are sure that the proceedings will serve as an important research source of references and the knowledge, which will lead to not only scientific and engineering progress but also other new products and processes.Prof. Irwin KingThe Chinese University of Hong Kong, Hong Kong S. A. R., ChinaConference Committee Chair

Retracted: Sparse data inspired depth of urbanization in Zhejiang based on geographic information system and visual system

AbstractIn the recent years, and also considering the rapid development of the urbanization, China has set up the higher requirements for modern urban planning concepts, methods, and means. Under the support of advanced technologies, it has become an inevitable trend to then make the full use of information technology to improve the design and management of city planning. Geographic information system (GIS) is a specific extremely essential spatial information system. It is a complex platform that collects, stores, manages, calculates, analyzes, displays, and describes geographical distribution data in all or part of the Earth's surface (including the atmosphere) space with the proper integration of the information processing and computer vision algorithms. In this paper, we apply the GIS and multimedia information systems to study the evaluation of local urbanization in Zhejiang. The multimedia system is designed to assist the GIS and the visualized model is presented to validate the proposed method. The results prove that the proposed is efficient.

Health status, resilience and quality of life of first and fourth year nursing students

Objective: To compare the health status (stress, depressive symptoms and sleep quality), the resilience and quality of life in first and fourth year nursing students.Methods: This is a cross-sectional research conducted in 2016 with 86 students enrolled in first and fourth years of the nursing degree. We applied the instrument for Assessment of Stress in Nursing Students, the Center for Epidemiologic Studies Depression Scale, Pittsburg Sleep Quality Index, Wagnild and Young’s Resilience Scale; and the WHOQOL-BREF. ANOVA (Test F) was applied for data analysis.Results and conclusions: A total of 49 first-year and 37 fourth-year students were sampled for this study. Fourth- year nursing students showed higher levels of stress, lower intensity of depressive symptoms and higher quality of life and resilience levels. The poor sleep quality was prevalent in both groups. Conclusion: although the nursing education potentially contributes for students’ sickness, the experiences lived in this period may strength the resilience skills.Conclusions: Video indexing and retrieval are accomplished by using hashing and $k$-d tree methods, while visual signatures containing color, shape and texture information are estimated for the key-frames, by using image and frequency domain techniques. Experimental results with the dataset of a multimedia information system especially developed for managing television broadcast archives demonstrate that our approach works efficiently, retrieving videos in 0.16 seconds on average and achieving recall, precision and F1 measure values, as high as 0.76, 0.97 and 0.86 respectively.

Application of GIS technology in the construction of urban traffic sharing multimedia information platform

With the gradual maturity of geographical multimedia information system, applying geographical multimedia information system to urban intelligent traffic management information system and urban traffic sharing information platform can realize unified management and real-time update of traffic information. Through the urban traffic sharing information platform, it can increase the value of information. The multimedia information of the entire intelligent traffic management system can be stored, organized and processed by the shared multimedia information platform. It can more effectively ensure the correctness, comprehensibility and avoid redundancy of data relationships. Then it improves the utilization and transmission speed of multimedia information in the system. The urban traffic multimedia information management system has improved the use efficiency of urban road construction in China. And it also made the traffic multimedia information system more scientific and intelligent. It can also improve its management level and play an important role in urban traffic management. This paper first briefly analyzes the current traffic situation and the development of intelligent traffic multimedia information system in China. The basic concepts of GIS and urban intelligent transportation system based on GIS are introduced secondly. At last, the possibility about GIS as urban intelligent traffic management system sharing multimedia information platform is analyzed. The system framework and the basic function of GIS platform are put forward, and the application of GIS in urban traffic common information platform using the key technical support was discussed. It expounds the application of GIS in urban traffic common multimedia information platform.