Multimedia Information Research Articles

Automatic Integration Algorithm of Vocal Performance Learning Materials Based on Multidimensional Association Rules

As computer and multimedia technology advances and as the variety of knowledge display forms expands, there are more ways for people to obtain knowledge and information. The best course in musicology is voice performance. A crucial issue is how to select and categorize valuable curriculum materials of varying quality levels. This paper implements an automatic classification and integration algorithm for vocal performance learning materials using machine learning technology and tests it on the corresponding dataset, beginning with multidimensional association rule mining technology and the premise that multimedia data contain numerous useful characteristics. Experiments demonstrate the classification precision and data integration capacity of the proposed algorithm. Vocal performance is the most engaging course in musicology. To cultivate corresponding talents, we can rely on college and university offline courses and the rapidly developing multimedia technology to train talents online. An important topic is how to efficiently select and classify curriculum materials of varying quality in order to provide them to students with different learning needs. We can achieve the automatic classification of the course content by leveraging the superior learning capabilities of artificial intelligence and machine learning technology. Consequently, this paper implements an automatic classification and integration algorithm for vocal performance learning materials using machine learning-related technology and conducts an experimental test on the corresponding dataset, beginning with multidimensional association rule mining technology and the perspective that multimedia information itself contains a large number of useful characteristics. Experiments demonstrate that the proposed algorithm has a high level of classification accuracy and data integration capability.

Artificial Intelligence (AI) and Machine Learning for Multimedia and Edge Information Processing

The advancements and progress in artificial intelligence (AI) and machine learning, and the numerous availabilities of mobile devices and Internet technologies together with the growing focus on multimedia data sources and information processing have led to the emergence of new paradigms for multimedia and edge AI information processing, particularly for urban and smart city environments. Compared to cloud information processing approaches where the data are collected and sent to a centralized server for information processing, the edge information processing paradigm distributes the tasks to multiple devices which are close to the data source. Edge information processing techniques and approaches are well suited to match current technologies for Internet of Things (IoT) and autonomous systems, although there are many challenges which remain to be addressed. The motivation of this paper was to survey these new paradigms for multimedia and edge information processing from several technological perspectives including: (1) multimedia analytics on the edge empowered by AI; (2) multimedia streaming on the intelligent edge; (3) multimedia edge caching and AI; (4) multimedia services for edge AI; and (5) hardware and devices for multimedia on edge intelligence. The review covers a wide spectrum of enabling technologies for AI and machine learning for multimedia and edge information processing.

Does digital, multimedia information increase recruitment and retention in a children’s wrist fracture treatment trial, and what do people think of it? A randomised controlled Study Within A Trial (SWAT)

ObjectivesTo evaluate digital, multimedia information (MMI) for its effects on trial recruitment, retention, decisions about participation and acceptability by patients, compared with printed information.DesignStudy Within A Trial using random cluster...

Implementation of Efficient Teaching Scheme of Human Anatomy and Physiology Based on Multimedia Information Processing Technologies

An application scheme based on the teaching of human anatomy and physiology, namely, PBL, is proposed. In particular, 95 medical students were randomly divided into two groups: classes 2 and 3 were the experimental classes (48 students), and then, the teaching practice was carried out according to the machine learning route; year 1 and class 4 were the control classes (47 students), and the traditional teaching method was used. The teaching effectiveness was evaluated by performance analysis, the mean score of the overall evaluation of the experimental class was (93.23 ± 2.01), the mean score of the control group was (91.51 ± 2.89), and the difference was statistically significant ( p < 0.01 ). The survey showed that more than 93% of the students in the experimental class thought that the deep learning model helped stimulate their interest in learning, enhance their sense of teamwork, and improve their overall ability.

A universal method for constructing non-degenerate hyperchaotic systems with any desired number of positive Lyapunov exponents

Due to the limited machine word length of hardware devices, the dynamics of digital chaotic systems will degenerate. To combat this issue, we proposed a universal method that is based on singular value decomposition (SVD), which can reversely construct non-degenerate hyperchaotic systems with any desired number of positive Lyapunov exponents by controlling pre-specified singular values. To assess the practicability and effectiveness of the method, we construct a 6-dimensional non-degenerate hyperchaotic system as an example. Furthermore, based on the hyperchaotic system, a pseudorandom number generator (PRNG) with desirable statistical characteristics is designed for image encryption. Numerical simulations were performed to evaluate the security of the image encryption algorithm in terms of histogram, information entropy, differential attack test, etc. The proposed non-degenerate hyperchaotic system can be effectively applied in the field of multimedia data encryption and information security.

Research on Application of Multimedia Information Technology in Modern Social Governance Platform

Facing the impact of MIT (Multimedia Information Technology) on modern SG (Social Governance) and its opportunity, we should promote the diversified development of SG by cultivating social democratic consciousness in MIT and promote the transparent development of SG by encouraging citizens’ right to know. Combining the internal logic of MIT innovation SG with the status quo and opportunities of MITSG, this paper actively explores the application of MIT in modern SG platform and realizes the steady progress of SG capability modernization. Oversampling and density are used to determine the initial K value and initial center point of K -means algorithm, and parallelization improvement is made based on Hadoop platform. Experiments show that the improved K -means algorithm has good parallelism.

АЛГОРИТМ ДИНАМИЧЕСКОГО КООРДИНАТНО-ПЕРЕМЕННОГО ВНЕДРЕНИЯ И АВТОМАТИЧЕСКОГО ОБНАРУЖЕНИЯ НЕВИДИМЫХ РОБАСТНЫХ ЦИФРОВЫХ ВОДЯНЫХ ЗНАКОВ В ЧАСТОТНОЙ ОБЛАСТИ ВИДЕОПОТОКА

Одним из способов внедрения цифровых водяных знаков является преобразование в частотной области изображения. В статье предлагается алгоритм динамического внедрения цифровых водяных знаков в видеоданные. Global scientific and technological progress contributes to the continuous growth of multimedia content in the global network. In some cases, when creating and distributing unique video information, the task of copyright protection arises, as well as the task of unambiguous identification of the content source. Therefore, the preservation of protected, stable and visually imperceptible signs with information about the sources of reproduction in the structure of the video stream is an urgent task. A common method of protecting multimedia information from unauthorized distribution is the introduction of digital watermarks in the video sequence. One of the ways to introduce digital watermarks is to transform in the frequency domain of the image. At the same time, any changes in the frequency spectrum will certainly lead to image distortion and the appearance of artifacts. Therefore, the method of implementing a hidden message should provide as little visual distortion of video data as possible. At the same time, the hidden message must be robust enough to remain retrievable after various impacts and operations with video data. The article proposes an algorithm for the dynamic implementation of digital watermarks in video data, which consists in changing the coordinates of the marker insertion according to the law of pseudorandom sequence.

A Multimedia Learning for Chinese Character Image Recognition via Human-Computer Interaction Network

As science and technology continue to develop, Chinese character image recognition technology is being used in a wide range of fields. This computer-based technology is a practical way of automatically recognizing images of text. Typically used in Chinese character education, it provides a new form of human–computer interaction for students. In addition, multimedia technology can provide a rich learning environment for students, which can present information about Chinese characters in the form of pictures, sounds, and videos, thus compensating for the disadvantages of learning Chinese characters by rote in the traditional educational process. The combination of Chinese character image recognition technology and multimedia technology can not only enrich the process of learning Chinese characters, but also promote students’ motivation to learn, thus providing a new and more modern approach to Chinese character education. Based on the study of Chinese character image recognition technology, this research combines it with multimedia information, to achieve the image recognition of Chinese character and multimedia information representation. The combined technology can provide significant references for course design and Chinese learners.

Research Challenges of Library and Information Science in retrieving content based Multimedia Information

Research Challenges of Library and Information Science in retrieving content based Multimedia Information

Secure Approach Using Visual Cryptography

An Image Encryption and Decryption Using AES (Advance Encryption Standard) Algorithm is proposed in this paper. Visual cryptography is the most popular technique attracted various researchers to improve the security level while utilizing the images and videos as encryption key, instead of text which is easy to crack. Visual cryptography computes complex multimedia information which may leads to computational overhead when simple processing techniques and architectures were utilized. So, various researchers had taken over this challenge and trying to resolve while introducing the various high speed techniques and architectures which would make visual cryptography process highly secured and energy efficient. This paper presents an algorithm in which the image is an input to AES Encryption to get the encrypted image and the encrypted image is the input to AES Decryption to get the original image. Keywords: Visual cryptography, security, energy efficient, high speed architecture, accurate prediction outcome, AES algorithm, image encryption, image decryption

A mixture of Noise Image Denoising using Sevenlets Wavelet Techniques

The noise has always been present in digital images when coding, image acquisition, transmission and processing steps has often corrupted by noise. Noise is challenging to confiscate from the digital images without the noise model’s prior information preserving edges. That is why the assessment of noise models is essential in the revise of image denoising techniques. A novel approach to improve the performance of an image’s quality and visual perception must be noise-free. The essential features like edge details should be retained as much as possible due to the increased traffic caused by multimedia information and digitized form of representation of images. This research articulates a brief general fundamental proposal of the noise model. The input image has debased with different noise probability density of Gaussian (G), Speckle (S), Salt and Pepper (SP) noise and a mixture of noise (G + S + SP). The Wavelet technique’s methodology using Sevenlets wavelet are Haar, Daubechies, Coiflets, Symlets, Discrete Meyer, Biorthogonal and Reverse Biorthogonal input Lena standard image has decomposed using Discrete Wavelet Transform (DWT). The decomposition process, as accomplished by discriminating the input image with lower and higher image coefficients. Filtering techniques are employed to deplete the noise present in an image. Hence the quantitative investigation of noise model at hard and soft thresholding is analyzed, improving image quality by increasing PSNR and decreasing MSE to have better performance.
 HIGHLIGHTS
 
 The images may be corrupted randomly in the transmission line; it is significant to retrieve exactly without loss of data; it is a challenging task. The images are examined with a different mixture of noises with corrupting at various percentage levels. In transmission channels the data will be corrupted, the primary aim is to retrieve actual data.
 For the testing purpose Gaussian (G), Speckle (S), and Salt & Pepper (SP) noise added to the Lena image have been corrupted and denoised. Denoising using methodology Discrete Wavelet Transform (DWT), to obtain better clarity image quality furthermore noise is filtered using Weiner and Median Filters.
 The mixture of noises of 0.1, 1, and 10 % density noise (G+S) (Gaussian (G) pulse Speckle (S)), G+S+SP (Gaussian (G) plus Speckle (S) pulse Salt & Pepper (SP)) added to the Lena image and denoised, have obtained improved denoised images comparing to previous research results.

Mental health in smart cities: The role of technology during COVID-19 pandemic

COVID-19 has changed the daily lives of citizens around the world and exposed the vulnerability of life and the functioning of cities. The pandemic has forced citizens to adapt to new models of remote work during quarantine and access to smart technology-based services. The article aims to assess citizens' perceptions of the technological solutions provided by smart cities and, in particular, the municipality of Paphos before and after the Covid-19 pandemic, as well as to evaluate their impact on citizens' mental health. The results of the study contribute to the understanding of the mental health benefits for citizens living in smart cities compared to people living in low-tech areas, revealing the potential positive effects of smart technologies, as well as the change in people's digital decision-making before and after the pandemic

A Study for Development of Digital Contents Management Systems Based on Smart Home

With the development of high-speed wireless LAN, the use of multimedia-type digital contents is increasing significantly even in the smart home environment. Therefore, it is very important to efficiently process and manage the use of digital content in the form of multimedia. In order to effectively process multimedia digital contents in the wireless LAN environment of a smart home, a server higher than the PC level is required. There is also a need for a support system that can exchange multimedia digital contents between clients of home appliances. Therefore, in this paper, we propose a Smart Home Digital Contents Management and Operation System (SDCMOS) that effectively processes and supports multimedia digital contents. This system is designed to effectively process real-time multimedia processing in home service in a wireless LAN environment. In addition, it was made possible to efficiently search multimedia information directly from the home server. SDCMOS is designed to be usable in fields such as biomedical image search, history museums, art exhibition halls, tourism information, geographic information, and e-commerce.

Design and Implementation of Interactive Platform for Operation and Maintenance of Multimedia Information System Based on Artificial Intelligence and Big Data.

In order to cope with the challenges that operators face after the impact of diversified social channels in the field of interactive services, we actively build a new generation of intelligent interactive systems based on artificial intelligence technology, a semantic understanding, and intention recognition, covering rich media content, omnichannel coverage, high-frequency knowledge updates, consistent service response, high-quality, and low-cost intelligent interactive solutions is proposed. The solution provides overall business modeling for scenario design and a scenario-based knowledge expression system, with the function of fragmented knowledge processing. With complete text and voice information, combined with pictures, text, audio, video, and other multimedia, we intelligently interact with users, allowing users to obtain required information and solve problems in a pleasant and relaxing interaction. Therefore, the research and exploration of the intelligent interactive system architecture based on artificial intelligence is a useful practice and strong support for operators to redefine the connotation and elements of “smart service” in the process of building “smart operation.” Through repeated tests, it can be seen that the language similarity has reached 0.75549, which is very close to 1.0000. It can be seen that the design of this platform has been successful.

QoE modeling for audiovisual associated with MOBA game using subjective approach.

With the advancement of multimedia communications and information technologies, online video games have become very popular recreational activities worldwide, while Multiplayer Online Battle Arena (MOBA) games have gained immense popularity from game players in recent times. Therefore, based on quality of experience, audiovisual quality evaluation models for MOBA games have been proposed in this study. The subjective data from 210 game players (both males and females) about audio quality during conversation, the video quality, the overall quality, and the weighted percentage of video and voice have been collected from small competition events of the Garena ROV (Arena of Valor) in Hua Hin, Thailand. The data from 160 game players have been used to create the models, while the data from 50 game players have been applied for model performance evaluation. After developing the models, Mean Absolute Percentage Error (MAPE) technique has been utilized for model evaluation. On completion of this study, it was found that two thirds of the proposed models provide better performance than the other previous works. All of them, called MOSAudiovisual-MOBA1 model, MOSAudiovisual-MOBA2 model and MOSAudiovisual-MOBA3 model, show excellent performances with MAPE values of 4.95%, 5.92% and 4.75% respectively. Therefore, excellent performance of these proposed models becomes one of the contributions of this study. Also, this evidence of excellent model performance makes the proposed models ideal for utilization for assessment of audiovisual quality of the MOBA games. All audiovisual quality evaluation models provide excellent efficiencies.

Digital watermarking method for image feature point extraction and analysis

Multimedia information (e.g., photos) is subject to numerous attacks when extensively dispersed, excellent stealth and robustness play a critical role in information concealment. Next, to further improve the imperceptibility of the generated images, we introduce an information embedding based on feature extraction, since the feature points themselves are robust as strong corner points in the images. We will perform specific practical applications in information-hiding scenarios, such as ticket anticounterfeiting, copyright protection, tampering hints, and covert marking. As a result, while assuring the accuracy of hidden data, assault resistance must also be addressed. In this paper, a strategy for watermark embedding utilizing image feature points is proposed. In principle, the embedding and extraction of digital watermarks are achieved in the transform domain by discrete wavelet transform processing to make digital images more robust than before. The effectiveness of the algorithm is analyzed by experimental data, in which different wavelet bases are used. To check the robustness of the watermarking algorithm, various attacks are performed on watermarked images.

Rendering and Optimization Algorithm of Digital City’s 3D Artistic Landscape Based on Virtual Reality

“Digital city” in a broad sense refers to urban informatization. That is to say, the digital city will gradually realize the informatization of the urban national economy and society by building infrastructure platforms such as broadband multimedia information network and geographic information system, integrating urban information resources, establishing e-government, e-commerce, labor, social insurance, and other information communities, to make the city in an invincible position in the competition of the information age. The virtual reality technology of urban three-dimensional landscape, or the establishment of a virtual city, is an important part of the vast project of digital city construction. This research mainly discusses the rendering and optimization algorithm of digital city 3D artistic landscape based on virtual reality. The article uses image stitching technology. Clean up unnecessary furniture in the CAD floor plan, and try to keep only the wall structure. Export drawings and save as dwg files for 3DMAX modeling. For adjacent overlapping images, the common features of the overlapping parts are determined by image matching, so that the images taken at different shooting positions and different viewing directions with a small angle of intersection are calculated to be unified. Take the photo coordinate system, and then find out the overlapping range of each direction for splicing. In the actual data acquisition process, most of the spatial data such as existing maps are used. It mainly includes topographic maps and the latest planning drawings, as well as planning and design drawings of various residential areas. In addition to determining the specific location of each feature, various maps are used to make a surface image (texture) of an urban area based on these data using Photoshop. The editing of roaming space is the key to realizing 3D panoramic virtual city browsing. Combined with the navigation of 3D panoramic map, using key technologies such as hotspot connection and command button, the 3D panoramic images collected in different places in the city can be effectively integrated into one, assisting with various multimedia elements, such as background music, animated videos, and language commentary, show the true appearance of the virtual city in all directions. Compared with the SURF algorithm, the SIFT algorithm extracts more feature points and more correctly matched point pairs, and the minimum time is 0.524 s. This research will contribute to the construction of the three-dimensional landscape of the digital city.

Integration of multimedia components into the models of treatment and diagnostic process in patients and clinical diagnostic tasks in cardiology

Introduction. Integration of multimedia results of diagnostic examinations into the information model of diagnostic and treatment process makes it possible to teach medical decision-making taking into account all available information about the patient.Aim. The purpose of this work was to use multimedia results of instrumental examination methods to form and verify the level of effective diagnostic decision-making.Material and Methods. A significant array of multimedia information arising in the course of treatment and diagnostic process was derived from databases of diagnostic units and was important for medical decision-making. The model was supplemented with clinically and demographically relevant studies of other patients when necessary. The multimedia components were integrated into the virtual simulations with two different trajectories of information presentation to the trainees depending on the purpose of further use.Results. At the first stage of the project, the multimedia components were integrated into linear models of completed cases to demonstrate medical decisions to the trainees. The multimedia components were presented as the fragments of magnetic resonance imaging (MRI) data, echocardiography and vascular ultrasound recordings, scanned electrocardiograms (ECG), angiography results, X-ray images, tomograms, and results of other visualization methods of patient examination. Each multimedia file was accompanied by a textual conclusion made by a relevant specialist. At the second stage, the multimedia components were integrated into the models with a branched trajectory of information presentation. The course of disease and the patient’s condition could change depending on the decisions made, which means that there are alternative scenarios of the therapeutic and diagnostic process unlike the real invariant treatment of the patient. This possibility is especially important for the formation of medical decision-making competencies in safe conditions of simulation. To elaborate clinical diagnostic tasks, the authors developed a rating system quantifying the effectiveness of the decisions.Discussion. Building physician competencies in the educational process through repeated decision-making under changing conditions is crucially important for the health and lives of patients and can be effectively implemented using simulation technologies. Web access to this content is strategically important for the use of virtual patients with multimedia diagnostic results to practice decision-making skills in clinical disciplines.

Secure IoMT Pattern Recognition and Exploitation for Multimedia Information Processing using Private Blockchain and Fuzzy Logic

The Internet of Medical Things (IoMT) is a definite IoT connecting atmosphere that contracts with communication via intelligent medical equipment. Activity detection, motion tracking, information extraction, consumer retrieval, etc., have all been solved due to advances in the autonomous study of human behavior from multimedia information processing. Though the IoT connecting atmosphere enables and provisions our daily actions, it too has certain disadvantages. IoTgrieves from numerous safety and confidentiality challenges, such as reiteration, impersonation, man-in-the-middle, remote hijacking, privileged-insider attack, denial of service (DoS) attacks, password guessing, and malware bouts. Hence, in this paper, Private Blockchain and Fuzzy Logic based Attack Detection system (PBFL-ADS) has been proposed for secure IoMT disease prediction using Multimedia Information Processing techniques. The proposed method utilizes Bayesian inference-based trust administration to perceived malevolent nodes in Health Smartphone Structures (HSS) for PBFL-ADS. This paper focuses on the specific form of IoMT called HSS because smartphones have been widely used in the healthcare profession. Then, blockchains have been utilized to improve Bayesian trust management's efficacy in detecting hostile nodes in HSSs. The effectiveness of the suggested technique has been assessed, and test results show that blockchain technology helps identify fraudulent nodes with an acceptable workload. The proposed PBFL-ADS method increases the HS2 scenario 1.1, processor utilization at nodes 33.5%, pattern recognition ratio 92.1%.and server utilization 40.1%.

Differential cryptanalysis of diffusion and confusion based information confidentiality mechanism

Wireless multimedia communications have progressed significantly in recent years. As a result, there is an increasing demand for more secure media transmission to protect multimedia information. Image encryption systems have been presented throughout the years, but those based on chaotic maps are the most secure and trustworthy due to the inherent properties in such types of multimedia contents involving the pixels strong correlation and data handling capacities. In this research, we have performed differential cryptanalysis of a recently suggested cryptosystem based on a three dimensional (3D) logistic map and 3D Cat map. The originally proposed approach was based on diffusion and confusion strategy. The vulnerabilities in the understudy cryptosystem lead to the successful proposed cryptanalysis attack. The original ciphers are recovered by means of a chosen-plaintext attack. The recovered data is also subjected to some statistical analysis to check the quality.