Multimedia Communication Research Articles

Application of Low Bit Rate Coding Based on Nonlinear Data Prediction in Wireless Network Multimedia Communication

In order to realize the application of low bit rate video coding in wireless multimedia communication, this paper analyzes the principle of video coding and highlights the importance of low bit rate in wireless multimedia communication. For this, the iterative optimization method of contour height map contour, B-spline curve approximate contour, and control points is carried out to ensure that hearing and vision can achieve the clarity of video under appropriate conditions. The results show that compressing the original video to a suitable size for decoding and completing the output in a compatible format can realize the operation efficiency of the encoder and improve the coding speed.

Video compression based on zig-zag 3D DCT and run-length encoding for multimedia communication systems

PurposeWith the advent of technology, a huge amount of data is being transmitted and received through the internet. Large bandwidth and storage are required for the exchange of data and storage, respectively. Hence, compression of the data which is to be transmitted over the channel is unavoidable. The main purpose of the proposed system is to use the bandwidth effectively. The videos are compressed at the transmitter’s end and reconstructed at the receiver’s end. Compression techniques even help for smaller storage requirements.Design/methodology/approachThe paper proposes a novel compression technique for three-dimensional (3D) videos using a zig-zag 3D discrete cosine transform. The method operates a 3D discrete cosine transform on the videos, followed by a zig-zag scanning process. Finally, to convert the data into a single bit stream for transmission, a run-length encoding technique is used. The videos are reconstructed by using the inverse 3D discrete cosine transform, inverse zig-zag scanning (quantization) and inverse run length coding techniques. The proposed method is simple and reduces the complexity of the convolutional techniques.FindingsCoding reduction, code word reduction, peak signal to noise ratio (PSNR), mean square error, compression percent and compression ratio values are calculated, and the dominance of the proposed method over the convolutional methods is seen.Originality/valueWith zig-zag quantization and run length encoding using 3D discrete cosine transform for 3D video compression, gives compression up to 90% with a PSNR of 41.98 dB. The proposed method can be used in multimedia applications where bandwidth, storage and data expenses are the major issues.

Analysis of Score-Level Fusion Rules for Deepfake Detection

Deepfake detection is of fundamental importance to preserve the reliability of multimedia communications. Modern deepfake detection systems are often specialized on one or more types of manipulation but are not able to generalize. On the other hand, when properly designed, ensemble learning and fusion techniques can reduce this issue. In this paper, we exploit the complementarity of different individual classifiers and evaluate which fusion rules are best suited to increase the generalization capacity of modern deepfake detection systems. We also give some insights to designers for selecting the most appropriate approach.

The Texture and Color Matching of Oil Painting Materials Based on Multimedia Visual Communication

The obvious tendency of modern artists to change the concept of painting is to pay more and more attention to personal feelings and spiritual expression. In modern oil paintings, there are more and more oil paintings that convey emotions and the emotional expression methods of the colors of the works are becoming more and more abundant. This article aims to study the application of multimedia visual communication in the texture and color matching of oil painting creation materials and to put forward the viewpoint of applying more multimedia visual communication to oil painting creation. This article first gives a detailed introduction to oil painting creation materials and their texture, oil painting color matching, and so on. In addition, experiments were conducted on the application of multimedia visual communication in the texture and color matching of oil painting creation materials. The experimental results show that the texture and color matching of oil painting creation materials based on multimedia visual communication are more popular with the public, and oil painters are also satisfied with this method. And, the expressiveness of oil painting texture has been improved by 10%. This shows that the texture and color matching scheme of the oil painting material in this study is effective.

Analysis of wireless English multimedia communication based on spatial state model equation

Abstract In order to improve the quality of wireless English multimedia communication, according to the characteristics of space multimedia communication environment and communication equipment, this paper proposes a wireless English synchronous QoS control algorithm with low complexity and easy implementation. Using RTCPSRRTP timestamp and NTP absolute timestamp, the wireless English RTP timestamp is mapped to the same absolute reference clock (sender system time) respectively, and the wireless English synchronization detection decision rule is established according to the synchronization QoS performance requirements between wireless English media. Wireless English synchronization control system model at the receiver. At the receiving end, the wireless English stream is the main media stream and the video stream is the slave media stream. The synchronization detection and judgment is implemented in real time before the video frame is played. The synchronization between audio and video media is realized by corresponding synchronization control of wireless English playback. State space model reflects all the information of system dynamic behavior and is a complete description of system behavior. The state space model has a wide range of applications. It is not only suitable for SISO linear constant systems, but also suitable for nonlinear systems, time-varying systems, MIMO systems and stochastic systems. The more outstanding advantage is that the state space model adopts local calculation and uses the state variables inside the system to describe its dynamic characteristics. This property of local calculation not only greatly simplifies the mathematical expression of multi-dimensional system, but also facilitates the analysis and research of the system. The air link rate of the wireless transceiver is set to 512Kbps. The video is encoded based on H.264 and the audio is encoded based on G.729 Speech coding standard. Compared with the wireless English media synchronization control algorithm based on RTP / RTCP, the results show that the RMSE value after adopting the synchronization algorithm in this paper is reduced by 60.09% and 77.69% at most; Compared with the wireless English media synchronization control algorithm based on RTP / RTCP, the synchronization performance of this algorithm is better than the wireless English media synchronization control algorithm. The RMSE value is reduced by 2% on average and 5.2% at most. In addition, the synchronization control algorithm between wireless English media performs synchronization control by losing frames or pausing decoding before video decoding at the receiver, which affects the quality of wireless English video decoding and reconstruction.

FPGA implementation of high performance digital FIR filter design using a hybrid adder and multiplier

ABSTRACT The energetic growth in portable multimedia and mobile communication system has increased the requirement of high-speed signal processing system with compact area and power consumption. Finite impulse response(FIR) filters are broadly used in image, signal, speech and video signal processing, medical electronics, noise filtering, mobile communication and many other fields. The performance of the whole signal processing system with FIR filter depends on the basic building block of multiplier and adders. Hence, the hybrid FIR filter is proposed to improve the speed of the signal processing system using hybrid adder and hybrid multiplier. In this technique, the basic hybrid adder is designed with the help of 2-bit adders, BEC and 4:1 Multiplexer. Also, the hybrid multiplier is designed based on partial products of two consecutive multiplicand bits which are added at same time using Han-Carlson, Weinberger and Ling adder. The proposed FIR filter is functionally verified and synthesised using Xilinx ISE simulator and is implemented in Spartan 6 FPGA boards. The result shows that the delay of FIR filter using the proposed multiplier is improved by 26.51%, 15.59%, 15.83% and 2.79% as compared with CLA, conventional CSA, CSA-BK-BEC and the proposed adder with array multiplier, respectively.

Communication Protocols and Technologies for Multimedia Transmission: A Comprehensive Study

The exponential growth in end-user demand for multimedia content has necessitated significant advancements in communication technologies and multimedia processing. This paper presents a comprehensive review of various multimedia communication systems, focusing on the techniques employed for processing multimedia content and ensuring seamless transmission. It examines various technologies and communication protocols used to transport multimedia material while also addressing the difficulties these technologies present. The goal is to satisfy the growing demands for multimedia communication that include high data rates, wide bandwidth, low latency, and increased Quality of Service (QoS).

MM-Wave HetNet in 5G and beyond Cellular Networks Reinforcement Learning Method to improve QoS and Exploiting Path Loss Model

This paper presents High density heterogeneous networks (HetNet) which are the most promising technology for the fifth generation (5G) cellular network. Since 5G will be available for a long time, previous generation networking systems will need customization and updates. We examine the merits and drawbacks of legacy and Q-Learning (QL)-based adaptive resource allocation systems. Furthermore, various comparisons between methods and schemes are made for the purpose of evaluating the solutions for future generation. Microwave macro cells are used to enable extra high capacity such as Long-Term Evolution (LTE), eNodeB (eNB), and Multimedia Communications Wireless technology (MC), in which they are most likely to be deployed. This paper also presents four scenarios for 5G mm-Wave implementation, including proposed system architectures. The WL algorithm allocates optimal power to the small cell base station (SBS) to satisfy the minimum necessary capacity of macro cell user equipment (MUEs) and small cell user equipment (SCUEs) in order to provide quality of service (QoS) (SUEs). The challenges with dense HetNet and the massive backhaul traffic they generate are discussed in this study. Finally, a core HetNet design based on clusters is aimed at reducing backhaul traffic. According to our findings, MM-wave HetNet and MEC can be useful in a wide range of applications, including ultra-high data rate and low latency communications in 5G and beyond. We also used the channel model simulator to examine the directional power delay profile with received signal power, path loss, and path loss exponent (PLE) for both LOS and NLOS using uniform linear array (ULA) 2X2 and 64x16 antenna configurations at 38 GHz and 73 GHz mmWave bands for both LOS and NLOS (NYUSIM). The simulation results show the performance of several path loss models in the mmWave and sub-6 GHz bands. The path loss in the close-in (CI) model at mmWave bands is higher than that of open space and two ray path loss models because it considers all shadowing and reflection effects between transmitter and receiver. We also compared the suggested method to existing models like Amiri, Su, Alsobhi, Iqbal, and greedy (non adaptive), and found that it not only enhanced MUE and SUE minimum capacities and reduced BT complexity, but it also established a new minimum QoS threshold. We also talked about 6G researches in the future. When compared to utilizing the dual slope route loss model alone in a hybrid heterogeneous network, our simulation findings show that decoupling is more visible when employing the dual slope path loss model, which enhances system performance in terms of coverage and data rate.

An Improved Modelling of User Clustering for Small Cell Deployment in Heterogeneous Cellular Network

Users in practical cellular geographical areas are found to be non-uniformly distributed. Small cell (SC) deployments in heterogeneous user distribution in a cellular geographical area help to meet high data rate user demands for multimedia data communications in hot spots. SCs help to offload traffic burden from the macro cell (MC) base station, and also cater the data traffic need for the edge users where signal strength from the MC base station (BS) is very weak. For deployments of SCs along with the central MC BS (hence called HetNet) in such spatial heterogeneous user distribution, effective user grouping or clustering algorithm is required for appropriate and satisfactory service coverage. We call it service grouping or clustering of users to be put under a SC for data transmission and reception. It does not disturb the spatial positions of users in clustered non-uniform distribution. Efficient grouping or clustering of users and then deploying a SC at optimal location enhances the performance of the HetNet. It is found that the K-means algorithm used for such grouping of users to position SCs is not efficient. A novel and improved user grouping algorithm is proposed in this paper which performs much better compared to the k-means algorithm. The proposed algorithm of modelling of user clustering results in increase in the number of users under SCs, increase in more offloading of data traffic from MC BS thereby increasing data throughput of MC users. The algorithm also increases in the energy efficiencies of the SCs which is considered as one important performance metric. A doubly stochastic poison process (DSPP), also called Cox process, is assumed here for simulation of non-uniform user distributions. We consider Rayleigh distributed small scale fading model, large scale fading factor representing shadow fading, and users’ geographical distances from BSs to evaluate users’ data rates.

An Electronic Data Capture Tool for Data Collection During Public Health Emergencies: Development and Usability Study.

BackgroundThe Discovery Critical Care Research Network Program for Resilience and Emergency Preparedness (Discovery PREP) partnered with a third-party technology vendor to design and implement an electronic data capture tool that addressed multisite data collection challenges during public health emergencies (PHE) in the United States. The basis of the work was to design an electronic data capture tool and to prospectively gather data on usability from bedside clinicians during national health system stress queries and influenza observational studies.ObjectiveThe aim of this paper is to describe the lessons learned in the design and implementation of a novel electronic data capture tool with the goal of significantly increasing the nation’s capability to manage real-time data collection and analysis during PHE.MethodsA multiyear and multiphase design approach was taken to create an electronic data capture tool, which was used to pilot rapid data capture during a simulated PHE. Following the pilot, the study team retrospectively assessed the feasibility of automating the data captured by the electronic data capture tool directly from the electronic health record. In addition to user feedback during semistructured interviews, the System Usability Scale (SUS) questionnaire was used as a basis to evaluate the usability and performance of the electronic data capture tool.ResultsParticipants included Discovery PREP physicians, their local administrators, and data collectors from tertiary-level academic medical centers at 5 different institutions. User feedback indicated that the designed system had an intuitive user interface and could be used to automate study communication tasks making for more efficient management of multisite studies. SUS questionnaire results classified the system as highly usable (SUS score 82.5/100). Automation of 17 (61%) of the 28 variables in the influenza observational study was deemed feasible during the exploration of automated versus manual data abstraction. The creation and use of the Project Meridian electronic data capture tool identified 6 key design requirements for multisite data collection, including the need for the following: (1) scalability irrespective of the type of participant; (2) a common data set across sites; (3) automated back end administrative capability (eg, reminders and a self-service status board); (4) multimedia communication pathways (eg, email and SMS text messaging); (5) interoperability and integration with local site information technology infrastructure; and (6) natural language processing to extract nondiscrete data elements.ConclusionsThe use of the electronic data capture tool in multiple multisite Discovery PREP clinical studies proved the feasibility of using the novel, cloud-based platform in practice. The lessons learned from this effort can be used to inform the improvement of ongoing global multisite data collection efforts during the COVID-19 pandemic and transform current manual data abstraction approaches into reliable, real time, and automated information exchange. Future research is needed to expand the ability to perform automated multisite data extraction during a PHE and beyond.

Review of multimedia communication quality assessment techniques

Communication pattern is drifting from conventional audio to multimedia applications, streaming live and on-demand digital video contents over telecommunications and broadcasting networks. Currently, some businesses deploy video in promoting products in a far more enriching, entertainment and informative approach than typical traditional audio would allow. However, users of multimedia applications are interested in paying for a good acceptable video quality. Thus, this paper reviews methods used in Peak Signal-to-Noise Ratio (PSNR), Structural Similarity Index Metric (SSIM) and Video Quality Metric (VQM) with the objective of providing useful information to wireless video services providers in assessing and monitoring of quality of multimedia services delivered to users. Experimental comparison of PSNR, SSIM and VQM assessment methods to examine their performances in evaluation of multimedia applications has been performed. Comparing the quality performance of PSNR, SSIM and VQM metrics for Akiyo and Crew standard test sequences, it has been observed that the quality performance of the metrics improves when the bitrates allocation increase. For the test of consistency and quality performance of the metrics, observation shows that for a given bitrates of 3.84Mb/s, under CABA test configuration, Akiyo test sequence, experienced better quality performance of 46.63dB (PSNR), 99.10% (SSIM) and 11.00% (VQM) compared to lower quality performance of 36.18dB (PSNR), 90.40% (SSIM) and 22.00% (VQM) experienced by Crew test sequence. Experimental results of the media quality metrics for Akiyo and Crew standard test sequences with different temporal activity levels show that the quality performance of media content also depends on the temporal activity of the media content. The experimental results further show consistency in quality performance of PSNR, SSIM and VQM metrics for CABA and UBA test configurations. Thus, the objective metrics can be harnessed for evaluation of quality performance of multimedia applications at different channel conditions.

ACM SIGMM Executive Committee Newsletter - 1, 2022

The Special Interest Group in Multimedia of ACM, ACM SIGMM, provides a forum for researchers, engineers, and practitioners in all aspects of multimedia computing, communication, storage, and applications. We do this through our sponsorship and organization of conferences and workshops, supporting student travel to such events, discounted registrations, two regional chapters, recognition of excellence and achievement through an awards scheme, and we inform the Multimedia community of our activities through the SIGMM Records, social media and through mailing lists. Information on joining SIGMM can be found at https://www.acm.org/special-interest-groups/sigs/sigmm.

Re-shaping the Gaming Industry after 5G

Abstract: The fifth generation of wireless communications (5G) is a revolutionary technology that plays a key role in the development of all sectors, including multimedia and entertainment. These systems have become an existential part of our society, industry, science, and more. On the other hand, intensive research is underway in many aspects of the 5th generation wireless communication network. This network has features with a higher mobile data volume, typical user data rate, number of connected devices, and lower end-to-end latency. There is a growing demand for the development and design of 5G multimedia and entertainment communication applications, technologies, and theories. In the context of 5G wireless communication networks, new theories and technologies support a variety of multimedia applications such as entertainment, gaming and social media, audio and video, medical imaging, surveillance videos, business transactions, and Internet-based streams of things. This paper focuses on the possibilities and outcomes of how 5G makes drastic changes in the gaming sector. Keywords: 5G, gaming, lower end-to-end latency, higher mobile data volume, typical user data rate

Design of Cloud Computing Platform for Large-Scale Multimedia Communication

In order to enlarge the scale of multimedia communication, based on the design of cloud computing platform, this paper makes an in-depth study on the design of multimedia communication platform. Firstly, we study from three methods: extracting high-quality content, broadening multimedia profit channels, and enhancing copyright awareness. Among them, the big data diversion system under the cloud computing platform is designed to optimize data clustering and pattern recognition. The traditional big data shunting system under the cloud computing platform adopts the open-source embedded system design method. The shunting system is connected to the switch of the cloud computing platform through the coupling coil, resulting in missing points and wrong points in the data in the shunting system. Using this method, it is concluded that the cloud computing platform cannot achieve the optimal allocation in terms of SLA violation rate, resource consumption, and power consumption. After experiments and research, the current development trend of media shows a deviation from this phenomenon. The development of media itself, that is, the self-appreciation of media, is gradually becoming the main purpose of media development. A power simulation cloud computing platform architecture with dynamic expansion, efficient computing, and convenient resource scheduling should be given to face large-scale multimedia communication.

VQProtect: Lightweight Visual Quality Protection for Error-Prone Selectively Encrypted Video Streaming.

Mobile multimedia communication requires considerable resources such as bandwidth and efficiency to support Quality-of-Service (QoS) and user Quality-of-Experience (QoE). To increase the available bandwidth, 5G network designers have incorporated Cognitive Radio (CR), which can adjust communication parameters according to the needs of an application. The transmission errors occur in wireless networks, which, without remedial action, will result in degraded video quality. Secure transmission is also a challenge for such channels. Therefore, this paper’s innovative scheme “VQProtect” focuses on the visual quality protection of compressed videos by detecting and correcting channel errors while at the same time maintaining video end-to-end confidentiality so that the content remains unwatchable. For the purpose, a two-round secure process is implemented on selected syntax elements of the compressed H.264/AVC bitstreams. To uphold the visual quality of data affected by channel errors, a computationally efficient Forward Error Correction (FEC) method using Random Linear Block coding (with complexity of ) is implemented to correct the erroneous data bits, effectively eliminating the need for retransmission. Errors affecting an average of 7–10% of the video data bits were simulated with the Gilbert–Elliot model when experimental results demonstrated that 90% of the resulting channel errors were observed to be recoverable by correctly inferring the values of erroneous bits. The proposed solution’s effectiveness over selectively encrypted and error-prone video has been validated through a range of Video Quality Assessment (VQA) metrics.

Supply Chain Financial Risk Management under the Background of Wireless Multimedia Communication and Artificial Intelligence

The application of information technology and various electronic communication equipment has grown rapidly. At the same time, information technologies such as the Internet and communication networks have become increasingly mature and widely used, making e-commerce transactions simpler and the roles of enterprises in the supply chain increasingly diversified. At this stage, supply chain finance has become an important way for small- and medium-sized enterprises to finance, and it is a key step in commercial trade. However, the risk control of this model is difficult to be effectively contained. How to control its financial risk to the lowest level is the research goal of this paper. This paper analyzes and calculates the supply chain financial risks of different enterprises through a questionnaire method, a case analysis method, and a comparison method and obtains relevant data. The data results show that the entropy value of the net interest rate is 0.97, which indicates that it has a larger market share and less risk. Through wireless multimedia communication technology and artificial intelligence algorithms, the system calculation of supply chain financial risk management is much simpler. In this regard, the research proposes a scientific system for building supply chain financial risk management.

Optimizing the Design of a Vocal Teaching Platform Based on Big Data Feature Analysis of the Audio Spectrum

With the development of electronics and communication technology, digital audio processing technologies such as digital audio broadcasting and multimedia communication have been widely used in society, and their influence on people’s lives has become increasingly profound. At present, the real-time and accuracy of musical instrument tuners on the market need to be improved, which hinders the design of vocal music teaching system. Based on the BP neural network algorithm and fast Fourier transform algorithm in FPGA, this paper designs a real-time and efficient audio spectrum analysis system, which realizes the spectrum analysis function of music signal. The methods to calculate fast discrete Fourier transform are the FFT algorithm based on time extraction and the FFT algorithm based on frequency extraction. The characteristic of BP neural network algorithm is that it can not only obtain the corresponding estimation results by forward propagation of the input data but also carry out back propagation from the output layer according to the error between the estimation results and the actual results, so as to optimize the connection weight between each layer. This paper proposes to add Nios II system to FPGA processor and adopt cyclone IV in the hardware design of the system, which can be better compatible with the system designed in this paper. In the software part, WM8731 is used to process the audio data. WM8731 consumes very little power to the system, which will effectively improve the processing efficiency of the system. Compared with the original system, the data model obtained after screening and processing of the system model designed in this paper has an algorithm accuracy of more than 90%, among which the audio spectrum clarity of vocal music can reach 95%. Based on the above, the circuit of each module is tested, and in the specific experimental process, the audio frequency spectrum under different conditions is analyzed and data processed. The system can complete the collection and analysis of various music signals in real time, overcome the limitation of single function of traditional tuner, improve the utilization rate of tuner and the clarity of timbre, and also tune a variety of musical instruments and greatly improve the intonation of musical instruments and the utilization rate of tuner, which has a certain practical value.

Cryptanalysis and enhancement of an authentication protocol for secure multimedia communications in IoT-enabled wireless sensor networks

Cryptanalysis and enhancement of an authentication protocol for secure multimedia communications in IoT-enabled wireless sensor networks

QoE modeling for audiovisual associated with MOBA game using subjective approach.

With the advancement of multimedia communications and information technologies, online video games have become very popular recreational activities worldwide, while Multiplayer Online Battle Arena (MOBA) games have gained immense popularity from game players in recent times. Therefore, based on quality of experience, audiovisual quality evaluation models for MOBA games have been proposed in this study. The subjective data from 210 game players (both males and females) about audio quality during conversation, the video quality, the overall quality, and the weighted percentage of video and voice have been collected from small competition events of the Garena ROV (Arena of Valor) in Hua Hin, Thailand. The data from 160 game players have been used to create the models, while the data from 50 game players have been applied for model performance evaluation. After developing the models, Mean Absolute Percentage Error (MAPE) technique has been utilized for model evaluation. On completion of this study, it was found that two thirds of the proposed models provide better performance than the other previous works. All of them, called MOSAudiovisual-MOBA1 model, MOSAudiovisual-MOBA2 model and MOSAudiovisual-MOBA3 model, show excellent performances with MAPE values of 4.95%, 5.92% and 4.75% respectively. Therefore, excellent performance of these proposed models becomes one of the contributions of this study. Also, this evidence of excellent model performance makes the proposed models ideal for utilization for assessment of audiovisual quality of the MOBA games. All audiovisual quality evaluation models provide excellent efficiencies.

S-RLNC based MAC Optimization for Multimedia Data Transmission over LTE/LTE-A Network

The high pace emergence in communication systems and associated demands has triggered academia-industries to achieve more efficient solution for Quality of Service (QoS) delivery for which recently introduced Long Term Evolution (LTE) or LTE-Advanced has been found as a promising solution. However, enabling QoS and Quality of Experience (QoE) delivery for multimedia data over LTE has always been a challenging task. QoS demands require reliable data transmission with minimum signalling overheads, computational complexity, minimum latency etc, for which classical Hybrid Automatic Repeat Request (HREQ) based LTE-MAC is not sufficient. To alleviate these issues, in this paper a novel and robust Multiple Generation Mixing (MGM) assisted Systematic Random Linear Network Coding (S-RLNC) model is developed to be used at the top of LTE MAC protocol stack for multimedia data transmission over LTE/LTE-A system. Our proposed model incorporated interleaving and coding approach along with MGM to ensure secure, resource efficient and reliable multiple data delivery over LTE systems. The simulation results reveal that our proposed S-RLNC-MGM based MAC can ensure QoS/QoE delivery over LTE systems for multimedia data communication.