Multimedia Streaming Research Articles

Adaptive Real-Time Routing Protocol for (m,k)-Firm in Industrial Wireless Multimedia Sensor Networks.

Many applications are able to obtain enriched information by employing a wireless multimedia sensor network (WMSN) in industrial environments, which consists of nodes that are capable of processing multimedia data. However, as many aspects of WMSNs still need to be refined, this remains a potential research area. An efficient application needs the ability to capture and store the latest information about an object or event, which requires real-time multimedia data to be delivered to the sink timely. Motivated to achieve this goal, we developed a new adaptive QoS routing protocol based on the (m,k)-firm model. The proposed model processes captured information by employing a multimedia stream in the (m,k)-firm format. In addition, the model includes a new adaptive real-time protocol and traffic handling scheme to transmit event information by selecting the next hop according to the flow status as well as the requirement of the (m,k)-firm model. Different from the previous approach, two level adjustment in routing protocol and traffic management are able to increase the number of successful packets within the deadline as well as path setup schemes along the previous route is able to reduce the packet loss until a new path is established. Our simulation results demonstrate that the proposed schemes are able to improve the stream dynamic success ratio and network lifetime compared to previous work by meeting the requirement of the (m,k)-firm model regardless of the amount of traffic.

Knowledge expansion of metadata using script mining analysis in multimedia recommendation

In this paper, a method for knowledge expansion of metadata using script mining analysis for multimedia recommendation systems is proposed. The method allows the extraction of new metadata and knowledge expansion through the mining analysis of multimedia scripts, which include a large amount of information. The scripts are collected by a Web crawler based on Python. From the collected scripts, hidden information is extracted through keyword analysis and sentiment analysis. In keyword analysis, scripts, unlike general documents, show a high frequency of names of characters or proper nouns. Such names or proper nouns are not frequently used in other media content, and therefore, their importance is high. Frequently, they are already offered in the conventional metadata, and consequently cause information duplication. Accordingly, term frequency–inverse document and metadata frequency (TF–IDMF), which considers the frequency of metadata in general term frequency–inverse document frequency (TF–IDF), is used. Thus, the importance of the names of characters or proper nouns in scripts can be decreased. Because the keywords for the extracted scripts are in fact included in the scripts, they can be used for precise multimedia search and recommendation. In sentiment analysis, the AFINN lexicon and the Bing lexicon are utilized to scan words in a script. The Bing lexicon is used to examine whether the words in the entire script are positive or negative. Then, the total numbers of positive words and negative words are used to calculate the representative sentiment of the script. The AFINN lexicon includes approximately 170 sentiment words, the negative or positive sentiment of which is presented in the range − 5 to +5. One script is divided into 100 sentences, and then, the representative sentiment in each sentence is evaluated as either positive or negative. Through script scanning, the flow of sentiment in multimedia streams can be discovered. The Bing lexicon categorizes words into positive, negative, and neutral sentiments. Through script scanning, the words included in each category can be quantified. Depending on the result of the script sentiment analysis, a different sentence embedding method based on inter-sentence similarity is used to cluster similar media. The results of the keyword analysis and sentiment analysis of a script are added to the metadata in a new column in a knowledge base to expand knowledge. To evaluate the significance of multimedia recommendations, keywords and sentiment information are used, and then, the similarity and clustering of the extracted media are assessed. As a result, script mining analysis based on the attributes that include actual information of media is considerably better than that based on types or a range of metadata attributes. Therefore, the proposed knowledge expansion method achieves significant results and shows an excellent performance in multimedia recommendation.

On Leveraging Machine and Deep Learning for Throughput Prediction in Cellular Networks: Design, Performance, and Challenges

The highly dynamic wireless communication environment poses a challenge for many applications (e.g., adaptive multimedia streaming services). Providing accurate TP can significantly improve performance of these applications. The scheduling algorithms in cellular networks consider various PHY metrics, (e.g., CQI) and throughput history when assigning resources for each user. This article explains how AI can be leveraged for accurate TP in cellular networks using PHY and application layer metrics. We present key architectural components and implementation options, illustrating their advantages and limitations. We also highlight key design choices and investigate their impact on prediction accuracy using real data. We believe this is the first study that examines the impact of integrating network-level data and applying a deep learning technique (on PHY and application data) for TP in cellular systems. Using video streaming as a use case, we illustrate how accurate TP improves the end user's QoE. Furthermore, we identify open questions and research challenges in the area of AI-driven TP. Finally, we report on lessons learned and provide conclusions that we believe will be useful to network practitioners seeking to apply AI.

Development of Smart Vehicle Security and Entertainment System SSES using Raspberry Pi

This paper deals with development of a Vehicle Security and Entertainment System, which is being used to monitor, track the vehicle, and to offer local entertainment system. The development system makes used of two embedded devices to split the entertainment system from the security system to ensure isolation and security. The security system is equipped with camera, distress signal switch and GPS/GPRS module to track, report a problem, and monitor the vehicle by sending data to a centralized database server where vehicle owner can access and retrieve these data to guarantee the safety of the passengers and the vehicle too. The second system is the entertainment system, where this system uses a powerful Intel atom embedded device and local network to allow users to connect and offer entertaining services. These services include, E-Book library and multimedia streaming. The main concept of research to develop a low cost system to secure and entertain passengers on vehicles like buses, train and even cars. The development is cost effective and as well as can be modified to add extra modules or to develop extra entertainment services. If the vehicle is stolen the system is able to send a distress signal to the owner or company. They can help the passengers by monitoring through the vehicle camera. In this research we have successfully developed and tested the system.

Digital Twin for Metasurface Reflector Management in 6G Terahertz Communications

The performance demands from data-intensive applications, such as multimedia streaming, as well as the growing number of devices connecting to the Internet, will increase the need for higher capacity wireless communication links. The research community has recently explored regions of the spectrum, including the Terahertz band (0.1 THz to 10 THz), that are underutilised for communications. THz frequencies come with a plethora of special challenges, one of which is the very narrow effective beam, thereby requiring a Line of Sight (LoS) between sender and receiver. Researchers have explored the use of reflectors that can redirect beams around blockages. In this paper, we propose a THz signal guidance system where a Digital Twin is used to model, predict and control the signal propagation characteristics of an indoor space. Our approach finds the best THz signal path from the base station to the mobile target via the tunable metamaterial walls, avoiding obstacles as needed, using geometric (ray tracing), path loss and Terahertz Potential Field (THzPF) models. With this knowledge, the digital twin guides the selection of antenna strips at a base station and the reflectors along the signal path. A top-view camera, with advanced image processing, provides context updates (obstacle and mobile target locations) to the digital twin. The image processing system also senses factors like water vapour concentration, and the material composition and surface roughness of obstacles. Such factors affect propagation strength, and the digital twin modifies the beam paths to adapt. Simulation results have shown the efficiency of our control system to maintain a reliable signal connection while minimising the use of antenna and reflector strips. Our system is the first proposal that maximises THz signal-to-noise ratio (SNR) through such a dynamic and robust control system, which integrates image processing of a room with base station configuration.

Interoperability and Data Storage in Internet of Multimedia Things: Investigating Current Trends, Research Challenges and Future Directions

Internet of Things (IoT) has widely been accepted as a promising paradigm for connecting a large number of resource-constrained miniature sensor nodes that have the ability to sense the deployed environment. They have found their applications in various aspect of our daily lives. However, these nodes are mostly restricted to sense only the scalar data. Nowadays, multimedia sensor nodes are gaining significant attention due to their ability to collect scalar as well as multi-dimensional data. These nodes are considered as the foundation of Internet of Multimedia Things (IoMT) and are shaping the perception of IoT. Multimedia data have stringent requirements in terms of reliability, latency, storage, bandwidth, and Quality of Service (QoS). To provide seamless and interoperable communication in IoMT, the underlying protocol stacks need to fulfill these stringent requirements. However, the heterogeneous nature of multimedia sensors makes interoperability a challenging task to fulfill. To understand the challenges faced by seamless and interoperable communication in IoMT, we provide a comprehensive review of the existing protocol stacks of IoMT and analyze their feasibility for multimedia streaming applications. Data storage of multimedia applications is another area that requires immediate attention of the research community. For this purpose, we study cloud as an entity to facilitate multimedia applications of IoMT. The instances of multimedia cloud are analyzed and a number of shortcomings are identified that pave the way for edge computing in IoMT. Finally, we present a case study that shows the significance of our work. The case study portrays an in-home patient monitoring system with an interoperable communication among the connected multimedia streaming devices at home, and healthcare practitioners at hospital. The case study also highlights the importance of uninterrupted data storage and retrieval at the network edge and multimedia sensor nodes.

Cloud-Based Implementation of an Automatic Coverage Estimation Methodology for Self-Organising Network

One of the main concerns of telecommunications operators is related to network coverage. A weak coverage can lead to a performance decrease, not only in the user experience, when using the operators' services, such as multimedia streaming, but also in the overall Quality of Service. This paper presents a novel cloud-based framework of a semi-empirical propagation model that estimates the coverage in a precise way. The novelty of this model is that it is automatically calibrated by using drive test measurements, terrain morphology, buildings in the area, configurations of the network itself and key performance indicators, automatically extracted from the operator's network. Requirements and use cases are presented as motivations for this methodology. The results achieve an accuracy of about 5 dB, allowing operators to obtain accurate neighbour lists, optimise network planning and automate certain actions on the network by enabling the Self-Organising Network concept. The cloud implementation enables a fast and easy integration with other network management and monitoring tools, such as the Metric platform, optimising operators' resource usage recurring to elastic resources on-demand when needed. This implementation was integrated into the Metric platform, which is currently available to be used by several operators.

HDA Video Transmission Scheme for DASH

In recent years, with the development of Internet communication technology, more and more people tend to get information through the network. And people prefer multimedia video streaming services. Traditional streaming media technology cannot meet people's needs because of its limitations. Recently, HTTP-based Dynamic Adaptive Streaming Over HTTP (DASH) has emerged as a new approach. In this paper, we consider two hybrid digital and analog video transmission schemes for DASH and propose three methods of enhancing the video quality of experience (QoE) of DASH users. First of all, considering the importance of data to video quality, we propose an energy-aware recombination method of reorganizing and packaging data and define the priority of the generated DASH layer in transmission. Second, we design an adaptive bitrate allocation algorithm to improve bandwidth utilization and video quality. Finally, we propose a retransmission mechanism to address the situation in which the digital stream at the receiving end cannot be decoded due to channel distance errors. Experiments show that our two schemes are superior to traditional DASH schemes.

Quality of Experience for Streaming Services: Measurements, Challenges and Insights

Over the last few years, the evolution of network and user handsets’ technologies, have challenged the telecom industry and the Internet ecosystem. Especially, the unprecedented progress of multimedia streaming services like YouTube, Vimeo and DailyMotion resulted in an impressive demand growth and a significant need of Quality of Service (QoS) (e.g., high data rate, low latency/jitter, etc.). Mainly, numerous difficulties are to be considered while delivering a specific service, such as a strict QoS, human-centric features, massive number of devices, heterogeneous devices and networks, and uncontrollable environments. Thenceforth, the concept of Quality of Experience (QoE) is gaining visibility, and tremendous research efforts have been spent on improving and/or delivering reliable and added-value services, at a high user experience. In this paper, we present the importance of QoE in wireless and mobile networks (4G, 5G, and beyond), by providing standard definitions and the most important measurement methods developed. Moreover, we exhibit notable enhancements and controlling approaches proposed by researchers to meet the user expectation in terms of service experience.

A Multipath Packet Scheduling Approach based on Buffer Acknowledgement for Congestion Control

Abstract Congestion is an important concern in both wired and wireless communication systems. Several technologies are in use for the data link, network, and transport layer to manage congestion. Conventional congestion control approaches are unreliable for transport layer protocols by means of congestion control mechanisms utilized for multimedia streaming. Packets that schedule flow control to employ multiple network interfaces to smoothly transmit streaming data play an important role in congestion control by overwhelming the intermediate node’s buffer and causing packet loss. In this paper, we propose a Multipath Packet Scheduling (MP-PS) approach to efficiently stream the data packets in multiple paths. It consists of a Multi-Path Packet Scheduler (MPS) to perform the path scheduling based on the path scheduling delay probability, and a Multipath Congestion Control (MCC) to regulate the congestion control through an explicit acknowledgment for the rate of transmission control based on packet delivery rate and buffer availability. It aims to reduce packet loss and improve the throughput utilizing the MP-PS approach. The proposed approach has been extensively simulated by means of a simulator and it showed improvised performance in provisions of throughput and buffer utilization when evaluated with the conventional approach.

Multimedia quality evaluation model in streaming service environments

Recently, mobile broadcast services such as digital media broadcasting (DMB) have generated a rapid increase in multimedia services via the internet compared to traditional cable or satellite delivery. Multimedia via the internet is consumed under different network conditions and through various devices. In this study, we propose a multimedia quality measurement model to assess quality consumes perspective. First, we select the parameters that affect the quality of multimedia at both the application and network levels, and then use these parameters to produce multiple altered versions of an original video. For each video and device, participants provide a mean opinion score (MOS). After determining the effect of parameters on videos and devices. Multiple regression on the MOS dataset collected from the subjects is applied to devise a model called MOS multimedia streaming (MOSMS). Finally, dividing the collected data as a training set and a test set, we validate the new model.

Framework for Multimedia Service using Multicast in CVCN Network

Vehicle communication networks have some deficient network resources to support a vast multimedia service including safety driving information, video, news and some broadcast relayed from the playgrounds such as professional baseball games for autonomous vehicles. This paper deals with the framework for providing seamless multimedia service including safety driving information using multicast in cooperatedconnected vehicle communication network (CVCN). It adopts smart-switch (SS) and smart intelligent multicast agent(SIMA) to support the seamless multimedia service. The SS manages and switches multimedia streams through SIMA in CVCN network. The SIMA to operate as an access point, is composed of multicast supporting part and control part of mobile devices/autonomous vehicles in CVCN network. Therefore this proposed technique using SS and SIMA within CVCN network is a new framework for multimedia service that can disperse the load of server.

A Novel Stream Cipher for Multimedia Security A Novel Stream Cipher for Multimedia Security A Novel Stream Cipher for Multimedia Security A Novel Stream Cipher for Multimedia Security A Novel Stream Cipher for Multimedia Security A Novel Stream Cipher for Multimedia Security A Novel Stream Cipher for Multimedia Security A Novel Stream Cipher for Multimedia Security A Novel Stream Cipher

In the last decades the tremendous usage of multimedia data like audio, video and images through communication channels create a need on the security over networks. Since multimedia content utilize large amount of storage for storing images, audio and video, classical cryptographic algorithms such as DES, AES are not efficient in encrypting multimedia data. In future these data are represented as media stream, like real time audio and video. Therefore it is urgent need to protect the multimedia data from attackers in between communication channels. In this paper we propose a new algorithm that encrypt and decrypt compressed multimedia stream of image or audio or video. The compression results in less time in encrypting data because more compression results in less data volume. Our work ensures that multimedia data streams can be secured according to the requirements of the current scenario.

QoE Management of Multimedia Streaming Services in Future Networks: A Tutorial and Survey

We provide in this paper a tutorial and a comprehensive survey of QoE management solutions in current and future networks. We start with a high level description of QoE management for multimedia services, which integrates QoE modelling, monitoring, and optimization. This followed by a discussion of HTTP Adaptive Streaming (HAS) solutions as the dominant technique for streaming videos over the best-effort Internet. We then summarize the key elements in SDN/NFV along with an overview of ongoing research projects, standardization activities and use cases related to SDN, NFV, and other emerging applications. We provide a survey of the state-of-the-art of QoE management techniques categorized into three different groups: a) QoE-aware/driven strategies using SDN and/or NFV; b) QoE-aware/driven approaches for adaptive streaming over emerging architectures such as multi-access edge computing, cloud/fog computing, and information-centric networking; and c) extended QoE management approaches in new domains such as immersive augmented and virtual reality, mulsemedia and video gaming applications. Based on the review, we present a list of identified future QoE management challenges regarding emerging multimedia applications, network management and orchestration, network slicing and collaborative service management in softwarized networks. Finally, we provide a discussion on future research directions with a focus on emerging research areas in QoE management, such as QoE-oriented business models, QoE-based big data strategies, and scalability issues in QoE optimization.

Building $k$ -Protected Routes in Multi-Hop Cognitive Radio Networks

In cognitive radio networks (CRNs), the established communication sessions between secondary users (SUs) may be affected or even get interrupted because the SUs need to relinquish a spectrum when the primary users (PUs) become active again. On detecting PU activities, the SUs on the interrupted links either switch to another link operating on another spectrum fragment using the same one-hop path, or the SUs seek for an alternative multi-hop backup path. In either approach, the communication session is destined to experience a delay or even gets interrupted, which is intolerable to quality of service-sensitive applications such as multimedia streaming or audio/video conferencing. In this paper, we study the problem of building ${k}$ -protected routes in CRNs. A ${k}$ -protected route consists of a set of main link s with preassigned backup links and backup path s so that the ${k}$ -protected route is guaranteed to endure ${k}$ PU appearances without being interrupted. For a CRN, we find a ${k}$ -protected route for each session request and maximize the number of sessions that the CRN can support. We propose both centralized and distributed algorithms for the ${k}$ -protected routing problem. Simulation results show that our ${k}$ -protected routes outperform existing opportunistic spectrum switching approaches regarding delay and interruption rate.

A Routing Delay Reduction Mechanism Based on Dynamic Switching through Congestion Prediction in Wireless Mobile Network

The advancement in wireless mobile networks (WMNs) and their technologies are becoming the most popular technologies today and are widely used in various communication services. Devices for communication are equipped with wireless network interfaces through which they can efficiently stream data to their network-wide devices. However, due to the extreme use of different services, and TCP incapacity to control congestion, it causes a high overload in wireless communication, which makes the network extremely unstable and congested. Conventional routing methods with congestion control mechanisms for multimedia streams are not reliable for transport layer protocols. In such a case, it makes wireless networks very complex and challenging to perform smooth routing due to its dynamic characteristics and resource constraints. It can be overcome through scheduling flow control in multiple network interfaces for smooth packets streaming data, and even it can play an important role in congestion control by overwhelming the buffers of intermediate nodes and reduction in packet loss. In this paper, we propose a Routing Delay Reduction Approach (RDRA) based on dynamic switching by estimating the transmission rate and delay probability through congestion prediction. The goal of RDRA is to reduce routing latency and packet loss and improve throughput at different traffic rates. Experimental evaluation measures at different traffic rate variation it shows an improved performance in terms of throughput and low latency compared to the related protocols.

Secure color image cryptosystem based on chaotic logistic in the FrFT domain

Recently, the digital multimedia security technology has been an interesting research theme due to fast advancement in employing real time multimedia through Internet and wireless networks. The market of multimedia streaming, such as exclusive video on demand (VoD) is a huge multi- billion-dollar market. This market is threatened by hackers. The multimedia streaming industry needs a cryptosystem that is both fast and secure. Chaotic cryptosystems have been proposed by many researchers in order to promote communication security. However, these chaotic schemes have some major problems, such as unacceptable expansion of data, slow performance speed, and shortcomings against differential attack. Therefore, this paper provides an efficient Fractional Fourier Transform (FrFT)-based logistic map (LM) color image encryption scheme by applying a 2D LM on FrFT. In the proposed FrFT-based LM color image encryption scheme, the 2D LM is employed as a confusion step to scramble the color image pixel positions in the FrFT and confuse the relationship between the cipherimage and the plainimage. For enhancing the encryption performance characteristics of the 2D LM under the FrFT, the angle of the FrFT is taken as an extra additional key in encryption. The proposed FrFT-based LM color image encryption scheme is examined and investigated using visual inspection, entropy, histograms, encryption quality, noise tests, and differential analysis. The obtained simulation tests demonstrate and verify the effectiveness of the FrFT-based LM color image encryption scheme. Moreover, our results also show a significant improvement in the performance of the confusion property with our proposed 2D LM encryption scheme using the FrFT. Also, we compared the proposed cryptosystem with recent state-of-the-art cryptosystems. Experimental results show that our proposed image cryptosystem is highly secure from the cryptographic point of view. Furthermore, the obtained test results ensured the superiority of our proposed cryptosystem for digital image transmission compared to the recent state-of-theart cryptosystems.

Collective Scheme of Transmission of Video Packet to Develop Cross Layer to Support QOS for Manet

MANETs have become very predominant when it comes to wireless communications. Multimedia streaming is rapidly increasing over all social networks. In this part of multimedia communication, Mobile – Ad – Hoc network (MANET) has established its importance to deliver enhanced Quality of Service (QoS). However, it can be stated that when it comes to multimedia applications, MANETs still need some improvisation especially when it comes to video transmissions. There still exists few difficulties when it comes to MANETs that are such as limited physical security and resources, less detection of malicious nodes, lack of authorization facilities etc. To avoid all these and to improvise the network use of a new design approach known as cross-layer approach is being used extensively by various researchers.. The cross layer approach is used to efficiently make use of all the network resources in a communication channel and provide the best adaptability. In this paper, we have proposed a model that will avoid packet loss and will rebuild the video packets at the receiver end thereby improving the overall performance of the network.

Towards Efficient Multi-Channel Data Broadcast for Multimedia Streams

Multi-channel data broadcast attracts increasingly focus in recent years. For the complex and large multimedia data like images, audios, and videos etc, multi-channel data broadcast is a promising approach to mitigate various limitations of data dissemination in mobile environment, such as narrow bandwidth, unreliable connections, and battery limitation. However, existing data broadcast schemes are inefficient for employing multiple channels. In this paper, we present five novel multimedia data broadcast schemes (SDAA, ISDAA, LDAA, AEA, and COA) specifically designed for wireless multichannel communications. The key idea behind those schemes is to utilize SVC (Scalable Video Coding) to generate data segments with different qualities and implement indexing and channel assignment to minimize the expected waiting time for clients. In terms of waiting time minimization, we prove theoretically that SDAA is a $\tfrac{4}{3}$43-approximation algorithm and ISDAA is a $\tfrac{6}{5}$65-approximation algorithm for global allocation, and AEA can achieve locally optimal solution. We show that integrating SDAA and AEA form a best schedule for practical applications. We provide numerical experiments by using a SVC dataset and a YouTube dataset to evaluate the system performance and prove the efficiency of our schemes. We also propose a multiple video broadcast framework and analyze its performance.

Real-time Multimedia Transmission in open group Environment of MANETsusing SLIM+ Protocol: A Performance Evaluation

Although the mobility of nodes or computing devices may cause problem of link failure, a careful strategy used for routing protocols resolve one of the major issue associated with MANETs. The multicast routing protocols adopt either a tree-based configuration structure or a mesh-based configuration structure to maintain their state in stressed conditions posed to them in various scenarios. The research paper focuses on evaluating the performance of routing scheme used by SLIM+ for real-time multimedia streaming multicast in open group environment of MANET. Performance metric used is Throughput and Normalized Routing Load; comparing SLIM+ with its competitive and most commonly used MAODV and PUMA routing protocols for multicasting. It then observed that performance of SLIM+ is promising.