Video Communication System Research Articles

Feasibility study of applying an online video communication system in tele-mentoring for guided robotic surgery

Feasibility study of applying an online video communication system in tele-mentoring for guided robotic surgery

Deep Learning-Based Cross-Layer Power Allocation for Downlink Cell-Free Massive Multiple-Input–Multiple-Output Video Communication Systems

We propose a deep learning-based cross-layer power allocation method for asymmetric cell-free massive MIMO video communication systems. The proposed cross-layer approach considers physical layer channel state information (CSI) and the application layer rate distortion (RD) function, and it aims to enhance video quality in terms of peak signal-to-noise ratio (PSNR). Our study develops a decentralized deep neural network (DNN) model to capture intricate system patterns, enabling accurate and efficient power allocation decisions. The proposed cross-layer approach includes unsupervised and hybrid (supervised/unsupervised) learning models. The numerical results show that the hybrid method achieves convergence with just 50% of the iterations required by the unsupervised learning model and that it achieves a 1 dB gain in PSNR over the baseline physical layer scheme.

Depth from motion parallax: Deictic consistency, eye contact, and a serious problem with Zoom.

The dynamics of head and eye gaze between two or more individuals displayed during verbal and nonverbal face-to-face communication contains a wealth of information and is used for both volitionary and unconscious signaling. Current video communication systems convey visual signals about gaze behavior and other directional cues, but the information they carry is often spurious and potentially misleading. I discuss the consequences of this situation, identify the source of the problem as a more general lack of deictic consistency, and demonstrate that using display technologies that simulate motion parallax are both necessary and sufficient to alleviate it. I then devise an avatar-based remote communication solution that achieves deictic consistency and provides natural, dynamic eye contact for computer-mediated audiovisual communication.

Human action analysis models in artificial intelligence based proctoring systems and dataset for them

This paper describes the approach for building a specialized model for human action analysis in AI-based proctoring systemsand proposes a prototype of dataset which contains data specific to the application area. Boosted development of machine learningtechnologies, the availability of devicesand the access to the Internet are skyrocketing the development of the field of distance learning. And in parallel with distance learning systemstheAI-based proctoring systems, that provide the functional analysis of student work by imitating the teacher's assessment, are developing as well. However, despite the development of image processing and machine learning technology, the functionality of modern proctoring systems is still at a primitive level. Within the image processing functionality, they focus entirely on tracking students' faces and do not track postures and actions. At the same time, assessment of physical activity is necessary not only as part of the learning process, but also to keep students healthy according to regulatory requirements, as they spend the entire duration of learning process in front of computers or other devices during the distance learning. In existing implementations, this process falls entirely on the shoulders of teachers or even the studentsthemselves, who work through the lesson materials or tests on their own. Teachers, at the same time, have toeither establish contact through video communication systems and social media (TikTok, Instagram) and/or analyse videos of students doing certain physical activities in ordertoorganise physical activities evaluation. The lack of such functionality in AI-based proctoring systemsslows down the learning process and potentially harms students' health in the long run. This paper presents additional functionality requirements forAI-based proctoring systemsincluding human action analysis functionality to assess physical activity and to monitor hygiene rules for working with computers during the educational process. For this purpose, afoundation modelcalledInternVideo was used for processing and analysis of student's actions. Based on it, the approach for building a specialized model for student action analysis was proposed. It includes two modes of student activity evaluation during the distance learning process: static and dynamic. The static mode (aka working phase) analyses and evaluates the student's behavior during the learning and examination process, where physical activity is not the main component of learning. The dynamic mode (aka physical education mode) analyses and assesses the student who purposefully performs physical activity (physical education lesson, exercises for children during the lesson, etc.). A prototype dataset designed specifically for this application area has also been proposed.

Cryptanalysis of a Multiround Image Encryption Algorithm Based on 6D Self-Synchronizing Chaotic Stream Cipher

Recently, a chaotic secure video communication system based on FPGA is proposed, which essentially encrypts the original image data of each frame in the video in multiple rounds by using the 6D self-synchronizing chaotic stream cipher. In this paper, the security performance of the multiround encryption algorithm is analyzed based on divide-and-conquer attack. In the case of one round encryption, the keys [Formula: see text] [Formula: see text] can be deciphered by setting 30 appropriate initial conditions according to known-plaintext attack. After that, according to chosen-ciphertext attack, the chaotic iterative equation of the decryption end is degenerated into a linear one if ciphertexts are all set to zero. Under this condition, the equations between the unknown keys and the plaintext-ciphertext pairs can be obtained by setting 24 appropriate initial conditions, and the keys [Formula: see text] [Formula: see text] can be deciphered by solving the equations in Mathematica. Secondly, in order to reduce the multiplication times of the unknown keys in the case of two-round encryption, the number of pixels in an image can be selected as little as possible. According to chosen-ciphertext attack, when the number of the pixels in an image is only one, the keys [Formula: see text] [Formula: see text] can be deciphered by setting 30 appropriate initial conditions. Then, when the number of pixels in an image is two, the keys [Formula: see text] [Formula: see text] can be deciphered by setting 24 appropriate initial conditions. However, in the case that the encryption round is three or more, the keys cannot be deciphered by the attack method proposed in this paper. The analysis results show that the multiround image encryption algorithm is not secure when the number of encryption rounds is one or two.

Design and Implementation of Two Immersive Audio and Video Communication Systems Based on Virtual Reality

Due to the impact of the COVID-19 pandemic in recent years, remote communication has become increasingly common, which has also spawned many online solutions. Compared with an in-person scenario, the feeling of immersion and participation is lacking in these solutions, and the effect is thus not ideal. In this study, we focus on two typical virtual reality (VR) application scenarios with immersive audio and video experience: VR conferencing and panoramic live broadcast. We begin by introducing the core principles of traditional video conferencing, followed by the existing research results of VR conferencing along with the similarities, differences, pros, and cons of each solution. Then, we outline our view about what elements a virtual conferencing room should have. After that, a simple implementation scheme for VR conferencing is provided. Regarding panoramic video, we introduce the steps to produce and transmit a panoramic live broadcast and analyze several current mainstream encoding optimization schemes. By comparing traditional video streams, the various development bottlenecks of panoramic live broadcast are identified and summarized. A simple implementation of a panoramic live broadcast is presented in this paper. To conclude, the main points are illustrated along with the possible future directions of the two systems. The simple implementation of two immersive systems provides a research and application reference for VR audio and video transmission, which can guide subsequent relevant research studies.

Toward Holographic Video Communications: A Promising AI-Driven Solution

Real-time holographic video communications enable immersive experiences for next-generation video services in the future metaverse era. However, high-fidelity holographic videos require high bandwidth and significant computation resources, which exceed the transferring and computing capacity of 5G networks. This article reviews state-of-the-art holographic point cloud video transmission techniques and highlights the critical challenges of delivering such immersive services. We further implement a preliminary prototype of an AI-driven holographic video communication system and present critical experimental results to evaluate its performance. Finally, we identify future research directions and discuss potential solutions for providing real-time and high-quality holographic experiences.

Analysis of the functionality of voice and video communication systems

The article contains a comparison of the functionality and qualitative verification of voice and video communication systems, through tests of voice message shift in time, at different data rates, tests of system use cases and the study of the popularity of applications in various environments and age groups, thanks to an electronic survey . The systems examined were: Microsoft Teams, Zoom, Signal, WhatsApp, Cisco Webex Meetings. The following hypothesis was made: Voice and video communication systems are very popular systems among users, and their functional capabilities are similar.

Multi-feature fusing local directional ternary pattern for facial expressions signal recognition based on video communication system

In the field of Automatic Facial Expression Signal Recognition (AFESR) at video communication system, the fusing feature extraction is playing an extremely important role in recognition accuracy. This paper presents a new feature extraction method, Multi-Feature Fusing Local Directional Ternary Pattern (MFF-LDTP) which keeps more feature information and improvs the robustness under the uncontrollable and wild environment for AFESR. Firstly, the MFF-LDTP operator obtains the global feature of facial expression by Principal Components Analysis (PCA). Secondly, the MFF-LDTP enhances traditional Local Directional Ternary Pattern （LDTP）by using a “kirsch mask” to replace the Frei-Chen masks and selects the threshold for facial expression signal recognition. To effectively avoid generating invalid features, the MFF-LDTP extracts the local feature of eye and mouth which are significant regions by ELDTP. Thirdly, The MFF-LDTP final feature vector includes the linear connection of global and local features. The recognition rate for the extended JAFFE database is 96.5%. And the extended JAFFE includes captured sample images under an uncontrollable and wild environment. The experimental results show that the proposed MFF-LDTP achieved significant improvement and outperformed some state-of-the-art methods.

Computational see-through screen camera based on a holographic waveguide device.

This study proposes a novel computational imaging system that integrates a see-through screen (STS) with volume holographic optical elements (vHOEs) and a digital camera unit. Because of the unique features of the vHOE, the STS can function as a holographic waveguide device (HWD) and enable the camera to capture the frontal image when the user gazes at the screen. This system not only provides an innovative solution to a high-quality video communication system by realizing eye-contact but also contributes to other visual applications due to its refined structure. However, there is a dilemma in the proposed imaging system: for a wider field of view, a larger vHOE is necessary. If the size of the vHOE is larger, the light rays from the same object point are diffracted at different Bragg conditions and reflect a different number of times, which causes blurring of the captured image. The system imaging process is analyzed by ray tracing, and a digital image reconstruction method was employed to obtain a clear picture in this study. Optical experiments confirmed the effectiveness of the proposed HWD-STS camera.

Coexistence of light emission and detection in a III-nitride quantum well diode.

The demand for on-chip multifunctional optoelectronic systems is increasing in today's Internet of Things era. III-nitride quantum well diodes (QWDs) can transmit and receive information through visible light and can be used as both light-emitting diodes (LEDs) and photodetectors (PDs). Spectral emission-detection overlap gives the III-nitride QWD an intriguing capability to detect and modulate light emitted by itself. In this paper, the coexistence of light emission and detection in a III-nitride QWD is experimentally demonstrated, and a wireless video communication system through light is established. When approximately biasing and illuminating at the same time, the III-nitride QWD can achieve light emission and detection simultaneously. This work provides a foundation for the development of multifunctional III-nitride QWDs and the realization of device-to-device data communication.

Overcoming the practical restrictions in H.266/VVC-based video communication systems by a PI bit rate controller

Overcoming the practical restrictions in H.266/VVC-based video communication systems by a PI bit rate controller

Notes From the Field: A Voice-Activated Video Communication System for Nurses to Communicate With Inpatients With COVID-19.

With the relaxing of telehealth regulations through the Health Insurance Portability and Accountability Act (HIPAA) waiver notification for Telehealth Remote Communications during the COVID-19 Nationwide Public Health Emergency, our organization had the opportunity to pilot an innovative virtual care solution using a modified consumer-grade voice-activated video communication system (Amazon Echo Show 8) within one inpatient COVID-19 unit. In this brief report, we describe our experiences with implementing the system and general feedback from clinicians, and discuss areas for future development required to enable future scaling of this solution. Our pilot demonstrates the feasibility of deploying a consumer-grade voice assistant device in COVID-19 patient rooms. We found the devices engaging due to the voice technologies and Alexa functionalities for both clinician and patient entertainment. To enable future deployment at scale, enhancements to the Echo Show and data analytics will need to be further explored.

Stroke Telemedicine for Arizona Rural Residents, the Legacy Telestroke Study.

Background:Efficacy of telemedicine for stroke was first established by the Stroke Team Remote Evaluation Using a Digital Observation Camera (STRokE DOC) trials in California and Arizona. Following these randomized controlled trials, the Stroke Telemedicine for Arizona Rural Residents (STARR) network was the first telestroke network to be established in Arizona. It consisted of a 7 spoke 1 hub telestroke system, and it was designed to serve rural, remote, or neurologically underserved communities.Objective:The objective of STARR was to establish a multicenter state-wide telestroke research network to determine the feasibility of prospective collection, recording, and regularly analysis of telestroke patient consultations and care data for the purposes of establishing quality measures, improvement, and benchmarking against other national and international telestroke programs.Methods:The STARR trial was open to enrollment for 29 months from 2008 to 2011. Mayo Clinic Hospital, Phoenix, Arizona served as the hub primary stroke center and its vascular neurologists provided emergency telestroke consultations to seven participating rural, remote, or underserved spoke community hospitals in Arizona. Eligibility criteria for activation of a telestroke alert and study enrollment were established. Consecutive patients exhibiting symptoms and signs of acute stroke within a 12 h window were enrolled, assessed, and treated by telemedicine. The state government sponsor, Arizona Department of Health Services' research grant covered the cost of acquisition, maintenance, and service of the selected telemedicine equipment as well as the professional telestroke services provided. The study deployed multiple telemedicine video cart systems, picture archive and communications systems software, and call management solutions. The STARR protocol was reviewed and approved by Mayo Clinic IRB, which served as the central IRB of record for all the participating hospitals, and the trial was registered at ClinicalTrials.gov.Results:The telestroke hotline was activated 537 times, and ultimately 443 subjects met criteria and consented to participate. The STARR successfully established a multicenter state-wide telestroke research network. The STARR developed a feasible and pragmatic approach to the prospective collection, storage, and analysis of telestroke patient consultations and care data for the purposes of establishing quality measures and tracking improvement. STARR benchmarked well against other national and international telestroke programs. STARR helped set the foundation for multiple regional and state telestroke networks and ultimately evolved into a national telestroke network.Conclusions:Multiple small and rurally located community hospitals and health systems can successfully collaborate with a more centrally located larger hospital center through telemedicine technologies to develop a coordinated approach to the assessment, diagnosis, and emergency treatment of patients manifesting symptoms and signs of an acute stroke syndrome. This model may serve well the needs of patients presenting with other time-sensitive medical emergencies.Clinical Trial Registration number: NCT00829361.

ANALYSIS OF PEER-TO-PEER NETWORKS TRENDS

The concept and nature of peer-to-peer networks are analyzed, a short history of their development is researched and presented. The first network of this type (Usenet), its features and prerequisites are described. Three types of peer-to-peer network architectures are considered – pure, federal and hybrid; advantages and disadvantages of each. The hybrid architecture is the most widely used today, as using a central server to connect nodes is a promising approach. Three generations of peer-to-peer networks are considered and their architectural features are presented. The first generation involved only file sharing, its feature was the use of a central server, which had information about which node contains which file. The second generation was characterized by the absence of a central server, but there was no indexing of nodes and data, which caused long delays in finding a node to connect. The third generation is more advanced, because it provides storage in each node of hash tables with information about other network members. The main advantages and disadvantages of peer-to-peer network architectures are investigated. A comparative analysis of peer-to-peer and multi-peer networks is performed. It is determined that it is more expedient to use decentralized networks in comparison with centralized ones, especially in cases where anonymity, confidentiality, fault tolerance and scalability are a priority. The most known directions of practical use of peer-to-peer networks are investigated. Today they are used in chat systems, banks, cryptocurrency systems, video communication systems. Decentralized systems are also used when working with digital wallets, because it makes online payments more effective.

METHODS OF PROTECTION OF INFORMATION RESOURCES IN TELECOMMUNICATION SYSTEMS

The article is devoted to the study of theoretical and methodological principles and practical recommendations for the use of information resource protection technology for the effective functioning of video communication systems. With the development of international relations in society, the introduction of information and telecommunication technologies, Ukraine is actively developing and implementing video conferencing technology, creating and implementing virtual events, webinars, video conferencing and online broadcasts. The use of such systems allows you to get a variety of information, use textual and visual graphics, and so on. For video conferencing systems are relevant threats to information security, which are inherent in any information and telecommunications system. One of the main problems of organizing a reliable video conferencing system is to ensure the optimal data rate at the maximum speed of audio and video processing. The main types of information are considered and the directions of maintaining information security of information and telecommunication systems in accordance with the legislation of Ukraine are determined. The main types of information security are related to the protection of confidentiality, integrity and accessibility and to the confirmation of authorship. To ensure the reliability of the video conferencing system, the protection of open information from unauthorized actions is used, which leads to its accidental or intentional modification or destruction, authorization of users. The tasks of user authorization are management of access rights, collection of statistics and acts as an additional means of ensuring the reliability of the system. Ensuring the protection of information resources is carried out through the use of means and methods of technical protection, implementation of organizational and technical measures of a comprehensive information protection system. Studies of these methods make it possible to distribute the load on all elements of the system in proportion to their resources and characteristics.

Evaluation of the effectiveness of handwashing training given to paramedic students remotely

Background and objectives: The COVID-19 pandemic has affected face to face medical education and training activities around the world. The aim of this study was to provide remote practical handwashing training to health sciences students and to measure the effectiveness of the training provided and to create a feedback model.
 Methods: Students of the Paramedic department were included in the study. Two virtual classrooms were created via Zoom Video Communication system. An 11-step handwashing algorithm was developed. Two hours of remote handwashing training was given. Participants were asked to apply the handwashing application they learned at their own location and to record videos. Application videos were evaluated and scored.
 Results: A total of 135 Term-1 and Term 2 students of the Paramedic department participated in the study. The duration of the evaluated videos was on average 57.67 ± 12.69 (34-95) seconds. Fifty-five (40.7%) of the participants successfully completed all the steps and their average success score was 10.3 ± 0.67 (8-11). The most failure (33.3%) in the process steps was the 9th step in which the wrists are rubbed with soap.
 Conclusion: Suitable teaching and feedback methods are required for medical and health science students who receive education and practical training remotely from home.
 Ibrahim Med. Coll. J. 2021; 15(2): 18-25

Video Archiving and Communication System (VACS): A Progressive Approach, Design, Implementation, and Benefits for Surgical Videos.

ObjectivesAs endoscopic, laparoscopic, and robotic surgical procedures become more common, surgical videos are increasingly being treated as records and serving as important data sources for education, research, and developing new solutions with recent advances in artificial intelligence (AI). However, most hospitals do not have a system that can store and manage such videos systematically. This study aimed to develop a system to help doctors manage surgical videos and turn them into content and data.MethodsWe developed a video archiving and communication system (VACS) to systematically process surgical videos. The VACS consists of a video capture device called SurgBox and a video archiving system called SurgStory. SurgBox automatically transfers surgical videos recorded in the operating room to SurgStory. SurgStory then analyzes the surgical videos and indexes important sections or video frames to provide AI reports. It allows doctors to annotate classified indexing frames, “data-ize” surgical information, create educational content, and communicate with team members.ResultsThe VACS collects surgical and procedural videos, and helps users manage archived videos. The accuracy of a convolutional neural network learning model trained to detect the top five surgical instruments reached 96%.ConclusionsWith the advent of the VACS, the informational value of medical videos has increased. It is possible to improve the efficiency of doctors’ continuing education by making video-based online learning more active and supporting research using data from medical videos. The VACS is expected to promote the development of new AI-based products and services in surgical and procedural fields.

141 Face Time’ for the First Time: Patients, Families and Junior Doctors

IntroductionOver the course of the COVID-19 pandemic, supporting effective communication between patients and their families has been a recognised challenge in the healthcare environment. Virtual communication via telecommunication and video-calling is more important than ever, but with minimal clinician education, preparation and relevant technological infrastructure available in the context of a global pandemic, we have recognised communication as an area for improvement as junior doctors working on a COVID-19 ward.MethodsWe interviewed via telephone 22 nominated next of kin relatives of patients admitted to a COVID-19 ward in the University Hospital of Llandough during May 2020 using a pre-prepared survey. We then provided relatives with the opportunity to engage with video-call updates from a doctor (with the patient’s permission). In appropriate scenarios, we used video calling to break bad news and to facilitate difficult communications with family members. These video calls were provided via Accurx, an NHS approved video communication system.ResultsInitial survey results showed an average understanding score of their relative’s current clinical plan of 5.5/10, with 63% of respondents saying they did not feel well informed. Nearly a quarter of respondents (22%) had received difficult news over the phone during the COVID-19 pandemic, and 86% said they would find video communication useful. Post-intervention survey results suggested a unanimous improvement in relative satisfaction, with relatives reporting an increased understanding around the admission, reassurance around the quality of care being given and less isolation from the patient.ConclusionsThe COVID-19 pandemic has provided novel communication challenges to physicians, promoting flexibility and adaptation to some of the core inter-personal skills we develop throughout training. Technology plays a huge role in this, and the use of video calling in particular can preserve non-verbal communication within the doctor-relative relationship and improve emotional connection between patients and their loved ones.

ИСПОЛНИТЕЛЬСКИЕ ИСКУССТВА В РОССИИ В КОНТЕКСТЕ ПАНДЕМИИ

This article is devoted to the modern history of performing arts during the pandemic. It examines the activities of authorities and theaters, concert organizations and concert organizers from 2020 to mid-2021. Countries plunged into self-isolation. The cultural sphere has been restructured, cultural contacts minimized, while video communication systems have evolved into virtual platforms in homes. The artists, left without full-fledged "live" concerts and performances were distressed. Halls could be accessed by documents and in very limited numbers. The article discusses two fundamental documents prepared by Rospotrebnadzor and appeared during this period: "Recommendations for Implementation of Measures Aimed at Prevention of the Spread of the New Coronavirus Infection (COVID-19) When Performing Activities of Theaters and Concert Organisations" and "On Measures to Limit the Spread of a New Coronavirus Infection (COVID-2019) on the Territory of the Russian Federation in Cases of Mass Events". Both documents were intensively discussed at various forums of performing arts managers in Russia.