Real-time Video System Research Articles

Proving the Difference between the Social Presence and Level of Interest according to the Non-Face-To-Face Teaching Method in Pre-School Teachers' Major Classes at Universities: focusing on Video Classes and Real-time Video Classes

본 연구의 목적은 유아교육 전공수업에서 비대면 수업 방식에 의해 사회적 실재감과 흥미 수준의 차이를 검증하는 것이다. 이를 위해 비대면 수업 방식인 동영상 수업과 실시간 화상 수업의 방법에 의해서 학습자들의 사회적 실재감과 흥미수준에 차이가 나타나는지 검증하기 위해서 실험 연구를 수행하였다. 연구를 위해서 충남의 B대학의 유아교육 전공 수업을 수강하는 학생 51명을 대상으로, 동영상 수업은 23명, 실시간 화상 수업은 28명으로 수행하였다. 동영상 수업은 사전에 제작된 수업 동영상을 정해진 기간 내에 수강을 하고, 추가로 부여된 학습 과제를 수행하는 방식으로 진행되었고, 실시간 화상 수업은 수업 시간으로 정해진 시간에 실시간 화상 시스템(ZOOM)에 접속을 해서 수업을 운영하였다. 학기가 시작되는 시점에 사회적 실재감과 흥미 수준을 측정하였고, 학기가 종료되는 시점에 사회적 실재감과 흥미 수준을 측정하였다. 수집된 자료는 두 집단의 비교를 위해서 공변량분산분석(ANCOVA)를 사용하여 분석하였다. 그 결과 흥미수준 전체는 집단 간 차이가 나타났고, 흥미 수준의 하위 요인 중 교육내용 선호, 교육활동의 가치, 교육 담당자 선호도, 교육기관에 대한 선호도는 집단 간 차이가 나타나지 않았고, 교육 활동 참여의 노력, 교육활동에 대한 유능감, 교육에 대한 또래 추천 의지는 집단 간 차이가 나타났다. 사회적 실재감 전체와 하위요인 중 영향력과 응집력만 집단 간 차이가 나타났다. 본 연구의 결과는 수업의 목적과 교육 내용을 고려하여 수업 방식에 대한 전략 수립을 위한 기반 자료를 제시한 것이 함의점이다.The purpose of this study is to verify the effect of non-face-to-face teaching methods on social presence and interest level in early childhood education classes. The subjects of this study were 51 students majoring in early childhood education at University B in Chungnam. The video class was attended by 23 people. And 28 people took the real-time video class. Video class is to take a pre-made class video within a set period. The real-time video class was conducted at a fixed time using a real-time video system (ZOOM). The preliminary survey measured the social presence and interest level at the beginning of the semester. And the post-morate survey measured the social presence and interest level at the end of the semester. The collected data were analyzed using ANCOVA for comparison between the two groups. As a result, among the overall interest level and sub-factors, the effort to participate in educational activities, competence in educational activities, and the will to recommend peers for education showed differences among groups. Among the sub-factors, there were no differences between groups in terms of preference for educational content, value of educational activities, preference for educators, and preference for educational institutions. Among the overall social presence and sub-factors, only influence and cohesion showed differences between groups. The result of this study is to present the basic data for establishing a strategy for the teaching method in consideration of the purpose and contents of the lesson.

Developing and testing a novel active-selection (ActSel) bycatch reduction device to quickly alternate trawls between capture and release configurations with real-time triggering

Bycatch reduction devices (BRDs) allow selective release of unwanted fish (bycatch) during fishing operations, while retaining target fish. Existing BRDs use passive methods, exploiting differences in fish behavior, size, and/or shape to separate bycatch from target species. Recent availability of practical systems transmitting real-time video from trawls to the towing vessel during routine fishing opens the possibility to develop active selection (ActSel) BRDs, devices that allow trawlers to selectively trigger fish release when bycatch species are observed.Development through numerical modeling, scale-model tests, and full-scale, at-sea trials, resulted in an ActSel BRD system that, when triggered, quickly (average 10 s) and reversibly moved a mesh panel between configurations covering a release opening or leading fish out of that opening. A hydrodynamic kite across that selection panel’s leading edge drove it between catch and release positions. Manipulation of control lines by a remotely-controlled electromechanical reel adjusted the kite’s orientation, determining movements of the mesh panel. Results of full-scale testing of this ActSel system under commercial fishing conditions while trawling for Pacific hake (Merluccius productus) showed that ActSel operation effectively and reversibly changed movement of all fish from normal passage toward the codend to moving toward the release opening. While our sea trials occurred in the Pacific hake fishery, the ActSel has applications to other trawl fisheries, particularly fisheries where real-time video systems are used (i.e., Alaska pollock (Gadus chalcogrammus) fishery).

Effect of Taking the Liberal Arts Course ‘Creative Thinking and Problem Solving’ on the Improvement of Creative Competencies of College Students in Science and Engineering －Focusing on Comparison Before and After COVID-19

This study was conducted to derive implications on how educational activities should be organized and operated for improving creative competency in online class situations by analyzing how it has changed in classes before and after COVID-19. These classes were taken by science and engineering students who took the ‘Creative Thinking and Problem Solving’ subject operated by N University. In order to achieve the goals of this study, a pre-post test related to creative competency was administered at the beginning and end of the semester to 92 students who took the face-to-face class in the second semester of 2019, and to 120 students who took the on-line class in the second semester of 2020. The research results are as follows: Creative competency was significantly improved in the face-to-face class, but not in the online class. Looking at each sub-competency of creative competency, both the challenge spirit and problem solving ability were significantly improved in the face-to-face class. Moreover, the student’s challenge spirit ability was significantly improved in the online class, but their problem solving ability was not significantly improved. These results were similar regardless of whether the instructor changed, or if the students’ grades changed. Also, the students’ gender had no bearing on these results either. Based on these research results, as well as on our educational goals and the content of the classes, the project activities involved in the ‘Creative Thinking and Problem Solving’ subject can be used in online classes in their current form. But this study suggested that strategies for improving students' problem-solving abilities need to be supplemented. Specifically, instructors should increase communication opportunities through the parallel use of the real-time remote video system, and should guide their students to become faithful to the team-based project activities through the sub-session function of the real-time remote video system. To this end, the university may consider changing two credits of two hours into two credits of three hours, or three credits of three hours. Universities also need to operate this subject in connection with extra-activities. It is also necessary for instructors to provide a support environment where students can freely meet using the real-time remote video system, and can engage in solving problems through their own initiative.

Research and design of cloud monitoring and management system for intelligent stereo garage

With the rapid development of the stereo garage, there are plenty of security problems appeared in stereo garage. The monitoring and management system of the stereo garage has attracted more and more attention. A cloud monitoring and management system for stereo garage is designed based on Web technology, which collects real-time data from the intelligent controller of the stereo garage, stores them in the cloud database. History and real-time data are studied to complete the functions of garage overview, real-time video monitoring, fault management, garage management, and system management. Deep confidence networks are proposed to conduct fault diagnosis for stereo garage, and the results are sent to the management interface of cloud portal (APP and website) for remote management. Test results show that the management efficiency of the stereo garage is significantly improved. The system guarantees the safe and reliable work of the stereo garage. It achieves better performance especially in the remote management and fault diagnosis.

Deep Learning-Based Video System for Accurate and Real-Time Parking Measurement

Parking spaces are costly to build, parking payments are difficult to enforce, and drivers waste an excessive amount of time searching for empty lots. Accurate quantification would inform developers and municipalities in space allocation and design, while real-time measurements would provide drivers and parking enforcement with information that saves time and resources. In this paper, we propose an accurate and real-time video system for future Internet of Things (IoT) and smart cities applications. Using recent developments in deep convolutional neural networks (DCNNs) and a novel vehicle tracking filter, we combine information across multiple image frames in a video sequence to remove noise introduced by occlusions and detection failures. We demonstrate that our system achieves higher accuracy than pure image-based instance segmentation, and is comparable in performance to industry benchmark systems that utilize more expensive sensors such as radar. Furthermore, our system shows significant potential in its scalability to a city-wide scale and also in the richness of its output that goes beyond traditional binary occupancy statistics.

The Intelligent Video Monitoring System Based on Cloud Storage and Safety

Cloud storage has braked through the limit of traditional methods to store the performance. It is able to connect the large number of various types of storage devices on the network, and thus form a very powerful storage capacity, which has successfully solved the problem of massive video data storage in intelligent video surveillance system. This article designs the intelligent video monitoring system based on cloud storage architecture, which can realize realtime video monitoring, video storage, device access, system management and other functions, all video data transmission, processing, storage management are processed by computer resources in management of video cloud platform , which greatly simplifies the application link, and saves the cost of customers. Cloud storage shared encoded video encryption and method for accessing policy updates used by this article have reached the requirement of cloud storage video security, and improve the efficiency of the access control policy updates significantly.

Dynamic and Static Task Allocation for Hard Real-Time Video Stream Decoding on NoCs

Hard real-time (HRT) video systems require admission control decisions that rely on two factors. Firstly, schedulability analysis of the data-dependent, communicating tasks within the application need to be carried out in order to guarantee timing and predictability. Secondly, the allocation of the tasks to multi-core processing elements would generate different results in the schedulability analysis. Due to the conservative nature of the state-of-the-art schedulability analysis of tasks and message flows, and the unpredictability in the application, the system resources are often under-utilised. In this paper we propose two blocking-aware dynamic task allocation techniques that exploit application and platform characteristics, in order to increase the number of simultaneous, fully schedulable, video streams handled by the system. A novel, worst-case response time aware, search-based, static hard real-time task mapper is introduced to act as an upper-baseline to the proposed techniques. Further evaluations are carried out against existing heuristic-based dynamic mappers. Improvements to the admission rates and the system utilisation under a range of different workloads and platform sizes are explored.

Directions of Development of Intelligent Real Time Video Systems

Real time video systems play a significant role in many fields of science and technology. The range of their applications is constantly increasing together with requirements to them, especially it concerns to real time video systems with the feedbacks. Conventional fundamentals and principles of real-time video systems construction are extremely redundant and do not take into consideration the peculiarities of real time processing and tasks, therefore they do not meet the system requirements neither in technical plan nor in informational and methodical one. Therefore, the purpose of this research is to increase responsiveness, productivity and effectiveness of real time video systems with a feedback during the operation with the high-speed objects and dynamic processes. The human visual analyzer is considered as a prototype for the construction of intelligent real time video systems. Fundamental functions, structural and physical peculiarities of adaptation and processes taking place in a visual analyzer relating to the information processing, are considered. High selectivity of information perception and wide parallelism of information processing on the retinal neuron layers and on the higher brain levels are most important peculiarities of a visual analyzer for systems with the feedback. The paper considers two directions of development of intelligent real time video systems. First direction based on increasing intellectuality of video systems at the cost of development of new information and dynamic models for video information perception processes, principles of control and reading parameters of video information from the sensor, adapting them to the requirements of concrete task, and combining of input processes with data processing. Second direction is associated with the development of new architectures for parallel perception and level-based processing of information directly on a video sensor matrix. The principles of annular and linear structures on the neurons layers, of close-range interaction and specialization of layers, are used to simplify the neuron network.

Real-time panorama video system using networked multiple cameras

Although panorama creation has been studied extensively, previous works still have limitations because they depend on customized hardware or post processing, resulting in high production cost and complexity. We propose and implement real-time panorama video system by using off-the-shelf embedded boards and camera modules. For real-time, we developed the performance improving methods such as reducing the homography computation load and employing multi thread structure. We conducted a series of experiments to investigate how different blending combinations and the number of threads affect the performance and image quality. We also analyzed the time consumption of threads and stitching steps.

High-Speed Simultaneous Image Distortion Correction Transformations for a Multicamera Cylindrical Panorama Real-time Video System Using FPGA

This paper presents a field-programmable gate array (FPGA) real-time multicamera cylindrical panorama video system. In this system, a novel simultaneous image transformation method has been studied (Chinese pattern pending No. 201310059020.1). Based on this method, perspective transformation, barrel correction, and cylindrical projection have been done at the same time for a multicamera system, resulting in an improvement of the overall performance. Using a low-cost parallel FPGA architecture, a high-speed real-time panoramic video system with low latency and high-performance has been developed. This video system can generate panoramic video of 5 \(\times \) 1280(H) \(\times \) 720(V)@15 frames/s or 5 \(\times \) 1280(H) \(\times \) 360(V)@30 frames/s in real-time on Xilinx Spartan6-150T FPGA. In order to display the panoramic video, a hardware display structure that can output the panoramic video in slide mode has also been constructed.

A fast algorithm for YCbCr to perception color model conversion based on fixed-point DSP

Real-time video processing heavily relies on the color space conversion. Due to the real-time requirement, the traditional conversion methods often suffer from the moderate conversion speed, inaccuracy and low video quality. In order to meet the efficiency requirement of color space conversion in real-time video systems, we present a fast algorithm for color space YCbCr to perception color model conversion, which is based on the simplified shift and look-up table (SSLUT). The approach can be divided into two steps. At first, the simplified fixed-point shift method is used to convert YCbCr to RGB. Then look-up table assists with the YCbCr to perception color model conversion, such as HSV, HSI and HSL. To validate the proposed fast algorithm, the conversion speed and accuracy are compared with the traditional methods based on Code Composer Studio (CCS) test platform. Moreover, we make the video quality evaluation by using the peak signal-to-ratio (PSNR) and the structural similarity (SSIM). Experimental results illustrate the real-time, robustness and accuracy of the fast algorithm.

Parallel implementation of a real-time high dynamic range video system

This article describes the use of the parallel processing capabilities of a graphics chip to increase the processing speed of a high dynamic range (HDR) video system. The basis is an existing HDR video system that produces each frame from a sequence

An Adaptive Thresholding algorithm of field leaf image

In this paper, we analyze the background and foreground images of jujube leaf, and propose a new Adaptive Thresholding algorithm that can segment single leaves in a leaf image extracted randomly from an online system. We use the OTSU and CANNY operators to segment the area of the target leaf by choosing the thresholds with the Mapping Function, the Shape Identification algorithm and pattern recognition. The optimization process of the algorithm, which includes Mapping Function, the Shape Identification algorithm, morphological methods and logical operations, is designed to precisely obtain the entire leaf edge. This algorithm has an advantage when segmenting complicated leaf images that contain overlapping laminas and have an uneven gray scale in the leaf region itself. Experiments show that this algorithm is both feasible and effective in segmenting jujube leaf images from real-time video systems, and we can obtain clear, smooth, accurate edge images. The algorithm can be used for other kinds of leaf or fruit image segmentation tasks after debugging and improvement.

World’s first telepathology experiments employing ultra-high-speed internet satellite, nicknamed “KIZUNA”

Background: Recent advances in information technology have allowed the development of a telepathology system involving high-speed transfer of high-volume histological figures via fiber optic landlines. However, at present there are geographical limits to landlines. The Japan Aerospace Exploration Agency (JAXA) has developed the “Kizuna” ultra-high speed internet satellite and has pursued its various applications. In this study we experimented with telepathology in collaboration with JAXA using Kizuna. To measure the functionality of the Wideband InterNet working engineering test and Demonstration Satellite (WINDS) ultra-high speed internet satellite in remote pathological diagnosis and consultation, we examined the adequate data transfer speed and stability to conduct telepathology (both diagnosis and conferencing) with functionality, and ease similar or equal to telepathology using fiber-optic landlines. Materials and Methods: We performed experiments for 2 years. In year I, we tested the usability of the WINDS for telepathology with real-time video and virtual slide systems. These are state-of-the-art technologies requiring massive volumes of data transfer. In year 2, we tested the usability of the WINDS for three-way teleconferencing with virtual slides. Facilities in Iwate (northern Japan),Tokyo, and Okinawa were connected via the WINDS and voice conferenced while remotely examining and manipulating virtual slides. Results: Network function parameters measured using ping and Iperf were within acceptable limits. However; stage movement, zoom, and conversation suffered a lag of approximately 0.8 s when using real-time video, and a delay of 60-90 s was experienced when accessing the first virtual slide in a session. No significant lag or inconveniencewas experienced during diagnosis and conferencing, and the results were satisfactory. Our hypothesis was confirmed for both remote diagnosis using real-time video and virtual slide systems, and also for teleconferencing using virtual slide systems with voice functionality. Conclusions: Our results demonstrate the feasibility of ultra-high-speed internet satellite networks for use in telepathology. Because communications satellites have less geographical and infrastructural requirements than landlines, ultra-high-speed internet satellite telepathology represents a major step toward alleviating regional disparity in the quality of medical care.

Algorithms for a real-time HDR video system

When the dynamic range of radiance values in a scene exceeds the capabilities of a camera, a single picture can only capture one brightness range of the scene faithfully at a time. We propose a system for creating high dynamic range (HDR) videos that overcomes this limitation. It acquires a number of images under varying exposure settings from dark to bright, each containing new scene radiance information. The camera motion between the images is compensated and they are fused into a single HDR frame. For visualization on regular displays, the video frame is tone mapped to the output range of the display. We introduce algorithms for reduced redundancy acquisition, efficient registration and visualization of HDR video that are fast enough to be used in real-time.

High Performance VLSI Architecture of Bi-directional Motion Search for B Picture in H.264

Bi-directional motion search is one of the important features of B picture coding in H.264/AVC. However, its high computational complexity and huge memory traffic make design difficult. This paper proposes a high throughput and cost efficient VLSI architecture for bi-directional integer motion estimation (Bi-IME). The redundancy of the joint motion search is removed, and the algorithm is simplified. Novel memory structure and intelligent reading method are designed to satisfy the iterations of full search with two reference windows. The parallel and sequence techniques are adopted to process the matching procedure. After logic synthesis using SMIC 0.13 μm standard cell library, under a clock frequency of 300 MHz, the proposed Bi-IME architecture can provide processing capacity up to 149 M MBs/sec which is enough for 1080p real-time video systems.

옵티컬 플로우와 마스킹에 의한 실시간 인터렉티브 비디오 개발

최근의 기술발달은 개인용 컴퓨터를 이용하여 실시간 영상처리 및 특수효과 처리를 가능하게 하였다. 본 논문에서는 개인용 컴퓨터를 이용하여 제작하고 시연한 실시간 인터렉티브 비디오 시스템을 기술하고 분석한다. 본 작품의 동기는 해변에서 파도가 부서지는 시각적 모습으로 부터 파도소리를 대체하는 사운드를 생성하고 자연과 하나가 되어가는 경험을 제공하기 위한 것이다. 이를 위하여 해변의 모습을 촬영한 실사 영상을 컴퓨터 비젼 기법인 옵티컬 프로우(Optical Flow)에 의하여 처리함으로써 프레임간의 변화에 대한 정보를 얻어 이를 카메라에서 실시간으로 캡쳐 받은 관객의 실루엣 이미지와 마스킹(masking)에 의하여 결합하고 그 결과를 프로젝터를 통하여 보여준다. 결과 이미지의 특성을 반영하여 미디 피아노 사운드가 함께 생성된다. 이는 하나의 인터렉티브 비디오 작품으로써 의도된 개념을 반영하여 상호작용 공간을 창출한다. Recent advances in computer technologies support real-time image processing and special effects on personal computers. This paper presents and analyzes a real-time interactive video system. The motivation of this work is to realize an artistic concept that aims at transforming the timeline visual variations in a video of sea water waves into sound in order to provide an audience with an experience of overlapping themselves onto the nature. In practice, the video of sea water waves taken on a beach is processed using an optical flow algorithm in order to extract the information of visual variations between the video frames. This is then masked by the silhouette of an audience and the result is projected on a gallery space. The intensity information is extracted from the resulting video and translated into piano sounds accordingly. This work generates an interactive space realizing the intended concept.

Rate Control Algorithms for Non-Embedded Wavelet-Based Image Coding

During the last decade, there has been an increasing interest in the design of very fast wavelet image encoders focused on specific applications like interactive real-time image and video systems, running on power-constrained devices such as digital cameras, mobile phones where coding delay and/or available computing resources (working memory and power processing) are critical for proper operation. In order to reduce complexity, most of these fast wavelet image encoders are non-(SNR)-embedded and as a consequence, precise rate control is not supported. In this work, we propose some simple rate control algorithms for these kind of encoders and we analyze their impact to determine if, despite their inclusion, the global encoder is still competitive with respect to popular embedded encoders like SPIHT and JPEG2000. In this study we focus on the non-embedded LTW encoder, showing that the increase in complexity due to the rate control algorithm inclusion, maintains LTW competitive with respect to SPIHT and JPEG2000 in terms of R/D performance, coding delay and memory consumption.

Real-time motion detection using block matching algorithms on multicore processors

Block matching algorithms (BMAs) like sum of absolute difference (SAD) and normalised cross correlation (NCC) form the basic building block in many computer vision applications. Full search (FS) BMAs take into account every pixel in a block, and are therefore very effective for wide motion search using different blocks. However, FS is computationally very expensive and unsuitable for real-time applications. We present efficient strategies for extracting data parallelism in FS SAD and NCC algorithms with fine-grained optimisation techniques for fully exploiting the computational capacity of the NVIDIA's multicore graphic processing units (GPUs). We demonstrate that proposed parallel implementation achieves a speedup of around 34× for SAD and 59× for NCC on GPU GTX 280, compared to sequential implementation on dual socket quad core Xeon processor with 2.50 GHz and 16 GB DRAM. Since GPUs are quite cheap and popular, our algorithm can form the base for many real-time video systems.

Three-dimensional, automated, real-time video system for tracking limb motion in brain–machine interface studies

Collection and analysis of limb kinematic data are essential components of the study of biological motion, including research into biomechanics, kinesiology, neurophysiology and brain–machine interfaces (BMIs). In particular, BMI research requires advanced, real-time systems capable of sampling limb kinematics with minimal contact to the subject's body. To answer this demand, we have developed an automated video tracking system for real-time tracking of multiple body parts in freely behaving primates. The system employs high-contrast markers painted on the animal's joints to continuously track the three-dimensional positions of their limbs during activity. Two-dimensional coordinates captured by each video camera are combined and converted to three-dimensional coordinates using a quadratic fitting algorithm. Real-time operation of the system is accomplished using direct memory access (DMA). The system tracks the markers at a rate of 52 frames per second (fps) in real-time and up to 100 fps if video recordings are captured to be later analyzed off-line. The system has been tested in several BMI primate experiments, in which limb position was sampled simultaneously with chronic recordings of the extracellular activity of hundreds of cortical cells. During these recordings, multiple computational models were employed to extract a series of kinematic parameters from neuronal ensemble activity in real-time. The system operated reliably under these experimental conditions and was able to compensate for marker occlusions that occurred during natural movements. We propose that this system could also be extended to applications that include other classes of biological motion.