Motion Playback Research Articles

Video frame interpolation for high dynamic range sequences captured with dual‐exposure sensors

AbstractVideo frame interpolation (VFI) enables many important applications such as slow motion playback and frame rate conversion. However, one major challenge in using VFI is accurately handling high dynamic range (HDR) scenes with complex motion. To this end, we explore the possible advantages of dual‐exposure sensors that readily provide sharp short and blurry long exposures that are spatially registered and whose ends are temporally aligned. This way, motion blur registers temporally continuous information on the scene motion that, combined with the sharp reference, enables more precise motion sampling within a single camera shot. We demonstrate that this facilitates a more complex motion reconstruction in the VFI task, as well as HDR frame reconstruction that so far has been considered only for the originally captured frames, not in‐between interpolated frames. We design a neural network trained in these tasks that clearly outperforms existing solutions. We also propose a metric for scene motion complexity that provides important insights into the performance of VFI methods at test time.

Action Realization of Modular Robot Using Memory and Playback of Motion

Action Realization of Modular Robot Using Memory and Playback of Motion

Distributed T&P Control System Based on CAN Bus for R-CUBE

The designed and experimental process of the teaching and playback(T&P) control system for R-CUBE is narrated. The control system was connected by CAN bus and has a distributed structure. The design thought and basic work principles of the control system about R-CUBE that regards the C8051F040 as the core are introduced, the basic circuit diagram of the hardware system and the software design projects are also provided. The teaching and playback progress was executed as several modes, with the control of three operator model, the teaching and playback of motion for R-CUBE could be realized.

Observation of High and Low Passive Ankle Flexibility in Stair Descent

Able-bodied people from the two extremes of the distribution of passive dorsiflexion exhibit biomechanical differences when descending stairs. Whether physical therapists could judge accurately the amount of ankle flexibility from observation of stair descent was examined with physical therapists (20 neurological 20 cardiothoracic) and 20 students. Subjects were 18 able-bodied men with high or low passive dorsiflexion. Raters viewed videotaped subjects descending stairs at normal playback speed and in slow motion and rated ankle flexibility on a 20-point scale. 'Flexible' or 'inflexible' subjects were classified correctly better than chance, but accuracy of rating flexibility was relatively poor. Both experience and slow motion playback improved accuracy. Physical therapists can detect extremes of normal flexibility in the ankle, based solely on observation of stair descent, and experienced therapists are better at this task than less experienced ones. Using slow motion videotape enhanced observational analysis.

Quality Enhancement of Frame Rate Up-Converted Video by Adaptive Frame Skip and Reliable Motion Extraction

Frame rate up-conversion is a postprocessing tool to convert the frame rate from a lower number to a higher one. It is a useful technique for a lot of practical applications, such as display format conversion, low bit rate video coding and slow motion playback. Unlike traditional approaches, such as frame repetition or linear frame interpolation, motion-compensated frame interpolation (MCFI) technique is more efficient since it takes block motion into account. In this paper, by considering the deficiencies of previous works, new criteria and coding schemes for improving motion derivation and interpolation processes are proposed. Next, for video coding applications, adaptive frame skip is executed at the encoder side to maximize the power of MCFI so that the quality of interpolated frames is guaranteed. Experimental results show that our proposal effectively enhances the overall quality of the frame rate up-converted video sequence, both subjectively and objectively.

イメージセンシング技術とその応用 毎秒３００フレーム順次走査ＨＤＴＶ高速度カメラ

We have developed an HDTV (High-definition television) high speed camera that uses three 2.2 M-pixel complementary metal oxide semiconductor image devices. The camera enables image acquisition up to a maximum speed of 300 frames per second and stores the image sequences directly in a semiconductor memory chip in the camera head. High-quality slow motion playback is available as the image is stored without being compression. A compact, lightweight (7.7 kg), handheld camera head can be controlled from a camera control unit using a single standard HDTV hybrid fiber optic camera cable (Max. 2 km).

A repetitive movement detector used for automatic monitoring and quantification of scratching in mice

We have designed an economical non-invasive movement detector for small animal studies and used it for monitoring and quantifying itch in mice. The system is based on a sensitive force transducer positioned below a recording platform holding a lightweight polystyrene recording box in which an animal is placed. A programmed micro-controller is used to discriminate between non-specific movement, grooming behaviour, and scratching movements made by the animal's hind limb. Following sub-dermal injection of histamine receptor agonists into the neck of a mouse, dose-related scratching occurred which was detected and quantified. There was 91% correlation between bouts of scratching as counted manually from playback of the video recording and recorded by the detector. The detector was also able rapidly to count the individual scratch movements of the hind limb that comprise a bout, with 95% accuracy in comparison with manual counting during slow motion playback of video tape, something that is impossible for an unaided observer to achieve because individual scratch movements are too fast to discriminate by eye. Separate detectors were used for the efficient non-invasive study of four animals simultaneously, and this number could easily be increased by adding more platforms. The system could also be modified to record the animal's position within the box, which would be of value in studies involving exploratory behaviour. In summary, the non-invasive multichannel repetitive movement detector will be very useful for accurate measurement of scratching during pruritus studies in small animals, with considerable savings in staff time and effort. It should therefore be a valuable tool for helping to investigate pruritus and in the evaluation of anti-pruritic drugs.

Production and playback of human figure motion for visual simulation

We describe a system for off-line production and real-time playback of motion for articulated human figures in 3D virtual environments. The key notion are (1) the logical storage of full-body motion in posture graphs, which provides a simple motion access method for playback, and (2) mapping the motions of high DOF figures to lower DOF figures using slaving to provide human models at several levels of detail, both in geometry and articulation, for later playback. We present our system in the context of a simple problem: animating human figures in a distributed simulation, using DIS protocols for communicating the human state information. We also discuss several related techniques for real-time animation of articulated figures in visual simulation.

Dynamic in vivo observation of rat islet microcirculation.

In vivo fluorescent microscopy with direct observation of flow through the islet was used to investigate the islet microcirculation. In urethane-anesthetized rats (n = 18), the pancreas was exposed and an islet was identified under direct microscopy. The vertical illuminator for fluorescent microscopy was turned on and fluorescein-albumin conjugate or fluorescent microspheres were injected intravenously or intraarterially. Each study was videotaped; on slow motion playback, the flow of the conjugate or microspheres was followed through the islet, the islet capillaries, and then to venules exiting the islet. One islet in the head of the pancreas in 12 rats was studied. The arterioles first reached the surrounding mantle of the islet where they divided into capillaries that carried conjugate or microspheres to other portions of the mantle or the core of the islet. Flow of conjugate traversed the core and returned to different portions of the mantle. The fluorescent microsphere study permitted a more detailed study of the pathways followed, the individual microspheres being seen to travel through numerous tortuous pathways through the islet. The flow of microspheres was nonhomogeneous in that individual microspheres in one portion of the islet would stop, then move on, while other microspheres flowed freely. The capillaries joined two to six venules that carried the conjugate or microspheres out of the islet. One or two of the exiting microvessels entered the adjacent acinar microcirculation; the others entered larger collecting venules. In six tail islets studied, the microcirculation was similar to that of the islets in the head of the pancreas.(ABSTRACT TRUNCATED AT 250 WORDS)

3-D Flow Modeling of a Hazardous Waste Incinerator

A three-dimensional flow model of a hazardous waste incinerator kiln and vertical secondary combustion chamber arrangement was constructed to evaluate critical system parameters. The chamber wall configuration, location and arrangement of burners, and the positioning of the outlet duct were examined to determine the critical secondary combustion chamber gas residence time and mixing of the combustion flows. The scale model consisted of the rotary kiln as a primary combustion chamber, the secondary combustion chamber, two burners, and the exhaust ducting. Flue gas velocities in the model inlets and outlet were maintained to provide a Reynolds numbers equal to the full size unit. Patterns of smoke which were injected into the model inlets were viewed to evaluate flow mixing. Slow motion playback of video tape was used to determine the minimum residence time of flow in the high temperature combustion zone. The results of the model study were used to complete the engineering of a waste incineration system.

Simultaneous Assessment of Human Sperm Motility and Morphology by Videomicrography

Videotapes were analyzed to assess sperm motility and morphology in the semen of 5 fertile donors and 20 infertile patients. The slow motion playback control of the video recorder allowed simultaneous assessment of the motility and morphology of individual sperm cells. Similar values were obtained with this method for living sperm cells and for sperm on fixed, Papanicolaou-stained seminal smears. Spermatozoa with abnormal morphology more often were immotile or weakly motile than were the normal sperm in the same ejaculates. Normal oval sperm in the semen of infertile men were less likely to be motile and tended to swim more slowly than did morphologically normal sperm in the semen of fertile men.