Motion Imagery Research Articles

A Real-Time High Performance Computation Architecture for Multiple Moving Target Tracking Based on Wide-Area Motion Imagery via Cloud and Graphic Processing Units.

This paper presents the first attempt at combining Cloud with Graphic Processing Units (GPUs) in a complementary manner within the framework of a real-time high performance computation architecture for the application of detecting and tracking multiple moving targets based on Wide Area Motion Imagery (WAMI). More specifically, the GPU and Cloud Moving Target Tracking (GC-MTT) system applied a front-end web based server to perform the interaction with Hadoop and highly parallelized computation functions based on the Compute Unified Device Architecture (CUDA©). The introduced multiple moving target detection and tracking method can be extended to other applications such as pedestrian tracking, group tracking, and Patterns of Life (PoL) analysis. The cloud and GPUs based computing provides an efficient real-time target recognition and tracking approach as compared to methods when the work flow is applied using only central processing units (CPUs). The simultaneous tracking and recognition results demonstrate that a GC-MTT based approach provides drastically improved tracking with low frame rates over realistic conditions.

A method for real-time memory efficient implementation of blob detection in large images

In this paper we propose a method for real-time blob detection in large images with low memory cost. The method is suitable for implementation on the specialized parallel hardware such as multi-core platforms, FPGA and ASIC. It uses parallelism to speed-up the blob detection. The input image is divided into blocks of equal sizes to which the maximally stable extremal regions (MSER) blob detector is applied in parallel. We propose the usage of multiresolution analysis for detection of large blobs which are not detected by processing the small blocks. This method can find its place in many applications such as medical imaging, text recognition, as well as video surveillance or wide area motion imagery (WAMI). We explored the possibilities of usage of detected blobs in the feature-based image alignment as well. When large images are processed, our approach is 10 to over 20 times more memory efficient than the state of the art hardware implementation of the MSER.

A Container-Based Elastic Cloud Architecture for Pseudo Real-Time Exploitation of Wide Area Motion Imagery (WAMI) Stream

Real-time information fusion based on WAMI (Wide-Area Motion Imagery), FMV (Full Motion Video), and text data is highly desired for many mission critical emergency or military applications. However, due to the huge data rate, it is still infeasible to process streaming WAMI in a real-time manner and achieve the goal of online, uninterrupted target tracking. In this paper, a pseudo-real-time Dynamic Data Driven Applications System (DDDAS) WAMI data stream processing scheme is proposed. Taking advantage of the temporal and spatial locality properties, a divide-and-conquer strategy is adopted to overcome the challenge resulting from the large amount of dynamic data. In the Pseudo Real-time Exploitation of Sub-Area (PRESA) framework, each WAMI frame is divided into multiple sub-areas and specified sub-areas are assigned to the virtual machines in a container-based cloud computing architecture, which allows dynamic resource provisioning to meet the performance requirements. A prototype has been implemented and the experimental results validate the effectiveness of our approach.

Automatic Registration of Wide Area Motion Imagery to Vector Road Maps by Exploiting Vehicle Detections.

To enrich large-scale visual analytics applications enabled by aerial wide area motion imagery (WAMI), we propose a novel methodology for accurately registering a geo-referenced vector roadmap to WAMI by using the locations of detected vehicles and determining a parametric transform that aligns these locations with the network of roads in the roadmap. Specifically, the problem is formulated in a probabilistic framework, explicitly allowing for spurious detections that do not correspond to on-road vehicles. The registration is estimated via the expectation-maximization (EM) algorithm as the planar homography that minimizes the sum of weighted squared distances between the homography-mapped detection locations and the corresponding closest point on the road network, where the weights are estimated posterior probabilities of detections being on-road vehicles. The weighted distance minimization is efficiently performed using the distance transform with the Levenberg-Marquardt nonlinear least-squares minimization procedure, and the fraction of spurious detections is estimated within the EM framework. The proposed method effectively sidesteps the challenges of feature correspondence estimation, applies directly to different imaging modalities, is robust to spurious detections, and is also more appropriate than feature matching for a planar homography. Results over three WAMI data sets captured by both visual and infrared sensors indicate the effectiveness of the proposed methodology: both visual comparison and numerical metrics for the registration accuracy are significantly better for the proposed method as compared with the existing alternatives.

Shooting Melanesians: Martin Johnson and Edward Salisbury in the Southwest Pacific

By the turn of the 20th century American photographers were venturing into the western Pacific. Two of the first cinematic teams to film in Melanesia were the Kansan explorers Martin and Osa Johnson and the yachtsman Edward A. Salisbury, who was joined by Merian Cooper (of later King Kong fame). Both drew on representational practice honed partly along the American Western Frontier. Both pairs took still and motion pictures in the New Hebrides and Solomon Islands which they used to illustrate magazine articles, travelogue books and silent films, including the Johnsons’ Cannibals of the South Seas [1918] and Head Hunters of the South Seas [1922], and Salisbury and Cooper's Gow the Head Hunter [1928]. Differences in their print and motion imagery of islanders reflect the newer movie aesthetic, stimulating new ways to shoot Melanesians as spectators, as actors and as occasional filmmakers themselves.

Stimulus needs are a moving target: 240 additional matched literal and metaphorical sentences for testing neural hypotheses about metaphor.

As the cognitive neuroscience of metaphor has evolved, so too have the theoretical questions of greatest interest. To keep pace with these developments, in the present study we generated a large set of metaphoric and literal sentence pairs ideally suited to addressing the current methodological and conceptual needs of metaphor researchers. In particular, the need has emerged to distinguish metaphors along three dimensions: the grammatical class of their base terms, the sensorimotor features of their base terms, and the syntactic form in which the base terms appear. To meet this need, we generated nominal metaphors (and matched literal sentences) using entity nouns as the base terms, with the intention that they be used in concert with already published sets of predicate metaphors or nominal metaphors using event nouns. Using the results of three norming experiments, we provide 120 pairs of closely matched metaphoric and literal sentences that are characterized along 14 dimensions: 11 at the sentence level (length, frequency, concreteness, familiarity, naturalness, imageability, figurativeness, interpretability, ease of interpretation, valence, and valence judgment reaction time), and three related to the base term (visual, motion, and auditory imagery). These items extend previously published stimuli, filling an extant gap in metaphor research and allowing for tests of new behavioral and neural hypotheses about metaphor.

Time-resolved searchlight analysis of imagined visual motion using 7T ultra-high field fMRI: Data on interindividual differences.

Interindividual differences play a crucial role in research on mental imagery. The inherently private nature of imagery does not allow for the same experimental control that is possible in perception research. Even when there are precise instructions subjects will differ in their particular imagery strategy and, hence, show different brain activations. Here, we show results of a time-resolved searchlight analysis for 12 individual subjects who perform a visual motion imagery task. The data show the spatial and temporal extent of brain areas and time windows that allow for a successful decoding of the direction of imagined motion out of four options. Accuracy maps for six different time windows are shown for every individual subject and are made freely available on NeuroVault. These data accompany the findings in the publication “Decoding the direction of imagined visual motion using 7 T ultra-high field fMRI” (Emmerling et al., 2016) [1].

Physiological capture of augmented viewing states: objective measures of high-dynamic-range and wide-color-gamut viewing experiences

The capability for improved image and video reproduction quality is notably growing. For example, augmentation of resolution and dynamic range allows for a markedly transformed viewer experience. These can influence a viewer’s experience of content in a manner not captured by standardized methods of subjective quality assessment. Changes in viewer experiences may include elevated arousal, enhanced emotional impact, and increased engagement. Here we describe objective methods and data metrics allowing for the assessment of individual responses to high-dynamic-range (HDR) and wide-color-gamut (WCG) motion imagery using electroencephalography (EEG) measurements. All test content was mapped from a HDR/WCG source, with the HDR/WCG content mapped to the parameters of the stimulus display (0.005-1000 cd/m2 dynamic range, DCI P3 color space). Comparison baseline content was mapped to the parameters of a standard consumer TV (0.05-100 cd/m2 dynamic range, Rec. 709 color space). The difference between viewing the HDR/WCG content and baseline content was captured using EEG to probe modulation of visual cortical drive, elicited with a fixed-frequency reversing checkerboard stimulus. These metrics are combined with a broader set of measures to collectively quantify content- and dynamic range-dependent impacts of engagement and attentional processing.

Vector Road Map Registration to Oblique Wide Area Motion Imagery by Exploiting Vehicle Movements

Vector Road Map Registration to Oblique Wide Area Motion Imagery by Exploiting Vehicle Movements

Generating a Vehicle Trajectory Database from Time-Lapse Aerial Photography

The advancing art of microsimulation modeling is driving a growing interest in vehicle trajectory databases. These can be rich sources of travel information, providing origin–destination patterns, path choices, travel times or delays, and lane changing behavior. These metrics have historically been difficult to acquire, and even with the approach of the big-data era, it remains a challenge to collect high-quality, granular vehicle trajectory data. This paper describes how use of state-of-the-practice time-lapse aerial photography (TLAP), acquired continuously for up to several hours at 1-s frame rates, can produce trajectory data sets with high granularity. These surveys involve the use of airborne digital cameras held in stationary positions about one mile above the ground, to record the movement of virtually all highway vehicles in defined study areas. In this paper, TLAP’s differences from similar military imaging capabilities, such as wide-area motion imagery, are discussed, to explain how TLAP can be affordable for highway traffic studies. Then local survey design and execution for a study in the Phoenix, Arizona, area are presented. Flight and photography survey planning, image alignment, and data extraction methods are discussed; and study output and graphics are presented near the end. Big data someday will likely be magically able to supply all the field data needed for complex analysis or simulation of specific study areas; for now, however, 1-s TLAP can provide many of those benefits.

“Set His Image in Motion:” John Dennis and Early Eighteenth-Century Motion Imagery

This article examines early eighteenth-century attempts to explain how poetic descriptions of physical motion generated vivid scenes in the imagination. Motion was central to neo-Augustan theories of representation because, for much of this period, writers understood motion as a central principle of human nature. Questions about the mind/soul's “agitations” were crucial to a wide range of Enlightenment theories about mental imagery, rhetorical persuasion, and aesthetic beauty. Many writers, including John Dennis, linked the aesthetic import of spatial movement to Newtonian laws of motion. I trace the ways that Dennis's theories about motion imagery address not only the classical tradition of “bringing-before-the-eyes,” but also the modern philosophical models of inertia and force. In arguing that writing about poetry could better elucidate the motions of the mind/soul than could moral philosophy or physics, Dennis's essays can also teach us about eighteenth-century proto-disciplinary organization. Recent work in cognitive cultural studies has shown that the concept of motion is of vital importance to understanding the way the brain comprehends and structures language. This has especially wide-reaching implications for scholars of Restoration and eighteenth-century literature because it was during this period that writers began to codify connections between universal laws of nature, beauty, and human cognition.

Vehicle-tracking in wide-area motion imagery from an airborne platform

Vehicle-tracking in wide-area motion imagery from an airborne platform

ASPEK CITRAAN DALAM NOVEL TRILOGI RONGGENG DUKUH PARUK: KAJIAN STILISTIKA DAN IMPLEMENTASINYA DALAM PEMBELAJARAN SASTRA DI SMK TAMANSISWA BANJARNEGARA

Penelitian ini mengkaji aspek citraan dalam novel trilogi Ronggeng Dukuh Paruk karya Ahmad Tohari dengan kajian stilistika dan implementasinya sebagai bahan ajar dalam pembelajaran sastra di SMK. Jenis penelitian ini adalah kualitatif deskriptif. Sumber datanya novel trilogi Ronggeng Dukuh Paruk karya Ahmad Tohari dan data berupa kata, frase, dan kalimat yang mengandung aspek citraan. Teknik pengumpulan data dengan teknik simak catat, dan teknik pustaka. Adapun teknik validasi data menggunakan triangulasi teori. Analisis data menggunakan metode pembacaan model semiotik yakni pembacaan heuristik dan pembacaan hermeneutik atau retroaktif. Hasil penelitian terhadap aspek citraan Ronggeng Dukuh Paruk dengan kajian stilistika yakni (1) Citraan penglihatan yang dimanfaatkan untuk melukiskan karakter tokoh, keadaan, suasana, tempat secara plastis dan indah serta untuk melukiskan emosi tokoh, aktivitas yang terjadi dalam cerita. Citraan penglihatan berfungsi sebagai sarana penafsiran, baik penafsiran tokoh, peristiwa, maupun latar yang mendukung cerita. (2) Pemanfaatan citraan pendengaran untuk menggambarkan perilaku atau aktivitas yang dilakukan oleh tokoh dalam cerita serta dapat memaknai situasi yang terjadi. (3) Analisis citraan rabaan digunakan untuk menggambarkan suasana dalam cerita serta mengilustrasikan tempat terjadi cerita dan latar waktu. (4) Penggunaan citraan penciuman berfungsi memudahkan imajinasi pembaca, menggugah pikiran dan perasaan, menghadirkan suasana yang lebih konkret dalam cerita. (5) Citraan gerak digunakan untuk mengilustrasikan suasana yang ada dalam cerita, menimbulkan imajinasi pembaca terhadap apa yang sedang terjadi, menggambarkan aktifitas maupun ekspresi para tokoh dalam cerita. (6) Penggunaan citraan pencecapan digunakan pengarang sebagai respon terhadap rasa oleh indra pengecap. (7) Citraan intelektual digunakan sebagai penyampaian pesan, pelurusan kebenaran, maupun penyampaian pengetahuan baru bagi pembaca. Implementasi aspek citraan sebagai materi ajar di SMK bertujuan untuk mencapai kompetensi pembelajaran dengan kompetensi dasar menyimak untuk memahami secara kreatif teks seni berbahasa dan teks ilmiah sederhana, serta kompetensi dasar mengapresiasi secara lisan teks seni berbahasa dan teks ilmiah sederhana. Materi ajar disajikan dalam bentuk modul pembelajaran.

Decoding the direction of imagined visual motion using 7 T ultra-high field fMRI

There is a long-standing debate about the neurocognitive implementation of mental imagery. One form of mental imagery is the imagery of visual motion, which is of interest due to its naturalistic and dynamic character. However, so far only the mere occurrence rather than the specific content of motion imagery was shown to be detectable. In the current study, the application of multi-voxel pattern analysis to high-resolution functional data of 12 subjects acquired with ultra-high field 7T functional magnetic resonance imaging allowed us to show that imagery of visual motion can indeed activate the earliest levels of the visual hierarchy, but the extent thereof varies highly between subjects. Our approach enabled classification not only of complex imagery, but also of its actual contents, in that the direction of imagined motion out of four options was successfully identified in two thirds of the subjects and with accuracies of up to 91.3% in individual subjects. A searchlight analysis confirmed the local origin of decodable information in striate and extra-striate cortex. These high-accuracy findings not only shed new light on a central question in vision science on the constituents of mental imagery, but also show for the first time that the specific sub-categorical content of visual motion imagery is reliably decodable from brain imaging data on a single-subject level.

Visual motion imagery neurofeedback based on the hMT+/V5 complex: evidence for a feedback-specific neural circuit involving neocortical and cerebellar regions

Objective. Current approaches in neurofeedback/brain–computer interface research often focus on identifying, on a subject-by-subject basis, the neural regions that are best suited for self-driven modulation. It is known that the hMT+/V5 complex, an early visual cortical region, is recruited during explicit and implicit motion imagery, in addition to real motion perception. This study tests the feasibility of training healthy volunteers to regulate the level of activation in their hMT+/V5 complex using real-time fMRI neurofeedback and visual motion imagery strategies. Approach. We functionally localized the hMT+/V5 complex to further use as a target region for neurofeedback. An uniform strategy based on motion imagery was used to guide subjects to neuromodulate hMT+/V5. Main results. We found that 15/20 participants achieved successful neurofeedback. This modulation led to the recruitment of a specific network as further assessed by psychophysiological interaction analysis. This specific circuit, including hMT+/V5, putative V6 and medial cerebellum was activated for successful neurofeedback runs. The putamen and anterior insula were recruited for both successful and non-successful runs. Significance. Our findings indicate that hMT+/V5 is a region that can be modulated by focused imagery and that a specific cortico-cerebellar circuit is recruited during visual motion imagery leading to successful neurofeedback. These findings contribute to the debate on the relative potential of extrinsic (sensory) versus intrinsic (default-mode) brain regions in the clinical application of neurofeedback paradigms. This novel circuit might be a good target for future neurofeedback approaches that aim, for example, the training of focused attention in disorders such as ADHD.

Corrected pose data for the Wright Patterson Air Force Base 2009 Wide Area Motion Imagery data set

The Wright Patterson Air Force Base 2009 Wide Area Image data set consists of 1537 frames of high-resolution image data. The data are supplied as raw images with pose files and also as projected images in National Imagery Transmission Format (NITF). The georegistration performance of the NITF images is 22.3 m root-mean square horizontal (RMSH). In a previous paper, calibrated camera models were developed to reduce the georegistration error to 3.3 m RMSH. In this work, corrected pose files are generated to reduce the error to 0.9 m RMSH. This is done by correcting the pose errors in a stepwise fashion to illustrate the error sources, which are global positioning system position bias, time registration errors, and attitude errors. The pose files are then corrected by simultaneously modifying the position and attitude to achieve the 0.9 m RMSH result. The corrected pose files are posted to allow users to perform high-accuracy projection, tracking, and other functions.

Content analysis of 4 to 8 year-old children's dream reports.

The role of dreaming in childhood and in adulthood are still equally enigmatic fields yet to be fully explored. However, while there is a consensus at least about the typical content and formal characteristics of adult dream reports, these features are still a matter of debate in the case of young children. Longitudinal developmental laboratory studies concluded that preschoolers' dreams usually depict static images about mostly animals and body states of the dreamer but they basically lack the active representation of the self, human characters, social interactions, dream emotions and motion imagery. Due to methodological arguments these results became the reference points in the literature of developmental dream research, in spite of the significantly different results of numerous recent and relevant studies using extra-laboratory settings. This study aims to establish a methodologically well-controlled and valid way to collect children's dreams for a representative period of time in a familiar home setting to serve as a comparison to the laboratory method. Pre trained parents acted as interviewers in the course of a 6 week-period of dream collection upon morning awakenings. Our results suggest that even preschoolers are likely to represent their own self in an active role (70%) in their mostly kinematic (82%) dream narratives. Their dream reports contain more human, than animal characters (70 and 7% of all dream characters respectively), and social interactions, self-initiated actions, and emotions are usual part of these dreams. These results are rather similar to those of recent extra-laboratory studies, suggesting that methodological issues may strongly interfere with research outcomes especially in the case of preschoolers' dream narratives. We suggest that nighttime awakenings in the laboratory setting could be crucial in understanding the contradictory results of dream studies in case of young children.

Effects of Motion Imagery and Motion Perception on Subsequent Conscious Perception

Effects of Motion Imagery and Motion Perception on Subsequent Conscious Perception

Learning with Privileged Information for Improved Target Classification

This work considers “Learning Using Privileged Information” (LUPI) paradigm. LUPI improves classification accuracy by incorporating additional information available at training time and not available during testing. In this contribution, the LUPI paradigm is tested on a Wide Area Motion Imagery (WAMI) dataset and on images from the Caltech 101 dataset. In both cases a consistent improvement in classification accuracy is observed. The results are discussed and the directions of future research are outlined.

CITRAAN DALAM KUMPULAN SAJAK TEBARAN MEGA KARYA SUTAN TAKDIR ALISJAHBANA

The purpose of this article is (a) to describe the types of images contained in a collection of poems Tebaran Mega created by Sutan Takdir Alisjahbana, (b) to describe the functions contained in a collection of poems Tebaran Mega by Sutan Takdir Alisjahbana. The data of this study is a collection of images in poems Tebaran Mega by Sutan Takdir Alisjahbana. The technique of analyzing data using detailed description techniques . The research findings in this study is the first, of the 6 types of images were examined, found 5 images in a collection of poems Tebaran Mega which is as follows: visual imagery found in 28 poems, auditory imagery found in 21 poems, olfactory imagery found in one poems, imagery feelings found as many as 11 poems, images grope found as many as 11 poems, and motion imagery found in 24 poems. Second, there are three functions in the collection of poems Tebaran Mega by Sutan Takdir Alisjahbana which is as follows: the function of imagination as much as 10 poems, aesthetic function was found in 7 poems, and suggestive function found in 4 poems.