Temporal Offsets Research Articles

Aircraft and Ship Velocity Determination in Sentinel-2 Multispectral Images.

The Sentinel-2 satellites in the Copernicus program provide high resolution multispectral images, which are recorded with temporal offsets up to 2.6 s. Moving aircrafts and ships are therefore observed at different positions due to the multispectral band offsets, from which velocities can be determined. We describe an algorithm for detecting aircrafts and ships, and determining their speed, heading, position, length, etc. Aircraft velocities are also affected by the parallax effect and jet streams, and we show how the altitude and the jet stream speed can be determined from the geometry of the aircraft and/or contrail heading. Ship speeds are more difficult to determine as wakes affect the average ship positions differently in the various multispectral bands, and more advanced corrections methods are shown to improve the velocity determination.

Geochemical evidence for expansion of marine euxinia during an early Silurian (Llandovery–Wenlock boundary) mass extinction

Repeated biotic crises have become the hallmark for the Silurian with the three most significant marine turnover events being related to dramatic global environmental perturbations. Causal mechanisms linking these marine extinction events with positive carbon isotope (δ13C) excursions, paleoceanographic change, and climate remain poorly constrained. Here, we examine the positive δ13C excursion across the Llandovery/Wenlock boundary, and the associated Ireviken extinction event. This positive δ13C excursion has been interpreted to reflect a major change in global oceanographic-climate state and enhanced organic carbon burial. New geochemical data from two paleocean basins have been analyzed to determine local and global redox conditions using carbon- and sulfur-isotopes (δ34S), and iodine (I/Ca+Mg) proxies. The high-resolution δ13C and δ34S data from both sections show positive excursions indicative of global perturbations to each of these elemental cycles, with minimal temporal offsets between the two systems. Numerical box modeling of δ13C and δ34S data indicates that these isotopic shifts can be generated by significant increases in the burial of organic carbon and pyrite, which are most likely due to enhanced burial under euxinic (anoxic and sulfidic) conditions. Independently, I/(Ca+Mg) values point to locally anoxic bottom waters in the distal and deeper basinal setting in Nevada before, during, and after the Ireviken positive δ13C excursion. I/(Ca+Mg) values in the proximal shelf setting in Tennessee show relatively oxic waters during the onset of peak δ13C values, after which bottom-water oxygen concentrations dropped throughout the remainder of the excursion. This multiproxy paleoredox dataset provides the first direct evidence for local and global expansion of reducing marine conditions coincident with the Silurian biotic event and positive δ13C excursion. Integration of these geochemical data for local- and global-scale changes in marine redox conditions with the paleontological data and evidence for eustatic sea-level rise points toward a shoaling of anoxic and/or euxinic waters onto the shelf as a driver for the Ireviken extinction event.

Testing symmetry of temporal window of integration between vibrotactile and auditory speech information in voiced phoneme perception

The temporal window for enhancement in cross-modal integration is asymmetrical, and does not require synchrony of stimuli for integration; this temporal offset has been linked to differences in relative signal speed as can be seen in audio-visual integration [Munhall et al. 1996. Perc. Psychophys. 58: 351] and audio-aerotactile integration [Gick et al. 2010. Journ. Acoust. Soc. Am. 128: EL342] of speech. However, as vibrotactile cues normally accompany acoustic cues, no difference in signal speed—and no concomitant perceptual asymmetry—is experienced between these two modalities. Contrary to previous research, we predict a symmetrical window for integration. A portable voice-coil transducer is used to produce vibrotactile stimuli, similar to the laryngeal vibrations normally felt in voiced speech. Results of an experiment will be presented in which participants are asked to discriminate between minimal pairs in noise with the device between their thumb and index finger, and in which audio and vibrotactile stimuli are presented in different orders and at different temporal offsets. Implications will be discussed for theories of cross-modal integration. [Funding from NSERC.]

High‐Frequency Sensor Data Reveal Across‐Scale Nitrate Dynamics in Response to Hydrology and Biogeochemistry in Intensively Managed Agricultural Basins

AbstractExcess nitrate in rivers draining intensively managed agricultural watersheds has caused coastal hypoxic zones, harmful algal blooms, and degraded drinking water. Hydrology and biogeochemical transformations influence nitrate concentrations by changing nitrate supply, removal, and transport. For the Midwest Unites States, where much of the land is used for corn and soybean production, a better understanding of the response of nitrate to hydrology and biogeochemistry is vital in the face of high nitrate concentrations coupled with projected increases of precipitation frequency and magnitude. In this study, we capitalized on the availability of spatially and temporally extensive sensor data in the region to evaluate how nitrate concentration (NO3−) interacts with discharge (Q) and water temperature (T) within eight watersheds in Iowa, United States, by evaluating land use characteristics and multiscale temporal behavior from 5‐year, high‐frequency, time series records. We show that power spectral density of Q, NO3−, and T, all exhibit power law behavior with slopes greater than 2, implying temporal self‐similarity for a range of scales. NO3− was strongly cross correlated with Q for all sites and correlation increased significantly with drainage area across sites. Peak NO3− increased significantly with crop coverage across watersheds. Temporal offsets in peak NO3− and peak Q, seen at all study sites, reduced the impact of extreme events. This study illustrates a relatively new approach to evaluating environmental sensor data and revealed characteristics of watersheds in which extreme discharge events have the greatest consequences.

Temporal Coupling of Subsurface and Surface Soil CO2 Fluxes: Insights From a Nonsteady State Model and Cross‐Wavelet Coherence Analysis

AbstractInferences about subsurface CO2 fluxes often rely on surface soil respiration (Rsoil) estimates because directly measuring subsurface microbial and root respiration (collectively, CO2 production, STotal) is difficult. To evaluate how well Rsoil serves as a proxy for STotal, we applied the nonsteady state DEconvolution of Temporally varying Ecosystem Carbon componenTs model (0.01‐m vertical resolution), using 6‐hourly data from a Wyoming grassland, in six simulations that cross three soil types (clay, sandy loam, and sandy) with two depth distributions of subsurface biota. We used cross‐wavelet coherence analysis to examine temporal coherence (localized linear correlation) and offsets (lags) between STotal and Rsoil and fluxes and drivers (e.g., soil temperature and moisture). Cross‐wavelet coherence revealed higher coherence between fluxes and drivers than linear regressions between concurrent variables. Soil texture and moisture exerted the strongest controls over coherence between CO2 fluxes. Coherence between CO2 fluxes in all soil types was strong at short (~1 day) and long periods (>8 days), but soil type controlled lags, and rainfall events decoupled the fluxes at periods of 1–8 days for several days in sandy soil, up to 1 week in sandy loam, and for a month or more in clay soil. Concentrating root and microbial biomass nearer the surface decreased lags in all soil types and increased coherence up to 10% in clay soil. The assumption of high temporal coherence between Rsoil and STotal is likely valid in dry, sandy soil, but may lead to underestimates of short‐term STotal in semiarid grasslands with fine‐grained and/or wet soil.

Impact of the cone operation on left ventricular size, function, and dyssynchrony in Ebstein anomaly: a cardiovascular magnetic resonance study

BackgroundIn addition to tricuspid regurgitation (TR) and right ventricular (RV) enlargement, patients with Ebstein anomaly are at risk for left ventricular (LV) dysfunction and dyssynchrony. We studied the impact of the cone tricuspid valve reconstruction operation on LV size, function, and dyssynchrony.MethodsAll Ebstein anomaly patients who had both pre- and postoperative cardiovascular magnetic resonance (CMR) studies were retrospectively identified. From cine images, RV and LV volumes and ejection fractions (EF) were calculated, and LV circumferential and longitudinal strain were measured by feature tracking. To quantify LV dyssynchrony, temporal offsets (TOs) were computed among segmental circumferential strain versus time curves using cross-correlation analysis and patient-specific reference curves. An LV dyssynchrony index was calculated as the standard deviation of the TOs.ResultsTwenty patients (65% female) were included with a median age at cone operation of 16 years, and a median time between pre- and postoperative CMR of 2.8 years. Postoperatively, there was a decline in the TR fraction (56 ± 19% vs. 5 ± 4%, p < 0.001), RV end-diastolic volume (EDV) (242 ± 110 ml/m2 vs. 137 ± 82 ml/m2, p < 0.001), and RV stroke volume (SV) (101 ± 35 vs. 51 ± 7 ml/m2, p < 0.001). RV EF was unchanged. Conversely, there was an increase in both LV EDV (68 ± 13 vs. 85 ± 13 ml/m2, p < 0.001) and LV stroke volume (37 ± 8 vs. 48 ± 6 ml/m2, p < 0.001). There was no change in LV EF, or global circumferential and longitudinal strain but basal septal circumferential strain improved (16 ± 7% vs. 22 ± 5%, p = 0.04). LV contraction become more synchronous (dyssynchrony index: 32 ± 17 vs. 21 ± 9 msec, p = 0.02), and the extent correlated with the reduction in RV EDV and TR.ConclusionsIn patients with the Ebstein anomaly, the cone operation led to reduced TR and RV stroke volume, increased LV stroke volume, improved LV basal septal strain, and improved LV synchrony. Our data demonstrates that the detrimental effect of the RV on LV function can be mitigated by the cone operation.

No Correlation Between Atmospheric Dust and Surface Ocean Chlorophyll‐a in the Oligotrophic Gulf of Aqaba, Northern Red Sea

AbstractHigh‐resolution records of daily surface chlorophyll‐a (chl‐a) concentrations and hourly atmospheric dust concentrations in the Gulf of Aqaba, northern Red Sea, are compared between 2012 and 2016 in order to examine the interplay between atmospheric dust input and surface productivity in this subtropic, nutrient‐poor marine ecosystem. Given that lags of days to weeks may occur between the dust input and phytoplankton response, and because of potential biases associated with differences in the sampling resolution, temporal offsets of 1–10 days between the dust and chl‐a are examined using smoothing windows between 3 and 31 days. The results suggest that there is no significant positive (or negative) correlation between dust and chl‐a surface concentrations, even when allowing for temporal offsets between the two records. This observation pertains to the seasonal as well as the daily time scale (i.e., abrupt dust storms). It is concluded that the role of atmospheric dust as a control on productivity in the Gulf of Aqaba and possibly other oligotrophic regions may have been previously overestimated.

Rapid Improvement on a Temporal Attention Task within a Single Session of High-frequency Transcranial Random Noise Stimulation.

This study explored the modulatory effects of high-frequency transcranial random noise stimulation (tRNS) on visual sensitivity during a temporal attention task. We measured sensitivity to different onset asynchronies during a temporal order judgment task as a function of active stimulation relative to sham. While completing the task, participants were stimulated bilaterally for 20 min over either the TPJ or the human middle temporal area. We hypothesized that tRNS over the TPJ, which is critical to the temporal attention network, would selectively increase cortical excitability and induce cognitive training-like effects on performance, perhaps more so in the left visual field [Matthews, N., & Welch, L. Left visual field attentional advantage in judging simultaneity and temporal order. Journal of Vision, 15, 1-13, 2015; Romanska, A., Rezlescu, C., Susilo, T., Duchaine, B., & Banissy, M. J. High-frequency transcranial random noise stimulation enhances perception of facial identity. Cerebral Cortex, 25, 4334-4340, 2015]. In Experiment 1, we measured the performance of participants who judged the order of Gabors temporally imbedded in flickering discs, presented with onset asynchronies ranging from -75 msec (left disc first) to +75 msec (right disc first). In Experiment 2, we measured whether each participant's temporal sensitivity increased with stimulation by using temporal offsets that the participant initially perceived as simultaneous. We found that parietal cortex stimulation temporarily increased sensitivity on the temporal order judgment task, especially in the left visual field. Stimulation over human middle temporal area did not alter cortical excitability in a way that affected performance. The effects were cumulative across blocks of trials for tRNS over parietal cortex but dissipated when stimulation ended. We conclude that single-session tRNS can induce temporary improvements in behavioral sensitivity and that this shows promising insight into the relationship between cortical stimulation and neural plasticity.

Self-organised Attractor Dynamics in the Developing Head Direction Circuit

Head direction (HD) cells signal the orientation of an animal’s head relative to its environment. During post-natal development, HD cells are the earliest spatially modulated neurons in the hippocampal circuit to emerge. However, before eye-opening, HD cell responses in rat pups carry low directional information content and are directionally unstable. Using Bayesian decoding, we characterise this instability and identify its source: despite the directional signal being internally coherent, it consistently under-signals angular head velocity (AHV), incompletely shifting in proportion to head turns. We find evidence that geometric cues (corners) can be used to mitigate this under-signalling, and stabilise the directional signal even before eye-opening. Crucially, even when directional firing cannot be stabilised, ensembles of unstable HD cells show short-timescale (1-10 sec) temporal and spatial couplings consistent with an adult-like HD network, through which activity drifts unanchored to landmark cues. The existence of fixed spatial and temporal offsets across co-recorded cells and of an AHV-responsive signal, even before HD responses become spatially stable, suggests that the HD circuit is assembled through internal, self-organising processes, without reference to external landmarks. The HD network is widely modelled as a continuous attractor whose output is one coherent activity peak, updated during movement by angular head velocity (AHV) signals, and anchored by landmark cues. Our findings present strong evidence for this model, and demonstrate that the required network circuitry is in place and functional during development, independent of reference to landmark information.

Categorizing coordination from the perception of joint actions.

The ability to perceive others' actions and coordinate our own body movements accordingly is essential for humans to interact with the social world. However, it is still unclear how the visual system achieves the remarkable feat of identifying temporally coordinated joint actions between individuals. Specifically, do humans rely on certain visual features of coordinated movements to facilitate the detection of meaningful interactivity? To address this question, participants viewed short video sequences of two actors performing different joint actions, such as handshakes, high fives, etc. Temporal misalignments were introduced to shift one actor's movements forward or backward in time relative to the partner actor. Participants rated the degree of interactivity for the temporally shifted joint actions. The impact of temporal offsets on human interactivity ratings varied for different types of joint actions. Based on human rating distributions, we used a probabilistic cluster model to infer latent categories, each revealing shared characteristics of coordinated movements among sets of joint actions. Further analysis on the clustered structure suggested that global motion synchrony, spatial proximity between actors, and highly salient moments of interpersonal coordination are critical features that impact judgments of interactivity.

Development of a simulation environment to support intercalibration studies over the Algodones Dunes system

The ability of sensors to detect changes in the Earth’s environment is dependent on retrieving radiometrically consistent and calibrated measurements from its surface. Intercalibration provides consistency among satellite instruments and ensures fidelity of scientific information. Intercalibration is especially important for spaceborne satellites without any on-board calibration, as accuracy of instruments is significantly affected by changes that occur postlaunch. To better understand the key parameters that impact the intercalibration process, this paper describes a simulation environment that was developed to support the primary mission of the Algodones Dunes campaign. Specifically, measurements obtained from the campaign were utilized to create a synthetic landscape to assess the feasibility of using the Algodones Dunes system as an intercalibration site for spaceborne instruments. The impact of two key parameters (differing view-angles and temporal offsets between instruments) on the intercalibration process was assessed. Results of these studies indicate that although the accuracy of intercalibration is sensitive to these parameters, proper knowledge of their impact leads to situations that minimize their effect. This paper concludes with a case study that addresses the feasibility of performing intercalibration on the International Space Station’s platform to support NASA’s CLARREO, the climate absolute radiance and refractivity observatory, mission.

Auditory and visual distractors disrupt multisensory temporal acuity in the crossmodal temporal order judgment task.

The ability to synthesize information across multiple senses is known as multisensory integration and is essential to our understanding of the world around us. Sensory stimuli that occur close in time are likely to be integrated, and the accuracy of this integration is dependent on our ability to precisely discriminate the relative timing of unisensory stimuli (crossmodal temporal acuity). Previous research has shown that multisensory integration is modulated by both bottom-up stimulus features, such as the temporal structure of unisensory stimuli, and top-down processes such as attention. However, it is currently uncertain how attention alters crossmodal temporal acuity. The present study investigated whether increasing attentional load would decrease crossmodal temporal acuity by utilizing a dual-task paradigm. In this study, participants were asked to judge the temporal order of a flash and beep presented at various temporal offsets (crossmodal temporal order judgment (CTOJ) task) while also directing their attention to a secondary distractor task in which they detected a target stimulus within a stream visual or auditory distractors. We found decreased performance on the CTOJ task as well as increases in both the positive and negative just noticeable difference with increasing load for both the auditory and visual distractor tasks. This strongly suggests that attention promotes greater crossmodal temporal acuity and that reducing the attentional capacity to process multisensory stimuli results in detriments to multisensory temporal processing. Our study is the first to demonstrate changes in multisensory temporal processing with decreased attentional capacity using a dual task paradigm and has strong implications for developmental disorders such as autism spectrum disorders and developmental dyslexia which are associated with alterations in both multisensory temporal processing and attention.

Camera/IMU Calibration Revisited

With growing interest in visual/inertial state estimation and an increasing number of approaches and applications emerging for this technology, camera/IMU calibration can be a valuable tool to increase the performance of these methods and to further the understanding of the involved sensor modalities. In this paper, we assess the impact of two different adjustments to the commonly used sensor models. First, we extend the IMU model to take the displacement of individual accelerometer axes into account. We show that especially high quality devices benefit from this extension, since these IMUs often employ separate sensors for each axis. Second, we propose a novel, direct model for the camera measurements that operates on image intensities rather than corner positions. This formulation is capable of explicitly accounting for motion blur and defocus, but it requires significant modeling efforts. Our results demonstrate that the transformation between camera and IMU can be estimated to a precision exceeding $\tfrac {1}{5}\mathrm { \text {m} \text {m} }$ and $\tfrac {1}{100}\mathrm { ^{\circ}}$ , while temporal offsets are determined to microsecond precision—on data sets of merely 20-s length. At the same time, image exposure time can be inferred to an accuracy of about $\tfrac {2}{100}\mathrm { \text {m} \text {s} }$ from motion blur.

A Neural “Tuning Curve” for Multisensory Experience and Cognitive-Perceptual Schizotypy

Our coherent perception of external events is enabled by the integration of inputs from different senses occurring within a range of temporal offsets known as the temporal binding window (TBW), which varies from person to person. A relatively wide TBW may increase the likelihood that stimuli originating from different environmental events are erroneously integrated and abnormally large TBW has been found in psychiatric disorders characterized by unusual perceptual experiences. Despite strong evidence of inter-individual differences in TBW, both within clinical and nonclinical populations, the neurobiological underpinnings of this variability remain unclear. We adopted an integrated strategy linking TBW to temporal dynamics in functional magnetic resonance imaging (fMRI)-resting-state activity and cortical excitation/inhibition (E/I) balance. E/I balance was indexed by glutamate/Gamma-AminoButyric Acid (GABA) concentrations and common variation in glutamate and GABA genes in a healthy sample. Stronger resting-state long-range temporal correlations, indicated by larger power law exponent (PLE), in the auditory cortex, robustly predicted narrower audio-tactile TBW, which was in turn associated with lower cognitive-perceptual schizotypy. Furthermore, PLE was highest and TBW narrowest for individuals with intermediate levels of E/I balance, with shifts towards either extreme resulting in reduced multisensory temporal precision and increased schizotypy, effectively forming a neural "tuning curve" for multisensory experience and schizophrenia risk. Our findings shed light on the neurobiological underpinnings of multisensory integration and its potentially clinically relevant inter-individual variability.

Consistency of vegetation index seasonality across the Amazon rainforest

Vegetation indices (VIs) calculated from remotely sensed reflectance are widely used tools for characterizing the extent and status of vegetated areas. Recently, however, their capability to monitor the Amazon forest phenology has been intensely scrutinized. In this study, we analyze the consistency of VIs seasonal patterns obtained from two MODIS products: the Collection 5 BRDF product (MCD43) and the Multi-Angle Implementation of Atmospheric Correction algorithm (MAIAC). The spatio-temporal patterns of the VIs were also compared with field measured leaf litterfall, gross ecosystem productivity and active microwave data. Our results show that significant seasonal patterns are observed in all VIs after the removal of view-illumination effects and cloud contamination. However, we demonstrate inconsistencies in the characteristics of seasonal patterns between different VIs and MODIS products. We demonstrate that differences in the original reflectance band values form a major source of discrepancy between MODIS VI products. The MAIAC atmospheric correction algorithm significantly reduces noise signals in the red and blue bands. Another important source of discrepancy is caused by differences in the availability of clear-sky data, as the MAIAC product allows increased availability of valid pixels in the equatorial Amazon. Finally, differences in VIs seasonal patterns were also caused by MODIS collection 5 calibration degradation. The correlation of remote sensing and field data also varied spatially, leading to different temporal offsets between VIs, active microwave and field measured data. We conclude that recent improvements in the MAIAC product have led to changes in the characteristics of spatio-temporal patterns of VIs seasonality across the Amazon forest, when compared to the MCD43 product. Nevertheless, despite improved quality and reduced uncertainties in the MAIAC product, a robust biophysical interpretation of VIs seasonality is still missing.

Angular oversampling with temporally offset layers on multilayer detectors in computed tomography.

Today's computed tomography (CT) scanners operate at an increasingly high rotation speed in order to reduce motion artifacts and to fulfill the requirements of dynamic acquisition, e.g., perfusion and cardiac imaging, with lower angular sampling rate as a consequence. In this paper, a simple method for obtaining angular oversampling when using multilayer detectors in continuous rotation CT is presented. By introducing temporal offsets between the measurement periods of the different layers on a multilayer detector, the angular sampling rate can be increased by a factor equal to the number of layers on the detector. The increased angular sampling rate reduces the risk of producing aliasing artifacts in the image. A simulation of a detector with two layers is performed to prove the concept. The simulation study shows that aliasing artifacts from insufficient angular sampling are reduced by the proposed method. Specifically, when imaging a single point blurred by a 2D Gaussian kernel, the method is shown to reduce the strength of the aliasing artifacts by approximately an order of magnitude. The presented oversampling method is easy to implement in today's multilayer detectors and has the potential to reduce aliasing artifacts in the reconstructed images.

The Effects of Odor Quality and Temporal Asynchrony on Modulation of Taste Intensity by Retronasal Odor.

The experiments had 2 main goals: 1) to add to the sparse literature on how retronasal aromas interact with bitter tastes, and 2) to determine whether modulation of taste intensity by aroma depends on temporal contiguity, as one might expect if flavor interactions depend on cross-modal binding (similar to object perception in other modalities). An olfactometer-gustometer allowed independent oral presentation of odorized air and liquid samples. First, using simultaneous presentation of odors and tastes (Experiments 1a-d) we found that a "sweet-smelling" aroma enhanced the rated sweetness of sucrose and decreased the rated bitterness of sucrose octaacetate (SOA), and that a "bitter-smelling" aroma enhanced the bitterness of SOA and decreased the sweetness of sucrose. Thus, with respect to effects on taste intensity, sweet and bitter aromas mimicked mixture-interactions between sweet and bitter tastes under current conditions. Next (Experiment 2), both odors were again paired with both tastes, with a parametric manipulation of odor onset. Odor presentation ranged from before taste delivery to after taste delivery. Enhancement of taste intensity was greatest with simultaneous onset, and greatly attenuated with offsets of 1s. These results are consistent with the idea that enhancement of taste by retronasal aroma depends on a temporal binding window like many other cross-modal interactions. The effects of temporal offsets on suppression of taste were inconclusive. These findings are discussed within the context of past work on odor-taste interactions.

Temporal Offsets Between Maximum CME Speed Index and Solar, Geomagnetic, and Interplanetary Indicators During Solar Cycle 23 and the Ascending Phase of Cycle 24

On the basis of morphological analysis of yearly values of the maximum CME (coronal mass ejection) speed index, the sunspot number and total sunspot area, sunspot magnetic field, and solar flare index, the solar wind speed and interplanetary magnetic field strength, and the geomagnetic Ap and Dst indices, we point out the particularities of solar and geomagnetic activity during the last cycle 23, the long minimum which followed it and the ascending branch of cycle 24. We also analyze temporal offset between the maximum CME speed index and the above-mentioned solar, geomagnetic, and interplanetary indices. It is found that this solar activity index, analyzed jointly with other solar activity, interplanetary parameters, and geomagnetic activity indices, shows a hysteresis phenomenon. It is observed that these parameters follow different paths for the ascending and the descending phases of solar cycle 23. It is noticed that the hysteresis phenomenon represents a clue in the search for physical processes responsible for linking the solar activity to the near-Earth and geomagnetic responses.

Visual Mislocalization of Moving Objects in an Audiovisual Event.

The present study investigated the influence of an auditory tone on the localization of visual objects in the stream/bounce display (SBD). In this display, two identical visual objects move toward each other, overlap, and then return to their original positions. These objects can be perceived as either streaming through or bouncing off each other. In this study, the closest distance between object centers on opposing trajectories and tone presentation timing (none, 0 ms, ± 90 ms, and ± 390 ms relative to the instant for the closest distance) were manipulated. Observers were asked to judge whether the two objects overlapped with each other and whether the objects appeared to stream through, bounce off each other, or reverse their direction of motion. A tone presented at or around the instant of the objects’ closest distance biased judgments toward “non-overlapping,” and observers overestimated the physical distance between objects. A similar bias toward direction change judgments (bounce and reverse, not stream judgments) was also observed, which was always stronger than the non-overlapping bias. Thus, these two types of judgments were not always identical. Moreover, another experiment showed that it was unlikely that this observed mislocalization could be explained by other previously known mislocalization phenomena (i.e., representational momentum, the Fröhlich effect, and a turn-point shift). These findings indicate a new example of crossmodal mislocalization, which can be obtained without temporal offsets between audiovisual stimuli. The mislocalization effect is also specific to a more complex stimulus configuration of objects on opposing trajectories, with a tone that is presented simultaneously. The present study promotes an understanding of relatively complex audiovisual interactions beyond simple one-to-one audiovisual stimuli used in previous studies.

A General Approach to Spatiotemporal Calibration in Multisensor Systems

With growing demands for accuracy in sensor fusion, increasing attention is being paid to temporal offsets as a source of deterministic error when processing data from multiple devices. Established approaches for the calibration of temporal offsets exploit domain-specific heuristics of common sensor suites and utilize simplifications to circumvent some of the challenges arising when both temporal and spatial parameters are not accurately known a priori . These properties make it difficult to generalize the work to other applications or different combinations of sensors. This work presents a general and principled approach to joint estimation of temporal offsets and spatial transformations between sensors. Our framework exploits recent advances in continuous-time batch estimation and thus exists within the rigorous theoretical framework of maximum likelihood estimation. The derivation is presented without relying on unique properties of specific sensors and, therefore, represents the first general technique for temporal calibration in robotics. The broad applicability of this approach is demonstrated through spatiotemporal calibration of a camera with respect to an inertial measurement unit as well as between a stereo camera and a laser range finder. The method is shown to be more repeatable and accurate than the current state of the art, estimating spatial displacements to millimeter precision and temporal offsets to a fraction of the fastest measurement interval.