Measuring and quantifying dynamic visual signals in jumping spiders

Abstract

Animals emit visual signals that involve simultaneous, sequential movements of appendages that unfold with varying dynamics in time and space. Algorithms have been recently reported (e.g. Peters et al. in Anim Behav 64:131-146, 2002) that enable quantitative characterization of movements as optical flow patterns. For decades, acoustical signals have been rendered by techniques that decompose sound into amplitude, time, and spectral components. Using an optic-flow algorithm we examined visual courtship behaviours of jumping spiders and depict their complex visual signals as "speed waveform", "speed surface", and "speed waterfall" plots analogous to acoustic waveforms, spectrograms, and waterfall plots, respectively. In addition, these "speed profiles" are compatible with analytical techniques developed for auditory analysis. Using examples from the jumping spider Habronattus pugillis we show that we can statistically differentiate displays of different "sky island" populations supporting previous work on diversification. We also examined visual displays from the jumping spider Habronattus dossenus and show that distinct seismic components of vibratory displays are produced concurrently with statistically distinct motion signals. Given that dynamic visual signals are common, from insects to birds to mammals, we propose that optical-flow algorithms and the analyses described here will be useful for many researchers.