Compound Eye Vision Research Articles

Gradient-metasurface directional photodetectors.

Angle-sensitive photodetectors are a promising device technology for many advanced imaging functionalities, including lensless compound-eye vision, lightfield sensing, optical spatial filtering, and phase imaging. Here we demonstrate the use of plasmonic gradient metasurfaces to tailor the angular response of generic planar photodetectors. The resulting devices rely on the phase-matched coupling of light incident at select geometrically tunable angles into guided plasmonic modes, which are then scattered and absorbed in the underlying photodetector active layer. This approach naturally introduces sharp peaks in the angular response, with smaller footprint and reduced guided-mode radiative losses (and therefore improved spatial resolution and sensitivity) compared to analogous devices based on diffractive coupling. More broadly, these results highlight a promising new application space of flat optics, where gradient metasurfaces are integrated within image sensors to enable unconventional capabilities with enhanced system miniaturization and design flexibility.

Muscles that move the retina augment compound eye vision in Drosophila.

Most animals have compound eyes, with tens to thousands of lenses attached rigidly to the exoskeleton. A natural assumption is that all of these species must resort to moving either their head ortheir body to actively change their visual input. However, classic anatomy has revealed that flies have muscles poised to move their retinas under the stable lenses of each compound eye1-3. Here we show that Drosophila use their retinal muscles to smoothly track visual motion, which helps to stabilize the retinal image, and also to perform small saccades when viewing a stationary scene. We show that when the retina moves, visual receptive fields shift accordingly, and that even the smallest retinal saccades activate visual neurons. Using a head-fixed behavioural paradigm, we find that Drosophila perform binocular, vergence movements of their retinas-which could enhance depth perception-when crossing gaps, and impairing the physiology of retinal motor neurons alters gap-crossing trajectories during free behaviour. That flies evolved an ability to actuate their retinas suggests that moving the eye independently of the head is broadly paramount for animals. The similarities of smooth and saccadic movements of the Drosophila retina and the vertebrate eye highlight a notable example of convergent evolution.

Building 2D Model of Compound Eye Vision for Machine Learning

This paper presents a two-dimensional mathematical model of compound eye vision. Such a model is useful for solving navigation issues for autonomous mobile robots on the ground plane. The model is inspired by the insect compound eye that consists of ommatidia, which are tiny independent photoreception units, each of which combines a cornea, lens, and rhabdom. The model describes the planar binocular compound eye vision, focusing on measuring distance and azimuth to a circular feature with an arbitrary size. The model provides a necessary and sufficient condition for the visibility of a circular feature by each ommatidium. On this basis, an algorithm is built for generating a training data set to create two deep neural networks (DNN): the first detects the distance, and the second detects the azimuth to a circular feature. The hyperparameter tuning and the configurations of both networks are described. Experimental results showed that the proposed method could effectively and accurately detect the distance and azimuth to objects.

Fabrication of a light screen-aperture integrated flexible thin film micro-lens array for a biomimetic superposition compound eye.

Micro-lens array, an artificial compound eye vision system, provides a wide field of view and multi-perspective view. However, it has not been adopted as a computer vision application due to its limited visible range and high optical interference. In this research, a novel fabrication method for the flexible polydimethylsiloxane micro-lens array with a polytetrafluoroethylene light screen-aperture integrated layer was established by the simple protrusion method. The integrated layer provided longer visible range by one meter while maintaining the wide field-of-view of 100 °. The resulting images were used for obtaining depth information of a target as an example and for analyzing the rectangular and hexagonal arrangements of the micro-lenses for the future applications. With the improved visual range, wide field-of-view and flexibility, the fabricated micro-lens array can be applied to the small and curved CMOS image sensors in the future.

Analysis and Optimization of Computer Trajectory Based on Compound Eye Vision System

With the rapid development of science and technology, people have higher and higher requirements for target detection technology, which requires us to solve the disadvantages of traditional cameras, such as the difficulty of panoramic photography and continuous tracking motion. However, compound eye insects have a visual system composed of fewer neurons, which can achieve rapid detection and capture of objects of interest. Therefore, based on the principle of compound eye vision, a bionic compound eye panoramic detection system is designed in this paper, which can realize panoramic real-time detection through multiple sub eye cameras. Through the compound eye vision system, we can accurately locate the pan tilt controller, which can provide a comprehensive panoramic motion image. Through the principle of automatic windowing, we can acquire the image of moving area by multi-layer window. Then, through the relevant image processing methods, such as binarization, median filtering, spatial filtering, moving object detection, edge detection and other methods, we can get a relatively clear moving object contour and trajectory analysis, which can achieve full field of view, high sensitivity detection and tracking.

Motion Track Optimization Based On Compound Eye Vision System

Aiming at many defects of human eye and computer vision system, based on the principle of multi-channel independent imaging, a method for fast determination of moving trajectory of moving target based on compound eye vision system is proposed. The principle, structure and algorithm of the traditional vision system and the compound eye vision system are compared and analyzed, and it is concluded that the compound eye vision system is superior to the traditional human eye and the computer vision system in the aspects of large wide angle, reaction speed and pixel. The SIFT method is used to extract image features quickly from different images, and the compound eye vision system is used to optimize the motion trajectory.

Bioinspired Optical Sensor for Remote Measurement of Small Displacements at a Distance.

Identifying appropriate sites for landing a spacecraft or building permanent structures is critical for extraterrestrial exploration. By tracking the movement of land masses and structures on a planetary surface, scientists can better predict issues that could affect the integrity of the site or structures. A lightweight, low-cost, low-power bioinspired optical sensor is being developed at the National Aeronautics and Space Administration (NASA) Ames Research Center to remotely measure small displacements of land masses on either side of a fault. This paper describes the sensor, which is inspired by the compound eye vision system found in many insects, and the algorithms developed to estimate displacement. The results are presented for indoor and outdoor tests using the sensor to measure the displacement of a specially designed target that is located 0.35, 6, and 30 m from the sensor and is moved 10 mm to the left and right of a centered position, simulating the displacement of land masses on either side of a fault. Measurement uncertainties estimates were a few tenths of a millimeter when the target was located 0.35 and 6 m from the sensor. At the 30 m distance, corrections were required to obtain accuracies in the order of 1 mm.

Ommochromes in invertebrates: biochemistry and cell biology.

Ommochromes are widely occurring coloured molecules of invertebrates, arising from tryptophan catabolism through the so-called Tryptophan → Ommochrome pathway. They are mainly known to mediate compound eye vision, as well as reversible and irreversible colour patterning. Ommochromes might also be involved in cell homeostasis by detoxifying free tryptophan and buffering oxidative stress. These biological functions are directly linked to their unique chromophore, the phenoxazine/phenothiazine system. The most recent reviews on ommochrome biochemistry were published more than 30 years ago, since when new results on the enzymes of the ommochrome pathway, on ommochrome photochemistry as well as on their antiradical capacities have been obtained. Ommochromasomes are the organelles where ommochromes are synthesised and stored. Hence, they play an important role in mediating ommochrome functions. Ommochromasomes are part of the lysosome-related organelles (LROs) family, which includes other pigmented organelles such as vertebrate melanosomes. Ommochromasomes are unique because they are the only LRO for which a recycling process during reversible colour change has been described. Herein, we provide an update on ommochrome biochemistry, photoreactivity and antiradical capacities to explain their diversity and behaviour both in vivo and in vitro. We also highlight new biochemical techniques, such as quantum chemistry, metabolomics and crystallography, which could lead to major advances in their chemical and functional characterisation. We then focus on ommochromasome structure and formation by drawing parallels with the well-characterised melanosomes of vertebrates. The biochemical, genetic, cellular and microscopic tools that have been applied to melanosomes should provide important information on the ommochromasome life cycle. We propose LRO-based models for ommochromasome biogenesis and recycling that could be tested in the future. Using the context of insect compound eyes, we finally emphasise the importance of an integrated approach in understanding the biological functions of ommochromes.

Three-Dimensional Information Acquisition Based on Artificial Compound Eye Vision System

In this paper, the artificial compound eye vision system is used to develop an effective algorithm for acquiring 3D information of object. According to compound eye vision system constructed, the imaging principle and correlation between the object point and the imaging point is analyzed. Then the cross correlation matching algorithm is present to extract the depth and obtain the 3D information. The influence factors such as number of matched elemental images and matching window size are considered and analyzed. The experimental is implemented to verify the validity of the proposed method.