Retinal Prosthesis Research Articles

Ultra‐Low Power Photosynaptic Devices Based on Persistent Photoconductivity‐Modulated SnO2

AbstractRealizing visual perception performance using robust metal oxide devices is highly desirable for brain‐inspired neuromorphic computing, visual prosthetics, and artificial intelligence. SnO2, a representative transparent semiconductor, has attracted considerable attention for its potential in ultraviolet photodetectors and photosynaptic devices operating in solar‐blind spectral ranges. This problem has been circumvented by lowering the electron concentration and reducing the persistent photoconductivity (PPC), one of the essential properties of photosynaptic devices. In this case, the electron concentration and PPC properties in SnO2 must be controlled independently. This paper reports the successful control of PPC in SnO2 by controllable addition of Zn and Sr ions, which act as acceptors to annihilate the charge carriers and as a reductant to form oxygen vacancies, respectively. Zn and Sr‐added SnO2 exhibits superior synaptic performance with low energy consumption, successfully imitating the biological synapses without a gate electrode. As a result, the PPC remains at about 40% even after 20 seconds of turning off the ultraviolet light, and energy consumption is reduced to 1–10 fJ, similar to energy consumption with biological synapses. A novel optical sensor that can receive analog signals is demonstrated using a photosynaptic device with Zn and Sr‐added SnO2 thin films.

Aligning visual prosthetic development with implantee needs.

Visual prosthetics are a promising assistive technology for vision loss, yet research often overlooks the human aspects of this technology. While previous studies focus on the perceptual experiences or attitudes of implant recipients (implantees), a systematic account of how current implants are being used in everyday life is still lacking . We interviewed six recipients of the most widely used visual implants (Argus II and Orion) and six leading researchers in the field. Through thematic analyses, we explored the daily usage of these implants by implantees and compared their responses to the expectations of researchers. We also sought implantees' input on desired features for future versions, aiming to inform the development of the next generation of implants. Although implants are designed to facilitate various daily activities, we found that implantees use them less frequently than researchers expect. This discrepancy primarily stems from issues with usability and reliability, with implantees finding alternative methods to accomplish tasks, reducing the need to rely on the implant. For future implants, implantees emphasized the desire for improved vision, smart integration, and increased independence. Our study reveals a significant gap between researcher expectations and implantee experiences with visual prostheses. Although limited by access to a small population of implantees, this study highlights the importance of focusing future research on usability and real-world applications. This retrospective qualitative study advocates for a better alignment between technology development and implantee needs to enhance clinical relevance and practical utility of visual prosthetics.

Advances and challenges in the development of visual prostheses.

The past 20 years have witnessed significant advancements in the field of visual prostheses, with developments spanning from early retinal implants to recent cortical approaches. This Perspective looks at some of the remaining challenges to achieve the ambitious clinical goals that these technologies could enable.

Reconfigurable Homojunction Phototransistor for Near-Zero Power Consumption Artificial Biomimetic Retina Function.

Semiconductor photodetectors integrating preliminary signal-processing functions play a vital role in artificial biomimetic retina systems. Herein, we propose a tungsten diselenide (WSe2) phototransistor with a dual-layer gate dielectric and an asymmetric graphene insert structure. This phototransistor exhibits a bidirectional self-powered photocurrent by controlling the gate voltage via the formation of reconfigurable p+-p and n-p homojunctions in the channel from the asymmetric graphene insert. At the same time, the nonvolatile electron and hole stored in the dual-layer gate dielectric are generated using a temporary gate voltage, which can replace the gate voltage to regulate the channel charge. Moreover, the photocurrent shows a linear relation with the temporary programming gate voltage. The phototransistor exhibits a rectification ratio of >4 orders of magnitude without the gate voltage, indicating its significant capability to operate in a fully self-powered mode with near-zero power consumption. Based on the device characteristics, we successfully simulate the biological functions of the photoreceptor layer and bipolar cell layer in the retinal receptive field. The identification of the object motion direction in the receptive field can be realized by integrating three programmable devices on the chip. Furthermore, edge enhancement of the image is achieved by independently modulating the light response of each pixel in the sensor by varying the programming gate voltage. This study will promote the developing progress of future artificial biomimetic retina systems.

Highly Photoresponsive Vertically Stacked Silicon Nanowire Photodetector with Biphasic Current Stimulator IC for Retinal Prostheses

This paper presents an integrated approach for a retinal prosthesis that overcomes the scalability challenges and limitations of conventional systems that use external cameras. Silicon nanowires (SiNWs) are utilized as photonic sensors due to their nanoscale dimensions and high surface-to-volume ratio. To enhance these properties and achieve high photoresponsivity, our research team developed a vertically stacked SiNW structure using a fabrication method entirely based on dry etching. The fabricated SiNW photodetector demonstrated excellent electrical and optical characteristics, including linear I–V characteristics that confirmed ohmic contact formation and high photoresponsivity exceeding 105 A/W across the 400–800 nm wavelength range. The SiNW photodetector, following its integration with a switched capacitor stimulator circuit, exhibited a proportional increase in stimulation current in response to higher light intensity and increased SiNW density. In vitro experiments confirmed the efficacy of the integrated system in inducing neural responses from retinal cells, as indicated by an increased number of neural spikes observed at higher light intensities and SiNW densities. This study contributes to sensor technology by demonstrating an approach to integrating nanostructures and electronic components, which enhances control and functionality.

Enhancing wayfinding in simulated prosthetic vision through semantic segmentation and rastering

Enhancing wayfinding in simulated prosthetic vision through semantic segmentation and rastering

Design and analysis of the liquid lens system for bionic human eye imaging

In this paper, the liquid lens system for bionic human eye imaging is designed based on the principles of dielectrophoretic drive and hydraulic drive. The core part of this lens system is the biconvex liquid lens of the bionic human eye crystalline lens. Based on this part, a PDMS membrane liquid lens module and a liquid chamber are added, which are combined with the biconvex liquid lens to form a structure that can be used to represent the cornea, the anterior chamber, the vitreous body and other parts of the human eye. It is a combined structural design to realize the whole human eye liquid lens system. The design of the system model and the analysis of ray tracing are mainly accomplished with COMSOL software, and the experimental research of the system is carried out. The whole liquid lens device for the bionic human eye is fabricated; its zoom characteristics and imaging resolution are measured at fixed volumes of liquid injection with different voltages and at fixed voltages with different volumes of liquid injection, respectively. The results show that the zoom range of the liquid lens system for bionic human eye imaging is 24.81mm-13.07 mm, which can reflect the zoom characteristics of general human eyes, and its imaging resolution can reach a maximum of 90.51lp/mm.

A flexible high-precision photoacoustic retinal prosthesis.

Retinal degenerative diseases of photoreceptors are a leading cause of blindness with no effective treatment. Retinal prostheses seek to restore sight by stimulating remaining retinal cells. We here present a photoacoustic retinal stimulation technology. We designed a polydimethylsiloxane and carbon-based flexible film that converts near-infrared laser pulses into a localized acoustic field, aiming at high-precision acoustic activation of mechanosensitive retinal cells. This photoacoustic stimulation of wild-type and degenerated ex vivo retinae resulted in robust and localized retinal ganglion cell activation with sub-100-µm resolution in both wild-type and degenerated ex vivo retinae. Our millimeter-size photoacoustic film generated neural activation in vivo along the visual pathway to the superior colliculus, as measured by functional ultrasound imaging when the film was implanted in the rat subretinal space and stimulated by pulsed laser. Biosafety of the film was indicated by absence of short-term adverse effect under optical coherence tomography retinal imaging, while local thermal increase was measured below 1 °C. These findings demonstrate the potential of our photoacoustic stimulation for visual restoration in blind patients with a high spatial precision and a large field of view.

Wireless and Opto-Stimulated Flexible Implants: Artificial Retina Constructed by Ferroelectric BiFeO3-BaTiO3/P(VDF-TrFE) Composites.

The degeneration of retinal photoreceptors is one of the primary causes of blindness, and the implantation of retinal prostheses offers hope for vision restoration in individuals who are completely blind. Flexible bioelectronic devices present a promising avenue for the next generation of retinal prostheses owing to their soft mechanical properties and tissue friendliness. In this study, we developed flexible composite films of ferroelectric BiFeO3-BaTiO3 (BFO-BTO) particles synthesized by the hydrothermal method and ferroelectric poly(vinyldene difluoride-trifluoroethylene) (P(VDF-TrFE)) polymer and investigated their applications in artificial retinas. Owing to the coupling of the photothermal effect of BFO-BTO particles and the pyroelectric effect of the P(VDF-TrFE) polymer, the composite films demonstrate a strong photoelectric response (a maximum peak-to-peak photovoltage > 80 V under blue light of 100 mW/cm2) in a wide wavelength range of light (from visible to infrared) with the inherent flexibility and ease of preparation, making it an attractive candidate for artificial retinal applications. Experimental results showed that blind rats implanted with artificial retinas of the composites display light-responsive behavior, showcasing the effectiveness of vision restoration. This study demonstrates a novel approach for employing ferroelectric materials in vision restoration and offers insights into future artificial retina design.

Adhesion of retinal cells to gold surfaces by biomimetic molecules.

Neural cell-electrode coupling is crucial for effective neural and retinal prostheses. Enhancing this coupling can be achieved through surface modification and geometrical design to increase neuron-electrode proximity. In the current research, we focused on designing and studying various biomolecules as a method to elicit neural cell-electrode adhesion via cell-specific integrin mechanisms. We designed extracellular matrix biomimetic molecules with different head sequences (RGD or YIGSR), structures (linear or cyclic), and spacer lengths (short or long). These molecules, anchored by a thiol (SH) group, were deposited onto gold surfaces at various concentrations. We assessed the modifications using contact angle measurements, fluorescence imaging, and X-ray Photoelectron Spectroscopy (XPS). We then analyzed the adhesion of retinal cells and HEK293 cells to the modified surfaces by measuring cell density, surface area, and focal adhesion spots, and examined changes in adhesion-related gene and integrin expression. Results showed that YIGSR biomolecules significantly enhanced retinal cell adhesion, regardless of spacer length. For HEK293 cells, RGD biomolecules were more effective, especially with cyclic RGD and long spacers. Both cell types showed increased expression of specific adhesion integrins and proteins like vinculin and PTK2; these results were in agreement with the adhesion studies, confirming the cell-specific interactions with modified surfaces. This study highlights the importance of tailored biomolecules for improving neural cell adhesion to electrodes. By customizing biomolecules to foster specific and effective interactions with adhesion integrins, our study provides valuable insights for enhancing the integration and functionality of retinal prostheses and other neural implants.

Retinal Prostheses: Basic Introduction, Current Technology Investigate and Future Outlooks

This passage would briefly introduce the Retinal Implant technology from three aspects: System, structure and signal processing of the Retinal implantation, reviewing on several existing specific example in the market, also comparing and contrasting them and making possible suggestions of future developing pathways.

Humanoid robot eyeballs driven by bubble artificial muscles

Currently, service robots play an increasingly significant role in human-computer interaction, and have their intelligent, humanized, emotional, and expressive capabilities have constantly improved. Eye movement is essential for humanoid service robot facial expression, which may significantly improve human-computer connection. This project aims to create bionic robot eyes powered by novel bubble artificial muscles (BAMs), resulting in low-cost and straightforward robot eyes with horizontal, vertical, and mixed ocular movement capabilities. By adjusting the air pressure input to the BAMs, an antagonistic mechanism composed of a BAM and a tension spring is meant to move an eyeball horizontally or vertically. The results of an experiment reveal that humanoid robot eyeballs can imitate human eye movement. This research will contribute to the development of a low-weight, low-cost humanoid service robot eyeball drive system that can realise the expression of robot facial expression by controlling the movement of robot eyeball, thereby enabling humanoid servers to effectively express their feelings and emotions in accordance with human needs and enhancing user interaction.

A novel interface for cortical columnar neuromodulation with multipoint infrared neural stimulation

Cutting edge advances in electrical visual cortical prosthetics have evoked perception of shapes, motion, and letters in the blind. Here, we present an alternative optical approach using pulsed infrared neural stimulation. To interface with dense arrays of cortical columns with submillimeter spatial precision, both linear array and 100-fiber bundle array optical fiber interfaces were devised. We deliver infrared stimulation through these arrays in anesthetized cat visual cortex and monitor effects by optical imaging in contralateral visual cortex. Infrared neural stimulation modulation of response to ongoing visual oriented gratings produce enhanced responses in orientation-matched domains and suppressed responses in non-matched domains, consistent with a known higher order integration mediated by callosal inputs. Controls include dynamically applied speeds, directions and patterns of multipoint stimulation. This provides groundwork for a distinct type of prosthetic targeted to maps of visual cortical columns.

Pattern-reversal visual evoked potentials in prosthetic vision and simulated visual reduction

ObjectiveTo quantitatively evaluate visual evoked potentials (VEPs) in prosthetic vision and simulated visual reduction.Methods and analysisFour blind patients implanted with the Argus II retinal prosthesis and seven sighted controls participated....

A Review on Recent Advances in Vision Prostheses

A Review on Recent Advances in Vision Prostheses

Comparison of modulation efficiency between normal and degenerated primate retina.

With electrical stimulation, retinal prostheses bypass dysfunctional photoreceptors and activate the surviving bipolar or retinal ganglion cells (RGCs). Therefore, the effective modulation of RGCs is crucial for developing retinal prostheses. Substantial research has been performed on the ability of an electrical stimulus to generate a reliable RGC response. However, different experimental conditions show varying levels of how well the electrical stimulation evokes RGC spikes. Therefore, in this study, we attempted to extract an indicator to understand how the electrical stimulation effectively evokes RGC spikes. Six cynomolgus monkeys were used: three as controls and three as an N-methyl-N-nitrosourea (MNU)-induced retinal degeneration model. The retinal recordings were performed using 8 × 8 multi-electrode arrays (MEAs). Electrical stimulation consisted of symmetrical biphasic pulses of varying amplitudes and durations. The number of stimulation conditions that resulted in significantly higher post-stimulation firing rates than pre-stimulus firing rates was defined as the modulation efficiency ratio (MER). The MER was significantly lower in degenerated retinas than in normal retinas. We investigated the relationship between the variables and the MER in normal and degenerated primate RGCs. External variables, such as duration and inter-electrode distance, and internal variables, such as average firing rates and statistics (mean, standard deviation, and coefficient of variation [CV]) of inter-spike intervals (ISIs) of spontaneous spikes, were used. External variables had similar effects on MER in normal and degenerated RGCs. In contrast, internal variables affected MER differently in normal and degenerated RGCs. While in normal RGCs, they were not related to MER, in degenerated RGCs, the mean ISIs were positively correlated with MER, and the CV of ISIs was negatively correlated with MER. The most important variable affecting MER was the mean ISI. A shorter ISI indicates hyperactive firing in the degenerated retina, which prevents electrical stimulation from evoking more RGCs. We believe that this hyperactivity in degenerated retinas results in a lower MER than that in the normal retina. Our findings can be used to optimize the selection of stimulation channels for in vitro MEA experiments and practical calibration methods to achieve higher efficiency when testing retinal prostheses.

Accelerated Simulation of Multi-Electrode Arrays Using Sparse and Low-Rank Matrix Techniques.

Modeling of Multi-Electrode Arrays used in neural stimulation can be computationally challenging since it may involve incredibly dense circuits with millions of interconnected resistors, representing current pathways in an electrolyte (resistance matrix), coupled to nonlinear circuits of the stimulating pixels themselves. Here, we present a method for accelerating the modeling of such circuits while minimizing the error of a simplified simulation by using a sparse plus low-rank approximation of the resistance matrix. Specifically, we prove that thresholding of the resistance matrix elements enables its sparsification with minimized error. This is accomplished with a sorting algorithm implying efficient O (N log (N)) complexity. The eigenvalue-based low-rank compensation then helps achieve greater accuracy without adding significantly to the problem size. Utilizing these matrix techniques, we accelerated the simulation of multi-electrode arrays by an order of magnitude, reducing the computation time by about 10-fold, while maintaining an average error of less than 0.3% in the current injected from each electrode. We also show a case where acceleration reaches at least 133 times with additional error in the range of 4%, demonstrating the ability of this algorithm to perform under extreme conditions. Although the techniques presented here are used for simulations of photovoltaic retinal prostheses, they are also immediately applicable to any circuit involving dense connections between nodes, and, with modifications, more generally to any systems involving non-sparse matrices. This approach promises significant improvements in the efficiency of modeling the next-generation retinal implants having thousands of pixels, enabling iterative design with broad applicability.

A virtual patient simulation modeling the neural and perceptual effects of human visual cortical stimulation, from pulse trains to percepts

The field of cortical sight restoration prostheses is making rapid progress with three clinical trials of visual cortical prostheses underway. However, as yet, we have only limited insight into the perceptual experiences produced by these implants. Here we describe a computational model or ‘virtual patient’, based on the neurophysiological architecture of V1, which successfully predicts the perceptual experience of participants across a wide range of previously published human cortical stimulation studies describing the location, size, brightness and spatiotemporal shape of electrically induced percepts in humans. Our simulations suggest that, in the foreseeable future the perceptual quality of cortical prosthetic devices is likely to be limited by the neurophysiological organization of visual cortex, rather than engineering constraints.

Fabrication of liquid-filled zoom compound eyes with a tunable focal length

The conventional bionic compound eye system encounters challenges associated with a complex zoom structure, susceptibility to wear, and elevated costs. In this paper, a preparation method of liquid-filled zoom compound eyes is proposed. A polydimethylsiloxane (PDMS) film is integrated with a microfluidic chamber composed of polymethyl methacrylate (PMMA). The microlens array (MLA, hexagonal array, diameter 800 µm, center distance 850 µm) on the PDMS film is prepared by a wettability-guided dipping method. The sub-eye focal length on zoom compound eyes (ZCEs) is 1.42 mm. By controlling the volume of deionized (DI) water injected into the chamber from 2.41 to 2.71cm3, the focal length of the main lens is adjusted from infinity to 55.51 mm, and the FOV is adjusted from 32° to 58°. This large aperture ZCE combines the advantages of monocular and compound eyes. This method has great potential for advanced micro-optical devices with a wide field of view and tunable imaging capabilities.

Neural activity shaping in visual prostheses with deep learning

Objective. The visual perception provided by retinal prostheses is limited by the overlapping current spread of adjacent electrodes. This reduces the spatial resolution attainable with unipolar stimulation. Conversely, simultaneous multipolar stimulation guided by the measured neural responses—neural activity shaping (NAS)—can attenuate excessive spread of excitation allowing for more precise control over the pattern of neural activation. However, defining effective multipolar stimulus patterns is a challenging task. Previous attempts focused on analytical solutions based on an assumed linear nonlinear model of retinal response; an analytical model inversion (AMI) approach. Here, we propose a model-free solution for NAS, using artificial neural networks (ANNs) that could be trained with data acquired from the implant. Approach. Our method consists of two ANNs trained sequentially. The measurement predictor network (MPN) is trained on data from the implant and is used to predict how the retina responds to multipolar stimulation. The stimulus generator network is trained on a large dataset of natural images and uses the trained MPN to determine efficient multipolar stimulus patterns by learning its inverse model. We validate our method in silico using a realistic model of retinal response to multipolar stimulation. Main results. We show that our ANN-based NAS approach produces sharper retinal activations than the conventional unipolar stimulation strategy. As a theoretical bench-mark of optimal NAS results, we implemented AMI stimulation by inverting the model used to simulate the retina. Our ANN strategy produced equivalent results to AMI, while not being restricted to any specific type of retina model and being three orders of magnitude more computationally efficient. Significance. Our novel protocol provides a method for efficient and personalized retinal stimulation, which may improve the visual experience and quality of life of retinal prosthesis users.