Prototype Camera Research Articles

System characterization and performance studies with MACACO III Compton camera

The IRIS group of IFIC-Valencia has developed a Compton camera prototype. The system detectors are made of Lanthanum (III) bromide scintillator crystals coupled to silicon photomultipliers. Two models of silicon photomultipliers arrays with different micro pixel pitch (25 and 50 μm) have been chosen as possible candidates to improve the response of the new system. Characterization studies with a 22Na point-like source have indicated that the 25 μm photodetector provided better performance in terms of energy resolution (5.2% FWHM at 511 keV) and angular resolution (6.9∘ FWHM at 1275 keV), and more stability with temperature variations. In addition, MACACO III imaging capabilities have been assessed using a structure composed of thirty-seven 22Na point-like sources. Furthermore, in order to evaluate possible ways of improving the system performance, several studies have been carried out by means of simulations both in realistic and performance improved conditions. In this work, the system performance is evaluated for its future application in different areas.

Development of a two-layer dense-pixel LYSO Compton camera prototype for prompt gamma imaging

Objective. Lutetium–yttrium orthosilicate (LYSO)-based Compton camera (CC) has been proposed for prompt gamma imaging due to its high detection efficiency and position resolution. However, very few LYSO CC prototypes have been built and used for practical evaluation. In this study, we built a lightweight dense-pixel silicon photomultiplier-based two-layer LYSO CC prototype for future prompt gamma imaging. Approach. We attempt the first-ever effort to use the double-encoding with the thick light guide and coding circuit structure for 46 × 46 dense-pixel LYSO detectors construction and use pixel segmentation based on centroid mapping to obtain 4232 spectral calibrations. We also present a framework for list-mode projection data acquisition based on the decoding of the time series data obtained by data acquisition card in this study. Finally, the standard source calibration, ring-like 22Na source with non-uniform intensity, and mixed point-like source with a wide energy spectrum experiments were implemented to evaluate the resolution metrics and imaging performance of the prototype. Main results. The lateral position resolution of the prototype was 1 mm, and the maximum measurement deviation is 2.5 mm and 5 mm in the depth direction for the scatterer and absorber, respectively. In the experiments, the measured energy resolution was 9.63% @ 1.33 MeV for the scatterer and 10.8% @ 1.33 MeV for the absorber. And the detection efficiency of the prototype for a spherical 60Co source with a diameter of 2.8 mm at 10 cm far was 5.7 × 10−3 @ 1.33 MeV and the full width at half maximum of the reconstruction was 5.5 mm. Besides, the spatial position offset within 2 mm of the radioactive source at 10 cm can be distinguished. Signification. The developed two-layer dense-pixel LYSO CC contributes to incorporating Compton imaging techniques for prompt gamma detection and multiple energy sources into nuclear medical imaging.

A Wide Energy Range and 4π-View Gamma Camera with Interspaced Position-Sensitive Scintillator Array and Embedded Heavy Metal Bars.

(1) Background: Gamma cameras have wide applications in industry, including nuclear power plant monitoring, emergency response, and homeland security. The desirable properties of a gamma camera include small weight, good resolution, large field of view (FOV), and wide imageable source energy range. Compton cameras can have a 4π FOV but have limited sensitivity at low energy. Coded-aperture gamma cameras are operatable at a wide photon energy range but typically have a limited FOV and increased weight due to the thick heavy metal collimators and shielding. In our lab, we previously proposed a 4π-view gamma imaging approach with a 3D position-sensitive detector, with which each detector element acts as the collimator for other detector elements. We presented promising imaging performance for 99mTc, 18F, and 137Cs sources. However, the imaging performance for middle- and high-energy sources requires further improvement. (2) Methods: In this study, we present a new gamma camera design to achieve satisfactory imaging performance in a wide gamma energy range. The proposed gamma camera consists of interspaced bar-shaped GAGG (Ce) crystals and tungsten absorbers. The metal bars enhance collimation for high-energy gamma photons without sacrificing the FOV. We assembled a gamma camera prototype and conducted experiments to evaluate the gamma camera’s performance for imaging 57Co, 137Cs, and 60Co point sources. (3) Results: Results show that the proposed gamma camera achieves a positioning accuracy of <3° for all gamma energies. It can clearly resolve two 137Cs point sources with 10° separation, two 57Co and two 60Co point sources with 20° separation, as well as a 2 × 3 137Cs point-source array with 20° separation. (4) Conclusions: We conclude that the proposed gamma camera design has comprehensive merits, including portability, 4π-view FOV, and good angular resolution across a wide energy range. The presented approach has promising potential in nuclear security applications.

Novel Algorithm for Improving Tracking Accuracy of Open-Loop Mobile Sun-Tracking System via Different Timing Control Scheme

This paper proposes a mobile sun-tracking (MST) system to track the sun on the moving vehicle. We have developed a novel MST algorithm using general sun-tracking formulas associated with simple-moving average linear regression (SMALR) to smoothen sun-tracking activity. Furthermore, two different timing control schemes to activate sun tracking are investigated: time lapse (TL) mode and azimuth actuation (AA) mode. For experimental validation, a prototype of MST has been constructed on a small truck moving at constant speed of 30 km/h for field measurements. For the result, AA mode has average pointing error of 110 mrad for the open-loop tracking design (13% better than that of TL mode), which is still far below the half acceptance angle of compound parabolic concentrator at 659 mrad. Since there is no feedback sensor to be implemented in this prototype, optical encoders and CCD camera can be employed in the future work to further reduce the pointing error of MST system.

Heterogeneous compound eye camera for dual-scale imaging in a large field of view.

Multi-scale imaging with large field of view is pivotal for fast motion detection and target identification. However, existing single camera systems are difficult to achieve snapshot multi-scale imaging with large field of view. To solve this problem, we propose a design method for heterogeneous compound eye, and fabricate a prototype of heterogeneous compound eye camera (HeCECam). This prototype which consists of a heterogeneous compound eye array, an optical relay system and a CMOS sensor, is capable of dual-scale imaging in large field of view (360°×141°). The heterogeneous compound eye array is composed of 31 wide-angle (WA) subeyes and 226 high-definition (HD) subeyes. An optical relay system is introduced to re-image the curved focal surface formed by the heterogeneous compound eye array on a CMOS sensor, resulting in a heterogeneous compound eye image containing dual-scale subimages. To verify the imaging characteristics of this prototype, a series of experiments, such as large field of view imaging, imaging performance, and real-world scene imaging, were conducted. The experiment results show that this prototype can achieve dual-scale imaging in large field of view and has excellent imaging performance. This makes the HeCECam has great potential for UAV navigation, wide-area surveillance, and location tracking, and paves the way for the practical use of bio-inspired compound eye cameras.

Characterization of a Compton camera based on the TOFPET2 ASIC

The use of Compton cameras for medical imaging and its interest as a hadron therapy treatment monitoring has increased in the last decade with the development of silicon photomultipliers. MACACOp is a Compton camera prototype designed and assembled at the IRIS group of IFIC-Valencia. This Compton camera is based on monolithic Lanthanum (III) Bromide crystals and silicon photomultipliers, and employs the novel TOFPET2 ASIC as readout electronics. This system emerged as an alternative to MACACO II prototype, with the aim of improving its limited time resolution. To test the performance of the ASIC in a Compton camera setup, the prototype was characterized, both in laboratory and in-beam. A time resolution of 1.5 ns was obtained after time corrections, which improves greatly the performance of the MACACO II. Moreover, the results obtained at high photon energies demonstrate the ability of the system to obtain 1 mm displacements of the reconstructed spots. The results reinforce the potential of the system as a monitoring device for hadron therapy.

Perovskite Wide‐Angle Field‐Of‐View Camera

Researchers have attempted to create wide-angle field-of-view (FOV) cameras inspired by the structure of the eyes of animals, including fisheye and compound eye cameras. However, realizing wide-angle FOV cameras simultaneously exhibiting low distortion and high spatial resolution remains a significant challenge. In this study, a novel wide-angle FOV camera is developed by combining a single large-area flexible perovskite photodetector (FP-PD) using computational technology. With this camera, the proposed single-photodetector imaging technique can obtain high-spatial-resolution images using only a single detector, and the large-area FP-PD can be bent further to collect light from a wide-angle FOV. The proposed camera demonstrates remarkable features of an extraordinarily tunable wide FOV (greater than 150°), high spatial resolution of 256×256 pixels, and low distortion. It is believed that the proposed compatible and extensible camera prototype will promote the development of high-performance versatile FOV cameras.

Spatial Temporal Video Enhancement Using Alternating Exposures

High-speed video acquisition under poor illumination conditions is a challenging task. Imaging using long exposure can ensure brightness and suppress noise. However, the captured images may be blurry due to fast object movements or camera shakes. Imaging with short exposure can record sharp textures, but the high camera gain may cause noticeable noise. To alleviate this dilemma, we design a camera system using alternating exposures, where frames expose cyclically in a short-long way. The system consists of restoration and interpolation modules to reconstruct sharp, noise-reduced, high-frame-rate frames from low-frame-rate alternate-exposed input images. We design an optical-flow-based alternate-complementary alignment architecture for spatial enhancement, which effectively aligns the short-exposed and long-exposed images in a two-stage progressive way. Moreover, it explores complementary information from short-exposed and long-exposed inputs to ensure consistency between outputs. We propose a flow-enhanced frame interpolation module for temporal enhancement, which refines the intermediate flows and reconstructs the intermediate images based on the restored images of the alignment network and warped input neighboring frames. The whole network with two modules is end-to-end jointly learnable. We first evaluate the algorithm on simulation data. To demonstrate practicality, we then test it on real data by setting up a prototype camera. We propose an effective spatial degradation regularization strategy to reduce the domain gap between simulation and real data. Besides, we extend our method by integrating multi-frame exposure fusion technology to reduce overexposure areas in real scenarios. Experimental results show that our method performs favorably against state-of-the-art methods on both synthetic data and real-world data.

One-handed Input for Mobile Devices via Motion Matching and Orbits Controls

We introduce a novel one-handed input technique for mobile devices that is not based on pointing, but on motion matching -where users select a target by mimicking its unique animation. Our work is motivated by the findings of a survey (N=201) on current mobile use, from which we identify lingering opportunities for one-handed input techniques. We follow by expanding on current motion matching implementations - previously developed in the context of gaze or mid-air input - so these take advantage of the affordances of touch-input devices. We validate the technique by characterizing user performance via a standard selection task (N=24) where we report success rates (&gt;95%), selection times (~1.6 s), input footprint, grip stability, usability, and subjective workload - in both phone and tablet conditions. Finally, we present a design space that illustrates six ways in which motion matching can be embedded into mobile interfaces via a camera prototype application.

Comparison of reconstructed prompt gamma emissions using maximum likelihood estimation and origin ensemble algorithms for a Compton camera system tailored to proton range monitoring

Compton-based prompt gamma (PG) imaging is being investigated by several groups as a potential solution for in vivo range monitoring in proton therapy. The performance of this technique depends on the detector system as well as the ability of the reconstruction method to obtain good spatial resolution to establish a quantitative correlation between the PG emission and the proton beam range in the patient. To evaluate the feasibility of PG imaging for range monitoring, we quantitatively evaluated the emission distributions reconstructed by a Maximum Likelihood Expectation Maximization (MLEM) and a Stochastic Origin Ensemble (SOE) algorithm. To this end, we exploit experimental and Monte Carlo (MC) simulation data acquired with the Polaris-J Compton Camera (CC) prototype. The differences between the proton beam range (RD) defined as the 80% distal dose fall-off and the PG range (RPG), obtained by fitting the distal end of the reconstructed profile with a sigmoid function, were quantified. A comparable performance of both reconstruction algorithms was found. For both experimental and simulated irradiation scenarios, the correlation between RD and RPG was within 5 mm. These values were consistent with the ground truth distance (RD-RPGg≈ 3 mm) calculated by using the expected PG emission available from MC simulation. Furthermore, shifts of 3 mm in the proton beam range were resolved with the MLEM algorithm by calculating the relative difference between the RPG for each reconstructed profile. In non-homogeneous targets, the spatial changes in the PG emission due to the different materials could not be fully resolved from the reconstructed profiles; however, the fall-off region still resembled the ground truth emission. For this scenario, the PG correlation (RD-RPG) varied from 0.1 mm to 4 mm, which is close to the ground truth correlation (3 mm). This work provides a framework for the evaluation of the range monitoring capabilities of a CC device for PG imaging. The two investigated image reconstruction algorithms showed a comparable and consistent performance for homogeneous and heterogeneous targets.

Front-End Design for SiPM-Based Monolithic Neutron Double Scatter Imagers.

Neutron double scatter imaging exploits the kinematics of neutron elastic scattering to enable emission imaging of neutron sources. Due to the relatively low coincidence detection efficiency of fast neutrons in organic scintillator arrays, imaging efficiency for double scatter cameras can also be low. One method to realize significant gains in neutron coincidence detection efficiency is to develop neutron double scatter detectors which employ monolithic blocks of organic scintillator, instrumented with photosensor arrays on multiple faces to enable 3D position and multi-interaction time pickoff. Silicon photomultipliers (SiPMs) have several advantageous characteristics for this approach, including high photon detection efficiency (PDE), good single photon time resolution (SPTR), high gain that translates to single photon counting capabilities, and ability to be tiled into large arrays with high packing fraction and photosensitive area fill factor. However, they also have a tradeoff in high uncorrelated and correlated noise rates (dark counts from thermionic emissions and optical photon crosstalk generated during avalanche) which may complicate event positioning algorithms. We have evaluated the noise characteristics and SPTR of Hamamatsu S13360-6075 SiPMs with low noise, fast electronic readout for integration into a monolithic neutron scatter camera prototype. The sensors and electronic readout were implemented in a small-scale prototype detector in order to estimate expected noise performance for a monolithic neutron scatter camera and perform proof-of-concept measurements for scintillation photon counting and three-dimensional event positioning.

Rapid compton camera imaging for source terms investigation in the nuclear decommissioning with a subset-driven origin ensemble algorithm

As the nuclear facilities (e.g. nuclear power plants) built in the last century gradually reached their life cycle, some nuclear facilities entered the decommissioning stage. Radioactivity measurement runs through the entire process of nuclear decommissioning, and source terms investigation is particularly important. Compton camera is a new technical method in nuclear facility decommissioning, and has the unique advantage of direct visualization of radiation pollution in nuclear facilities. This paper proposed a subset-driven origin ensemble algorithm with resolution recovery, which is suitable for rapid reconstruction of large space via Compton cameras. The proposed algorithm can correct the projection data deviation caused by the inherent spatial and energy resolution of the Compton camera as well as the Doppler broadening effect, and realize the rapid positioning of the spatial radiation source within a few seconds. We used both the Monte Carlo simulation based on Geant4 and the experiments of the double-layer Compton camera prototype to verify the feasibility of this new algorithm in real-time radiation source detection. This research can provide a promising method for the spatial radiation field reconstruction of nuclear facilities based on Compton cameras and the refined management of nuclear facilities decommissioning.

Use of Genetic Algorithms for Design an FPGA-Integrated Acoustic Camera.

The goal of this paper is to design a broadband acoustic camera using micro-electromechanical system (MEMS) microphones. The paper describes how an optimization of the microphone array has been carried out. Furthermore, the final goal of the described optimization is that the gain in the desired direction and the attenuation of side lobes is maximized at a frequency up to 4 kHz. Throughout the research, various shapes of microphone arrays and their directivity patterns have been considered and analyzed using newly developed algorithms implemented in Matlab. A hemisphere algorithm, genetic algorithm, and genetic square algorithm were used to find the optimal position and number of microphones placed on an acoustic camera. The proposed acoustic camera design uses a large number of microphones for high directional selectivity, while a field programmable gate array system on a chip (FPGA SoC) is selected as the processing element of the system. According to the obtained results, three different acoustic camera prototypes were developed. This paper presents simulations of their characteristics, compares the obtained measurements, and discusses the positive and negative sides of each acoustic camera prototype.

MSI-RPi: Affordable, Portable, and Modular Multispectral Imaging Prototype Suited to Operate in UV, Visible and Mid-Infrared Regions

Digital plant inventory provides critical growth insights, given the associated data quality is good. Stable &amp; high-quality image acquisition is critical for further examination. In this work, we showcase an affordable, portable, and modular spectral camera prototype, designed with open hardware’s and open-source software’s. The image sensors used were color, and infrared Pi micro-camera. The designed prototype presents the advantage as being low-cost and modular with respect to other general commercial market available spectral devices. The micro-size connected sensors make it a compact instrument that can be used for any general spectral acquisition purposes, along with the provision of custom selection of the bands, making the presented prototype design a Plug-nd-Play (PnP) setup that can be used in different wide application areas. The images acquired from our custom-built prototype were back-tested by performing image analysis and qualitative assessments. The image acquisition software, and processing algorithm has been programmed, which is bundled with our developed system. Further, an end-to-end automation script is integrated for the users to readily leverage the services on-demand. The design files, schematics, and all the related materials of the spectral block design is open-sourced with open-hardware license &amp; is made available at https://github.com/ajayarunachalam/Multi-Spectral-Imaging-RaspberryPi-Design. The automated data acquisition scripts &amp; the spectral image analysis done is made available at https://github.com/ajayarunachalam/SI-RPi.

Estimation of the contribution of scattered ionising radiation to the dosimeter readings during measurements inside a low-background chamber

The article evaluates the contribution of ionising gamma radiation scattered by structural materials when measuring the dose rate in a low-background chamber. The contribution of scattered radiation to the total dose rate was estimated using Monte Carlo simulations. A model of a low-background camera and a BDKG-05K dosimeter was created in the computer program Fluka. In addition, a model of a point source of 137Cs gamma radiation was placed in the low-background chamber. The fraction of scattered radiation was calculated by comparing the dosimeter readings when measuring the dose rate inside the low-background chamber with the reference model (the dosimeter model is placed together with the source in a vacuum, as a result, scattered radiation is completely absent). The calculation was carried out for two positions of the dosimeter relative to the source (30 and 100 cm). It was found that the contribution of scattered radiation to the dose rate reaches 38 % (distance from the source to the detector is 100 cm). To minimise the contribution of scattered radiation to the readings of the dosimeter, a design in the form of a collimator, inside which the source is located, was considered. Additionally, the work investigated the dependence of the dose rate formed by the scattered radiation on the design features of the collimator. It was found that the use of a collimator makes it possible to reduce the contribution of scattered radiation to 3 %. The aim of the work was to calculate the optimal design of the collimator, in which the contribution of scattered radiation to the total dose rate will be minimal. The results of the work will be used to create a prototype of a low-background camera and an optimised collimator.

Action Recognition From a Single Coded Image.

The unprecedented success of deep convolutional neural networks (CNN) on the task of video-based human action recognition assumes the availability of good resolution videos and resources to develop and deploy complex models. Unfortunately, certain budgetary and environmental constraints on the camera system and the recognition model may not be able to accommodate these assumptions and require reducing their complexity. To alleviate these issues, we introduce a deep sensing solution to directly recognize human actions from coded exposure images. Our deep sensing solution consists of a binary CNN-based encoder network that emulates the capturing of a coded exposure image of a dynamic scene using a coded exposure camera, followed by a 2D CNN for recognizing human action in the captured coded exposure image. Furthermore, we propose a novel knowledge distillation framework to jointly train the encoder and the action recognition model and show that the proposed training approach improves the action recognition accuracy by an absolute margin of 6.2%, 2.9%, and 7.9% on Something 2-v2, Kinetics-400, and UCF-101 datasets, respectively, in comparison to our previous approach. Finally, we built a prototype coded exposure camera using LCoS to validate the feasibility of our deep sensing solution. Our evaluation of the prototype camera show results that are consistent with the simulation results.

Coded Illumination for 3D Lensless Imaging

Mask-based lensless cameras offer a novel design for imaging systems by replacing the lens in a conventional camera with a layer of coded mask. Each pixel of the lensless camera encodes the information of the entire 3D scene. Existing methods for 3D reconstruction from lensless measurements suffer from poor spatial and depth resolution. This is partially due to the system ill conditioning that arises because the point-spread functions (PSFs) from different depth planes are very similar. In this paper, we propose to capture multiple measurements of the scene under a sequence of coded illumination patterns to improve the 3D image reconstruction quality. In addition, we put the illumination source at a distance away from the camera. With such baseline distance between the lensless camera and illumination source, the camera observes a slice of the 3D volume, and the PSF of each depth plane becomes more resolvable from each other. We present simulation results along with experimental results with a camera prototype to demonstrate the effectiveness of our approach.

Means and Methods of Efficiency Estimation of Video Stream Transmission Based on GigE Vision Technology Using Application Processor

The paper investigates the possibility of efficient implementation of a GigE Vision compatible video stream source on a computing platform based on a system-on-a-chip with general-purpose ARM processor cores. In particular, to implement the aforementioned video source, a proprietary prototype of a GigE Vision compatible camera was developed based on the Raspberry Pi 4 single-board computer. This computing platform was chosen due to its widespread use and wide community support. The software part of the camera is implemented using the Video4Linux and Aravis libraries. The first library is used for the primary image capturing from a video sensor connected to a single board computer. The second library is intended for forming and transmission of video stream frames compatible with GigE Vision technology over the network. To estimate the delays in the transmission of a video stream over an Ethernet channel, a methodology based on the Precise Time Protocol (PTP) has been proposed and applied. During the experiments, it was found that the software implementation of a GigE Vision compatible camera on single-board computers with general-purpose processor cores is quite promising. Without additional optimization, such an implementation can be successfully used to transmit small frames (with a resolution of up to 640 × 480 pixels), giving a delay less than 10 ms. At the same time, some additional optimizations may be required to transmit larger frames. Namely, a MTU (maximum transmission unit) size value plays the crucial role in latency formation. Thus, to implement a faster camera, it is necessary to select a platform that supports the largest possible MTU (unfortunately, it turned out that it is not possible with Raspberry Pi 4, as it supports relatively small MTU size of up to 2000 bytes). In addition, the image format conversion procedure can noticeably affect the delay. Therefore, it is highly desirable to avoid any frame processing on the transmitter side and, if it is possible, to broadcast raw images. If the conversion of the frame format is necessary, the platform should be chosen so that there are free computing cores on it, which will permit to distribute all necessary frame conversions between these cores using parallelization techniques.

LOCAL FEATURE EXTRACTION IN IMAGES

The methods of the local feature point extraction are analyzed. The analysis shows that the most effective detectors are based on the brightness gradient determination. They usually use the Harris angle detector, which is complex in calcu­la­tions. The algorithm complexity minimization contradicts both the detector effective­ness and to the high dynamic range of the analyzed image. As a result, the high-speed methods could not recognize the feature points in the heavy luminance conditions. The modification of the high dynamic range (HDR) image compression algorithm based on the Retinex method is proposed. It contains an adaptive filter, which preserves the image edges. The filter is based on a set of feature detectors perfor­ming the Harris-Laplace transform which is much simpler than the Harris angle detector. A prototype of the HDR video camera is designed which provides sharp images. Its structure simplifies the design of the artificial intelligence engine, which is implemented in FPGA of medium or large size.

Method to measure the size of a radiographic field larger than a detector by imaging fluorescence X‐rays with a slit camera

PurposeX‐ray imaging devices contain a collimator system that defines a rectangular irradiation field on the detector plane. The size and position of the X‐ray field, and its congruence with the corresponding light field, must be regularly tested for quality control. We propose a new method to estimate how far the x‐ray field extends beyond the detector which does not require the use of external detectors.MethodsA metallic foil is inserted perpendicularly between the source and the detector. A slit camera, a linear extension of a pinhole camera, is used to project onto the detector the fluorescence X‐rays emitted by the irradiated foil. The location where the fluorescence signal inside the camera vanishes is used to extrapolate the location of the field boundary. Monte Carlo simulations were performed to determine the optimal composition and thickness of the foil. A prototype camera with a 1‐mm‐wide slit was built and tested in a clinical mammography and digital breast tomosynthesis (DBT) system.ResultsThe simulations estimated that a foil made of 25 µm of Molybdenum provided the maximum signal inside the camera for a 39 kVp beam. The boundary of the X‐ray fields in mammography and DBT views were experimentally measured. With the camera along the chest wall side, the measured field in multiple DBT views had a variability of only 0.4 ± 0.1 mm compared to mammography. A difference in the measured boundary position of 2.4 and –1.0 mm was observed when comparing to measurements with a fluorescent ruler and self‐developing film.ConclusionThe introduced technique provides a practical alternative method to detect the boundary of an X‐ray field. The method can be combined with other testing methods to assess the congruence of the X‐rays and light fields, and to determine if the X‐ray field extends beyond the detector more than permitted.