Stereoscopic System Research Articles

FPGA-based multi-view stereo system with flexible measurement setup

In recent years, stereoscopic image processing algorithms have gained importance for a variety of applications. To capture larger measurement volumes, multiple stereo systems are combined into a multi-view stereo (MVS) system. To reduce the amount of data and the data rate, calculation steps close to the sensors are outsourced to Field Programmable Gate Arrays (FPGAs) as upstream computing units. The calculation steps include lens distortion correction, rectification and stereo matching. In this paper a FPGA-based MVS system with flexible camera arrangement and partly overlapping field of view is presented. The system consists of four FPGA-based passive stereoscopic systems (Xilinx Zynq-7000 7020 SoC, EV76C570 CMOS sensor) and a downstream processing unit (Zynq Ultrascale ZU9EG SoC). This synchronizes the sensor near processing modules and receives the disparity maps with corresponding left camera image via HDMI. The subsequent computing unit calculates a coherent 3D point cloud. Our developed FPGA-based 3D measurement system captures a large measurement volume at 24 fps by combining a multiple view with eight cameras (using Semi-Global Matching for an image size of 640 px × 460 px, up to 256 px disparity range and with aggregated costs over 4 directions). The capabilities and limitation of the system are shown by an application example with optical non-cooperative surface.

Stereoscopic Distance Filtering Plus Thermal Imaging Glasses Design.

The authors present the development of eyewear that incorporates stereoscopic and thermal imaging cameras for the purpose of highlighting objects/views of interest. Image processing algorithms that simplify complex elements in a scene have the ability to improve the utility of blind and low vision aids. Thermal imaging can be used to highlight important objects such as people or animals, while stereoscopic imaging can be used to filter background imagery beyond a certain distance. The methods used have been successful in providing utility to retinal prosthesis users. The stereoscopic camera systems involved strict requirements on the relative orientation of the cameras for calibrated distance filtering. A mechanical design is presented that fixes the relative camera locations on a 3D printed titanium structure that can float in the frame to maintain orientations even when the eyewear is flexed during wearing. Clinical Relevance - The design presented has utility in improving perceived spatial resolution in implantable retinal prostheses, implantable visual cortical prostheses, direct-vision prostheses, and wearable low vision aids.

The contribution of Galactic TeV pulsar wind nebulae to Fermi large area telescope diffuse emission

The large-scale diffuse γ − ray flux observed by Fermi Large Area Telescope (Fermi-LAT) in the 1–100 GeV energy range, parameterized as ∝ E−Γ, has a spectral index Γ that depends on the distance from the Galactic center. This feature, if attributed to the diffuse emission produced by cosmic rays interactions with the interstellar gas, can be interpreted as the evidence of a progressive cosmic ray spectral hardening towards the Galactic center. This interpretation challenges the paradigm of uniform cosmic rays diffusion throughout the Galaxy. We report on the implications of TeV Pulsar Wind Nebulae observed by the High Energy Stereoscopic System (H.E.S.S.) Galactic Plane Survey in the 1–100 TeV energy range for the interpretation of Fermi-LAT data. We argue that a relevant fraction of this population cannot be resolved by Fermi-LAT in the GeV domain providing a relevant contribution to the large-scale diffuse emission, ranging within ~4%–40% of the total diffuse γ-ray emission in the inner Galaxy. This additional component may account for a large part of the spectral index variation observed by Fermi-LAT, weakening the evidence of cosmic ray spectral hardening in the inner Galaxy.

A MeerKAT, e-MERLIN, H.E.S.S., and Swift search for persistent and transient emission associated with three localized FRBs

ABSTRACT We report on a search for persistent radio emission from the one-off fast radio burst (FRB) 20190714A, as well as from two repeating FRBs, 20190711A and 20171019A, using the MeerKAT radio telescope. For FRB 20171019A, we also conducted simultaneous observations with the High-Energy Stereoscopic System (H.E.S.S.) in very high-energy gamma rays and searched for signals in the ultraviolet, optical, and X-ray bands. For this FRB, we obtain a UV flux upper limit of $1.39 \times 10^{-16}~{\rm erg\, cm^{-2}\, s^{-1}}$Å−1, X-ray limit of $\sim 6.6 \times 10^{-14}~{\rm erg\, cm^{-2}\, s^{-1}}$ and a limit on the very high energy gamma-ray flux $\Phi (E\gt 120\, {\rm GeV}) \lt 1.7\times 10^{-12}\, \mathrm{erg\, cm^{-2}\, s^{-1}}$. We obtain a radio upper limit of ∼15 $\mu$Jy beam−1 for persistent emission at the locations of both FRBs 20190711A and 20171019A with MeerKAT. However, we detected an almost unresolved (ratio of integrated flux to peak flux is ∼1.7 beam) radio emission, where the synthesized beam size was ∼ 8 arcsec size with a peak brightness of $\sim 53\, \mu$Jy beam−1 at MeerKAT and $\sim 86\, \mu$Jy beam−1 at e-MERLIN, possibly associated with FRB 20190714A at z = 0.2365. This represents the first detection of persistent continuum radio emission potentially associated with a (as-yet) non-repeating FRB. If the association is confirmed, one of the strongest remaining distinction between repeaters and non-repeaters would no longer be applicable. A parallel search for repeat bursts from these FRBs revealed no new detections down to a fluence of 0.08 Jy ms for a 1 ms duration burst.

Evidence for γ-ray emission from the remnant of Kepler’s supernova based on deep H.E.S.S. observations

Observations with imaging atmospheric Cherenkov telescopes (IACTs) have enhanced our knowledge of nearby supernova (SN) remnants with ages younger than 500 yr by establishing Cassiopeia A and the remnant of Tycho’s SN as very-high-energy (VHE) γ-ray sources. The remnant of Kepler’s SN, which is the product of the most recent naked-eye SN in our Galaxy, is comparable in age to the other two, but is significantly more distant. If the γ-ray luminosities of the remnants of Tycho’s and Kepler’s SNe are similar, then the latter is expected to be one of the faintest γ-ray sources within reach of the current generation IACT arrays. Here we report evidence at a statistical level of 4.6σ for a VHE signal from the remnant of Kepler’s SN based on deep observations by the High Energy Stereoscopic System (H.E.S.S.) with an exposure of 152 h. The measured integral flux above an energy of 226 GeV is ∼0.3% of the flux of the Crab Nebula. The spectral energy distribution (SED) reveals a γ-ray emitting component connecting the VHE emission observed with H.E.S.S. to the emission observed at GeV energies with Fermi-LAT. The overall SED is similar to that of the remnant of Tycho’s SN, possibly indicating the same nonthermal emission processes acting in both these young remnants of thermonuclear SNe.

Metalens-based stereoscopic microscope

Stereoscopic microscopy is a promising technology to obtain three-dimensional microscopic images. Such microscopes are based on the parallax effect, and as such require two lenses to focus at two different points. Geometrical constraints, however, restrict their numerical apertures to about 0.2, thus limiting the system’s resolution. Higher numerical apertures ( ∼ 0.35 ) can be achieved with designs using only one bulk lens, but such systems are ∼ 10 times more costly than the conventional ones. Thus, there is a pressing need for alternative solutions to improve the resolution of stereoscopic systems. Here, we show that high-resolution and low-cost stereoscopic systems can be obtained using birefringent single-layer metalenses. We design and fabricate a birefringent metalens operating at 532 nm with a numerical aperture as high as 0.4. The metalens is then used to demonstrate high-resolution stereoscopic imaging of biological samples. The microscopic images are further displayed and perceived vividly in an autostereoscopic display. Our demonstration paves the way to a new strategy to achieve high-resolution and low-cost stereoscopic microscopes.

Advances in phosphor two-color ratio method thermography for full-field surface temperature measurements

Thermographic phosphors can be employed for optical sensing of surface, gas phase, and bulk material temperatures through different strategies including the time-decay method, time-integrated method, and frequency-domain method. We focus on the time-integrated method, also known as the ratio method, as it can be more practical in many situations. This work advances the ratio method using two machine vision cameras with CMOS detectors for full-field temperature measurements of a solid surface. A phosphor calibration coupon is fabricated using aerosol deposition and employed for in situ determination of the temperature-versus-intensity ratio relationship. Algorithms from digital image correlation are employed to determine the stereoscopic imaging system intrinsic and extrinsic parameters, and accurately register material points on the sample to subpixel locations in each image with 0.07 px or better accuracy. Detector nonlinearity is carefully characterized and corrected. Temperature-dependent, spatial non-uniformity of the full-field intensity ratio—posited to be caused by a blue-shift effect of the bandpass filter for non-collimated light and/or a wavelength-dependent transmission efficiency of the lens—is assessed and treated for cases where a standard flat-field correction fails to correct the non-uniformity. In sum, pixel-wise calibration curves relating the computed intensity ratio to temperature in the range of T = 300–430 K are generated, with an embedded error of less than 3 K. This work offers a full calibration methodology and several improvements on two-color phosphor thermography, opening the door for full-field temperature measurements in dynamic tests with deforming test articles.

Body size measuring techniques enabling stress-free growth monitoring of extreme preterm infants inside incubators: A systematic review.

IntroductionGrowth monitoring of preterm infants is essential for assessing the nutritional effects on their growth. The current growth monitoring techniques are too stressful, however, for the smallest preterm infants. We performed a systematic review to summarize studies on stress-free techniques for measuring the body size of preterm infants inside incubators other than the traditional calliper and tape measure-based instruments.MethodsWe searched four online literature databases: Embase, Medline, Web of Science Core Collection, and Cochrane, using search terms related to patients (neonates, infants, children) and body size measuring techniques. By means of expert judgement we assessed the techniques’ suitability for stress-free body size measurement of an infant lying in an incubator. As a criterion for suitability, we used an imaginary ideal technique.ResultsTwenty-six studies were included in this review. In 24 studies, the technique for body size measurement was related to 3D technology, and the majority of these studies acknowledged clinical superiority of 3D over 2D data. Two 3D techniques were assessed as suitable for stress-free measurement of preterm infants inside incubators. The first technique used a commercially available 3D handheld scanner which needed 3D postprocessing to derive measurement data. The second technique used a self-developed stereoscopic vision system.Conclusions3D volumetric parameters have higher clinical value for growth monitoring than 2D. In addition, contactless 3D measurements enable stress-free growth monitoring of even the smallest preterm infants. However, the time-consuming 3D postprocessing challenges the usability of 3D techniques. Regrettably, none of the identified suitable 3D techniques met all our requirements of an ideal all-in-one body size measuring technique for extreme preterm infants. Handheld 3D scanning might have the best properties for developing this ideal technique.

Reducing ExacTrac intrafraction imaging uncertainty for prostate stereotactic body radiotherapy using a pre-treatment CBCT.

This study evaluated the intrafractional auto-matching uncertainties of prostate-implanted fiducial markers when using the ExacTrac v6.5 (Brainlab, Feldkirchen, Germany) X-ray stereoscopic system. A customised phantom with 3 implanted gold seeds was initially positioned at the isocentre using a cone beam CT (CBCT) prior to intrafractional imaging. Progressive offsets were applied to the phantom in all six directions (3 translational, 3 rotational) of 0mm, 1mm, 2mm, 0°, 1° and 2°. Subsequently, the ability of the ExacTrac image-matching functions to detect and correct these offsets was tested. For comparison, this procedure was repeated, but without a CBCT for pre-treatment positioning. The auto-matching uncertainties when a CBCT was introduced into the workflow were significantly reduced, and overall, the auto-matching statistics using the implanted marker (seeds) matching function was found to be more precise than the bony anatomy function in-phantom. The total standard deviations for the translational shifts using the implanted marker and bony anatomy functions respectively were 0.1mm and 0.3mm vertically, 0.1mm and 0.3mm longitudinally, and 0.1mm and 0.4mm laterally. The standard deviations for the rotational shifts using the implanted marker and bony anatomy matching functions respectively were 0.2° and 1.2° for the yaw (angle vert), 0.3° and 1.1° for the pitch (angle long), and 0.2° and 1.2° for the roll (angle lat) directions. The reduced uncertainties from introducing a CBCT for initial localisation resulted in decreased probability of inhibits due to false positives during treatment.

In situ size and motility measurement of aquatic invertebrates with an underwater stereoscopic camera system using tilted lenses

Abstract In situ observation of traits of aquatic organisms, including size and motility, requires three‐dimensional measurements that are commonly done with a stereoscopic imaging system. However, to observe traits of small aquatic invertebrates, the imaging system requires relatively high magnification, which results in a small overlapping volume between the two cameras of a conventional stereoscopic system. The provision of a larger shared volume would therefore be of great advantage, especially, when the organism abundance is low. We implement a stereoscopic system that utilizes a tilted lens approach, known as the Scheimpflug principle, to increase the common imaging volume of two cameras. The system was calibrated and tested in the laboratory and then deployed in a saltmarsh to observe water boatmen Trichocorixa californica. Processing of the image data from the field deployments resulted in the simultaneous estimation of the traits of body length and swimming speed of the aquatic insects. Our stereo setup with tilted lenses increased the sampling volume by 3.1 times compared to a traditional stereo setup with the same optical parameters. The in situ data and subsequent processing reveal that the instrument can capture stereoscopic images that resolve both body length and swimming speed of the aquatic insects. Results indicate that the relationship between the body length and the swimming speed of the water boatmen is linear in the log–log space with an exponent of . Furthermore, the insects experience Reynold's number in the range of –. Our results demonstrated that the system can be used to observe key traits of small aquatic organisms in an ecologically relevant context. This work expands the capability of underwater imaging systems to measure important traits of an individual aquatic invertebrate in its natural environment and aids in providing a trait‐based approach to zooplankton ecology.

Very High-energy Afterglow Emission of GRB 190829A: Evidence for Its Hadronic Origin?

The detection of multi-TeV gamma rays from the afterglow phase of GRB 190829A by the High Energy Stereoscopic System telescope is an addition to the already existing list of two GRBs observed in very high-energy (VHE) gamma rays in recent years. Jets of blazars and GRBs have many similarities and the photohadronic model is very successful in explaining the VHE gamma-ray spectra from the high-energy blazars. Recently, the photohadronic model has been successfully applied to study the sub-TeV gamma rays from the afterglow phases of GRB 180720B and GRB 190114C. We employed this model again to explain the VHE spectra observed for the two consecutive nights from GRB 190829A. We show that the spectra of GRB 190829A can be due to the interactions of high-energy protons with the synchrotron self-Compton photons in the forward shock region of the GRB jet, similar to the low emission state of the VHE flaring events of high-energy blazars. We speculate that, if in the future, it is possible to observe the VHE gamma-ray spectra from nearby GRBs in their afterglow phases, then some of them could only be explained by employing two different spectral indices. If confirmed, such VHE spectra could be interpreted as a result of the interactions of the high-energy protons with the photons, both from the synchrotron background and the synchrotron self-Compton background in the forward shock region.

A simulated comparison of lung tumor target verification using stereoscopic tomosynthesis or radiography.

Mobile lung tumors are increasingly being treated with ablative radiotherapy, for which precise motion management is essential. In-room stereoscopic radiography systems are able to guide ablative radiotherapy for stationary cranial lesions but not optimally for lung tumors unless fiducial markers are inserted. We propose augmenting stereoscopic radiographic systems with multiple small x-ray sources to provide the capability of imaging with stereoscopic, single frame tomosynthesis. In single frame tomosynthesis, nine x-ray sources are placed in a 3×3 configuration and energized simultaneously. The beams from these sources are collimated so that they converge on the tumor and then diverge to illuminate nine non-overlapping sectors on the detector. These nine sector images are averaged together and filtered to create the tomosynthesis effect. Single frame tomosynthesis is intended to be an alternative imaging mode for existing stereoscopic systems with a field of view that is three times smaller and a temporal resolution equal to the frame rate of the detector. We simulated stereoscopic tomosynthesis and radiography using Monte Carlo techniques on 60 patients with early-stage lung cancer from the NSCLC-Radiomics dataset. Two board-certified radiation oncologists reviewed these simulated images and rated them on a 4-point scale (1: tumor not visible; 2: tumor visible but inadequate for motion management; 3: tumor visible and adequate for motion management; 4: tumor visibility excellent). Each tumor was independently presented four times (two viewing angles from radiography and two viewing angles from tomosynthesis) in a blinded fashion over two reading sessions. The fraction of tumors that were rated as adequate or excellent for motion management (scores 3 or 4) from at least one viewing angle was 53% using radiography and 90% using tomosynthesis. From both viewing angles, the corresponding fractions were 7% for radiography and 48% for tomosynthesis. Readers agreed exactly on 62% of images and within 1 point on 98% of images. The acquisition technique was estimated to be 75 mAs at 120 kVp per treatment fraction assuming one verification image per breath, approximately one order of magnitude less than a standard dose cone beam CT. Stereoscopic tomosynthesis may provide a noninvasive, low dose, intrafraction motion verification technique for lung tumors treated by ablative radiotherapy. The system architecture is compatible with real-time video capture at 30 frames per second. Simulations suggest that most, but not all, lung tumors can be adequately visualized from at least one viewing angle.

End to end comparison of surface-guided imaging versus stereoscopic X-rays for the SRS treatment of multiple metastases with a single isocenter using 3D anthropomorphic gel phantoms.

IntroductionTwo end‐to‐end tests evaluate the accuracy of a surface‐guided radiation therapy (SGRT) system (CRAD Catalyst HD) for position verification in comparison to a stereoscopic x‐ray imaging system (Brainlab Exactrac ) for single‐isocenter, multiple metastases stereotactic radiosurgery (SRS) using 3D polymer gel inserts.Materials and methodsA 3D‐printed phantom (Prime phantom, RTsafe PC, Athens, Greece) with two separate cylindrical polymer gel inserts were immobilized in open‐face masks and treated with a single isocentric, multitarget SRS plan. Planning was done in Brainlab (Elements) to treat five metastatic lesions in one fraction, and initial setup was done using cone beam computed tomography. Positional verification was done using orthogonal X‐ray imaging (Brainlab Exactrac) and/or a surface imaging system (CRAD Catalyst HD, Uppsala, Sweden), and shift discrepancies were recorded for each couch angle. Forty‐two hours after irradiation, the gel phantom was scanned in a 1.5 Tesla MRI, and images were fused with the patient computed tomography data/structure set for further analysis of spatial dose distribution.ResultsDiscrepancies between the CRAD Catalyst HD system and Brainlab Exactrac were <1 mm in the translational direction and <0.5° in the angular direction at noncoplanar couch angles. Dose parameters (D Mean% , D 95%) and 3D gamma index passing rates were evaluated for both setup modalities for each planned target volume (PTV) at a variety of thresholds: 3%/2 mm (Exactrac≥93.1% and CRAD ≥87.2%), 5%/2 mm (Exactrac≥95.6% and CRAD ≥94.6%), and 5%/1 mm (Exactrac≥81.8% and CRAD ≥83.7%).ConclusionDose metrics for a setup with surface imaging was found to be consistent with setup using x‐ray imaging, demonstrating high accuracy and reproducibility for treatment delivery. Results indicate the feasibility of using surface imaging for position verification at noncoplanar couch angles for single‐isocenter, multiple‐target SRS using end‐to‐end quality assurance (QA) testing with 3D polymer gel dosimetry.

Time-resolved hadronic particle acceleration in the recurrent nova RSOphiuchi.

Recurrent novae are repeating thermonuclear explosions in the outer layers of white dwarfs, due to the accretion of fresh material from a binary companion. The shock generated when ejected material slams into the companion star's wind can accelerate particles. We report very-high-energy (VHE; [Formula: see text]) gamma rays from the recurrent nova RSOphiuchi, up to 1 month after its 2021 outburst, observed using the High Energy Stereoscopic System (H.E.S.S.). The temporal profile of VHE emission is similar to that of lower-energy giga-electron volt emission, indicating a common origin, with a 2-day delay in peak flux. These observations constrain models of time-dependent particle energization, favoring a hadronic emission scenario over the leptonic alternative. Shocks in dense winds provide favorable environments for efficient acceleration of cosmic rays to very high energies.

Possible TeV Gamma-Ray Binary Origin of HESS J1828–099

Abstract The High Energy Stereoscopic System (H.E.S.S.) observatory has carried out a deep survey of the Galactic plane, in the course of which the existence of a significant number of (∼78) TeV γ-ray sources was confirmed, many of which remain unidentified. HESS J1828–099 is a point-like (Gaussian standard deviation &lt; 0.°07) unidentified source among the 17 confirmed point-like sources in the H.E.S.S. Galactic Plane Survey (HGPS) catalog. This source is also unique because it does not seem to have any apparent association with any object detected at other wavelengths. We investigate the nature and association of HESS J1828–099 with multiwavelength observational data. A high-mass X-ray binary (HMXB)—composed of the pulsar XTE J1829–098 and a companion Be star—has been observed earlier in the X-ray and infrared bands, 14′ away from HESS J1828–099. With 12 yr of Fermi-LAT γ-ray data, we explore the possibility of 4FGL J1830.2–1005 being the GeV counterpart of HESS J1828–099. Within the RXTE confidence region, a steep-spectrum (α radio = −0.746 ± 0.284) plausible counterpart is detected in data from existing radio frequency surveys. In this Letter, we probe for the first time, using multiwavelength data, whether HESS J1828–099, 4FGL J1830.2–1005, and the HMXB system have a common origin. Our study indicates that HESS J1828–099 might be a TeV high-mass γ-ray binary source.

Galactic center gamma-ray production by cosmic rays from stellar winds and Sgr A East

Context. The High Energy Stereoscopic System, the Major Atmospheric Gamma-ray Imaging Cherenkov Telescope, and the Very Energetic Radiation Imaging Telescope Array System have observed diffuse gamma-ray emission strongly correlated with the central molecular zone in the Galactic center. The most accepted scenario to generate this emission is via a hadronic interaction between cosmic rays (CRs) and ambient gas, where CRs are accelerated from a central and continuous source of 1 PeV protons. Aims. We explore the influence of the three-dimensional (3D) shape of the central molecular zone on the indirect observation of the CR energy density via gamma-ray detection. Methods. We simulated synthetic gamma-ray maps using a CR diffusion model with spherical injection, one isotropic diffusion coefficient, no advection, and mono-energetic particles of 1 PeV. Also, we used two different 3D gas distributions considering the observed gas column density, both with and without an inner cavity. Results. We find that when using a persistent CR source, a disk-like gas distribution is needed to reproduce the existing CR indirect observations. This is in agreement with the continuous gas distribution implied by some dynamical models and studies based on the comparison of emission and absorption molecular lines. However, it contradicts several models of the central molecular zone, which imply that this structure has a significant inner cavity. This tension can be reconciled by an additional, impulsive CR injection. Conclusions. If the central molecular zone has a cavity, a composite CR population, coming from the stellar winds of the Wolf-Rayet stars in the central 0.5 pc and the supernova Sgr A East, produces a good match to the observed gamma-ray morphology in the Galactic center.

Methods and means of visual and dimensional tests of hard-to-reach nodes of rocket and space equipment

The most machine vision-oriented industries are metallurgical, food, household chemicals, automotive and mechanical engineering, as well as pharmaceutical production. These are the areas in which there are increased requirements for the quality of products. An important role in increasing the demand for machine vision technologies was also played by the introduction of a national labeling and product tracking system. However, in the space industry, issues related to machine vision have not been fully resolved by non-destructive testing methods. For the first time in Russia, a prototype measuring stereoscopic video endoscope was developed, manufactured and tested. The authors have developed the software that allows obtaining textured three-dimensional models of objects, measure their geometric parameters, estimate the measurement error, calibrate and configure the system. The technical characteristics of the video endoscope have been confirmed at the level of analogues produced by the world's leading manufacturers. A method of designing probe stereoscopic systems has been developed and applied in practice.

The Possible Seismo-Ionospheric Perturbations Recorded by the China-Seismo-Electromagnetic Satellite

Driven by the objective of earthquake disaster prevention and mitigation, China launched the Zhangheng mission to build a stereoscopic earthquake monitoring system from the lithosphere to space. This report briefly presents the possible seismic ionospheric disturbances recorded by the first probe of the Zhangheng mission, which is known as the China-Seismo-Electromagnetic Satellite (CSES). The routine data preprocessing and seismo-ionospheric information analysis methods are briefly introduced. The possible seismo-ionospheric disturbances that appeared during the strong shallow earthquakes (with a magnitude over 7 and a depth shallower than 30 km) are analyzed by using CSES and other multi-source data. Investigating seismo-ionospheric mechanisms requires multidisciplinary knowledge involving geophysics, atmosphere/ionosphere physics, geochemistry/atmospheric chemistry, etc. We state that the results from the CSES scientific application center are preliminary, calling for international scientists to contribute to the seismo-ionospheric perturbation phenomena, which is one of the most challenging scientific problems.

Offline generator for digitally reconstructed radiographs of a commercial stereoscopic radiotherapy image-guidance system.

PurposeImage‐guided radiotherapy (IGRT) research sometimes involves simulated changes to patient positioning using retrospectively collected clinical data. For example, researchers may simulate patient misalignments to develop error detection algorithms or positioning optimization algorithms. The Brainlab ExacTrac system can be used to retrospectively “replay” simulated alignment scenarios but does not allow export of digitally reconstructed radiographs (DRRs) with simulated positioning variations for further analysis. Here we describe methods to overcome this limitation and replicate ExacTrac system DRRs by using projective geometry parameters contained in the ExacTrac configuration files saved for every imaged subject.MethodsTwo ExacTrac DRR generators were implemented, one with custom MATLAB software based on first principles, and the other using libraries from the Insight Segmentation and Registration Toolkit (ITK). A description of perspective projections for DRR rendering applications is included, with emphasis on linear operators in real projective space P3. We provide a general methodology for the extraction of relevant geometric values needed to replicate ExacTrac DRRs. Our generators were tested on phantom and patient images, both acquired in a known treatment position. We demonstrate the validity of our methods by comparing our generated DRRs to reference DRRs produced by the ExacTrac system during a treatment workflow using a manual landmark analysis as well as rigid registration with the elastix software package.ResultsManual landmarks selected between the corresponding DRR generators across patient and phantom images have an average displacement of 1.15 mm. For elastix image registrations, we found that absolute value vertical and horizontal translations were 0.18 and 0.35 mm on average, respectively. Rigid rotations were within 0.002 degrees.ConclusionCustom and ITK‐based algorithms successfully reproduce ExacTrac DRRs and have the distinctive advantage of incorporating any desired 6D couch position. An open‐source repository is provided separately for users to implement in IGRT patient positioning research.

The relationship between vision and simulated remote vision system air refueling performance

United States Air Force (USAF) vision tests have largely remained unchanged since WWII and therefore, it is unclear whether current standards are applicable for users of new humane-machine interfaces (e.g., stereoscopic remote vision system (RVS) in the KC-46 refueling tanker). This study examined the relationships between a range of early vision assessments, including Operational Based Vision Assessment (OBVA) lab-developed tests, an electronic version of the standard Titmus test, and the current Armed Forces Vision Tester (AFVT), and air refueling task performance using a stereoscopic RVS. Additionally, the relationships of these vision test scores to operationally-relevant subjective measures of visual fatigue were assessed. Results showed that OBVA measures of disparity discrimination, horizontal fusion, and horizontal phoria correlated with air refueling performance. OBVA measures of acuity, contrast sensitivity, disparity discrimination, and radial motion sensitivity were significantly associated with subjective measures of discomfort and visual fatigue. Notably, neither the electronic Titmus results, nor the AFVT measures were not associated with either air refueling task performance or subjective measures of discomfort and visual fatigue. Adjustments to the vision standards and test methods used for USAF aeromedical vision screening should therefore be considered.