Real-time 3D Ultrasound Imaging Research Articles

Real-time 3D ultrasound imaging with a clip-on device attached to common 1D array transducers

Performing 3D ultrasound imaging at a real-time volume rate (e.g., >20 Hz) is a challenging task. While 2D array transducers remain the most practical approach for real-time 3D imaging, the large number of transducer elements (e.g., several thousand) that are necessary to cover an effective 3D field-of-view impose a fundamental constraint on imaging speed. Although solutions such as multiplexing and specialized transducers, including sparse arrays and row-column-addressing arrays, have been developed to address this limitation, they inevitably compromise imaging quality (e.g., SNR, resolution) in favor of speed. Coupled with the high equipment cost of 2D arrays, these compromises hinder the widespread adoption of 3D ultrasound imaging technologies in clinical settings. In this presentation, we introduce an innovative transducer clip-on device comprising a water-immersible, fast-tilting electromechanical acoustic reflector and a redirecting reflector to enable real-time 3D ultrasound imaging using common 1D array transducers. We will first introduce the principles underlying our novel technique, followed by validation studies incorporating simulation and experimental data. We will also demonstrate the feasibility of using the clip-on device to achieve a high 3D imaging volume rate that is suitable for advanced imaging modes such as shear wave elastography, blood flow imaging, and super-resolution ultrasound localization microscopy.

Free scan real time 3D ultrasound imaging with shading artefacts removal

Ultrasound imaging (USI) is a widely adopted imaging method in clinical diagnosis owing to its low cost, convenience, and safety. However, due to the complex acoustic attenuation, two-dimensional (2D) USI lacks the capability to achieve a clear imaging result when the target is shaded by high echo tissues. This paper proposes a three-dimensional (3D) free-scan real-time ultrasound imaging (FRUSI) method. By integrating 2D ultrasound image sequences around the region of interest (ROI) with a real-time and spatially accurate probe tracking method, the proposed FRUSI system provides clear and accurate ultrasound images for medical study. The experiment results on reconstruction precision and accuracy show the potential ability of our proposed system to provide high-quality 3D ultrasound imaging. Moreover, previously shaded targets can be discerned clearly in the same scan plane in both phantom studies and in vivo studies on the human finger joint. The performance of the proposed FRUSI system has demonstrated its potential value for clinical diagnosis to provide high ultrasound imaging quality and rich details in spatial information. Due to the convenient setup, the FRUSI system might potentially be expanded to other ultrasound imaging modalities.

A real‐time freehand 3D ultrasound imaging method for scoliosis assessment

Real‐time 3D ultrasound has gained popularity in many fields because it can provide interactive feedback to help acquire high‐quality images or to conduct timely diagnosis. However, no comprehensive study has been reported on such an imaging method for scoliosis evaluation due to the complexity of this application. Meanwhile, the use of radiation‐free assessment of scoliosis is becoming increasingly popular. This study developed a real‐time 3D ultrasound imaging method for scoliosis assessment based on an incremental imaging method. In vivo experiments involving 36 patients with scoliosis were performed to test the performance of the proposed method. This new imaging method achieved a mean incremental frame rate of 82.7 ± 11.0 frames/s. The high repeatability of the intra‐operator test (intraclass correlation coefficient [ICC] = 0.92) and inter‐operator test (ICC = 0.91) demonstrated that the new method was very reliable. The result of spinous process angles obtained by the new method was linearly correlated (y = 0.97x, R 2 = 0.88) with that obtained by conventional 3D reconstruction. These results suggested that the newly developed imaging method can provide real‐time ultrasound imaging for scoliosis evaluation while preserving the comparative image quality of the conventional 3D reconstruction method.

Real-time 3D imaging with Fourier-domain algorithms and matrix arrays applied to non-destructive testing

Real-time 3D ultrasound imaging with matrix arrays remains a challenge in Non-Destructive Testing (NDT) due to the time-consuming reconstruction algorithms based on delay-and-sum operations. Other algorithms operating in the Fourier domain have lower algorithmic complexities and therefore higher frame rates at the cost of more storage space, which may limit the number of reconstruction points. In this paper, we present an implementation for real-time 3D imaging of the Total Focusing Method (TFM) and the Plane Wave Imaging (PWI), as well as of their Fourier-domain counterparts, referred to as k-TFM and k-PWI. For both types of acquisition, the Fourier-domain algorithms are used to increase frame rates, and they are compared to the time-domain TFM and PWI in terms of image quality, frame rates and memory requirements. In order to greatly reduce their memory requirements, a new implementation of k-TFM and k-PWI is proposed. The four imaging methods are then evaluated by imaging in real time a block of stainless steel containing a 3D network of spherical porosities produced by additive layer manufacturing using a powder bed laser fusion process.

A Review on Real-Time 3D Ultrasound Imaging Technology.

Real-time three-dimensional (3D) ultrasound (US) has attracted much more attention in medical researches because it provides interactive feedback to help clinicians acquire high-quality images as well as timely spatial information of the scanned area and hence is necessary in intraoperative ultrasound examinations. Plenty of publications have been declared to complete the real-time or near real-time visualization of 3D ultrasound using volumetric probes or the routinely used two-dimensional (2D) probes. So far, a review on how to design an interactive system with appropriate processing algorithms remains missing, resulting in the lack of systematic understanding of the relevant technology. In this article, previous and the latest work on designing a real-time or near real-time 3D ultrasound imaging system are reviewed. Specifically, the data acquisition techniques, reconstruction algorithms, volume rendering methods, and clinical applications are presented. Moreover, the advantages and disadvantages of state-of-the-art approaches are discussed in detail.

Development of a Wireless and Near Real-Time 3D Ultrasound Strain Imaging System.

Ultrasound elastography is an important medical imaging tool for characterization of lesions. In this paper, we present a wireless and near real-time 3D ultrasound strain imaging system. It uses a 3D translating device to control a commercial linear ultrasound transducer to collect pre-compression and post-compression radio-frequency (RF) echo signal frames. The RF frames are wirelessly transferred to a high-performance server via a local area network (LAN). A dynamic programming strain estimation algorithm is implemented with the compute unified device architecture (CUDA) on the graphic processing unit (GPU) in the server to calculate the strain image after receiving a pre-compression RF frame and a post-compression RF frame at the same position. Each strain image is inserted into a strain volume which can be rendered in near real-time. We take full advantage of the translating device to precisely control the probe movement and compression. The GPU-based parallel computing techniques are designed to reduce the computation time. Phantom and in vivo experimental results demonstrate that our system can generate strain volumes with good quality and display an incrementally reconstructed volume image in near real-time.

Real-time 3D ultrasound imaging of infant tongue movements during breast-feeding

BackgroundWhether infants use suction or peristaltic tongue movements or a combination to extract milk during breast-feeding is controversial. The aims of this pilot study were 1] to evaluate the feasibility of using 3D ultrasound scanning to visualise infant tongue movements; and 2] to ascertain whether peristaltic tongue movements could be demonstrated during breast-feeding. Methods15 healthy term infants, aged 2weeks to 4months were scanned during breast-feeding, using a real-time 3D ultrasound system, with a 7MHz transducer placed sub-mentally. Results1] The method proved feasible, with 72% of bi-plane datasets and 56% of real-time 3D datasets providing adequate coverage [>75%] of the infant tongue. 2] Peristaltic tongue movement was observed in 13 of 15 infants [83%] from real-time or reformatted truly mid-sagittal views under 3D guidance. ConclusionsThis is the first study to demonstrate the feasibility of using 3D ultrasound to visualise infant tongue movements during breast-feeding. Peristaltic infant tongue movement was present in the majority of infants when the image plane was truly mid-sagittal but was not apparent if the image was slightly off the mid-sagittal plane. This should be considered in studies investigating the relative importance of vacuum and peristalsis for milk transfer.

Strain Measurement of Abdominal Aortic Aneurysm with Real-time 3D Ultrasound Speckle Tracking

Abdominal aortic aneurysm rupture is caused by mechanical vascular tissue failure. Although mechanical properties within the aneurysm vary, currently available ultrasound methods assess only one cross-sectional segment of the aorta. This study aims to establish real-time 3-dimensional (3D) speckle tracking ultrasound to explore local displacement and strain parameters of the whole abdominal aortic aneurysm. Validation was performed on a silicone aneurysm model, perfused in a pulsatile artificial circulatory system. Wall motion of the silicone model was measured simultaneously with a commercial real-time 3D speckle tracking ultrasound system and either with laser-scan micrometry or with video photogrammetry. After validation, 3D ultrasound data were collected from abdominal aortic aneurysms of five patients and displacement and strain parameters were analysed. Displacement parameters measured in vitro by 3D ultrasound and laser scan micrometer or video analysis were significantly correlated at pulse pressures between 40 and 80 mmHg. Strong local differences in displacement and strain were identified within the aortic aneurysms of patients. Local wall strain of the whole abdominal aortic aneurysm can be analysed in vivo with real-time 3D ultrasound speckle tracking imaging, offering the prospect of individual non-invasive rupture risk analysis of abdominal aortic aneurysms.

Enabling 3D Ultrasound Procedure Guidance through Enhanced Visualization.

Real-time 3D ultrasound (3DUS) imaging offers improved spatial orientation information relative to 2D ultrasound. However, in order to improve its efficacy in guiding minimally invasive intra-cardiac procedures where real-time visual feedback of an instrument tip location is crucial, 3DUS volume visualization alone is inadequate. This paper presents a set of enhanced visualization functionalities that are able to track the tip of an instrument in slice views at real-time. User study with in vitro porcine heart indicates a speedup of over 30% in task completion time.

術中リアルタイム3D超音波診断画像を用いた胎児外科手術ナビゲーションの開発

術中リアルタイム3D超音波診断画像を用いた胎児外科手術ナビゲーションの開発

Extended, ultrasound real time 3D image probe for insertion into the body

An ultrasound imaging probe for real time 3D ultrasound imaging from the tip of the probe that can be inserted into the body. The ultrasound beam is electronically scanned within a 2D azimuth plane with a linear array, and scanning in the elevation direction at right angle to the azimuth plane is obtained by mechanical movement of the array. The mechanical movement is either achieved by rotation of the array through a flexible wire, or through wobbling of the array, for example through hydraulic actuation. The probe can be made both flexible and stiff, where the flexible embodiment is particularly interesting for catheter imaging in the heart and vessels, and the stiff embodiment has applications in minimal invasive surgery and other procedures. The probe design allows for low cost manufacturing which allows factory sterilized probes to be disposed after use.

An open-source real-time ultrasound reconstruction system for four-dimensional imaging of moving organs

Four-dimensional imaging is a necessary step in computer-assisted interventions (CAI) performed on moving surgical targets, such as those located within the beating heart or influenced by respiratory motion. Ultrasound (US) is often the best imaging modality for this application, as it provides good contrast and spatial resolution while remaining simple to integrate into the operating room. However, conventional 2D US imaging is often insufficient for preoperative planning and surgical guidance, real-time 3D ultrasound imaging using matrix array probes has a smaller field of view and lower spatial resolution, and 3D volumes created using 3D US reconstruction suffer from motion artifacts. As an alternative, gated 4D ultrasound reconstruction using a tracked 2D US probe is a promising technology. In this paper, we present SynchroGrab4D to the open-source community. SynchroGrab4D performs 3D and 4D US reconstruction in real-time while visualizing the output volume(s) within an OpenIGTLink-compliant CAI system, such as 3D Slicer. Also included are VTK classes that perform ECG-gating and that interface with several commercial tracking systems, as well as a 4D Imaging module in 3D Slicer. Our open-source imaging system can be used to collect the 4D image data required for computer-assisted surgical planning and intraoperative guidance for a variety of moving organs.

4D cardiac strain imaging for diagnosis of chronic heart failure

Strain imaging or elastography is a well-known technique for measuring passive and active deformation of biological tissue [1,2]. Cardiac strain imaging has been assessed as a non-invasive technique for mapping the mechanical properties of myocardial tissue and monitoring cardiac diseases, such as fibrosis and infarction [2]. The introduction of real-time 3D ultrasound imaging has boosted research in 3D strain imaging. The complex heart movements and deformations require 3D+t data for accurate assessment of strain in all directions. Sub-optimal temporal resolution of 3D datasets is still a problem. In this study, BiPlane and full 3D volume imaging are used for measuring cardiac strain in 3 orthogonal directions and their application to detect chronic heart failure.

Stereotactic mammography imaging combined with 3D US imaging for image guided breast biopsy

Stereotactic X-ray mammography (SM) and ultrasound (US) guidance are both commonly used for breast biopsy. While SM provides three-dimensional (3D) targeting information and US provides real-time guidance, both have limitations. SM is a long and uncomfortable procedure and the US guided procedure is inherently two dimensional (2D), requiring a skilled physician for both safety and accuracy. The authors developed a 3D US-guided biopsy system to be integrated with, and to supplement SM imaging. Their goal is to be able to biopsy a larger percentage of suspicious masses using US, by clarifying ambiguous structures with SM imaging. Features from SM and US guided biopsy were combined, including breast stabilization, a confined needle trajectory, and dual modality imaging. The 3D US guided biopsy system uses a 7.5 MHz breast probe and is mounted on an upright SM machine for preprocedural imaging. Intraprocedural targeting and guidance was achieved with real-time 2D and near real-time 3D US imaging. Postbiopsy 3D US imaging allowed for confirmation that the needle was penetrating the target. The authors evaluated 3D US-guided biopsy accuracy of their system using test phantoms. To use mammographic imaging information, they registered the SM and 3D US coordinate systems. The 3D positions of targets identified in the SM images were determined with a target localization error (TLE) of 0.49 mm. The z component (x-ray tube to image) of the TLE dominated with a TLEz of 0.47 mm. The SM system was then registered to 3D US, with a fiducial registration error (FRE) and target registration error (TRE) of 0.82 and 0.92 mm, respectively. Analysis of the FRE and TRE components showed that these errors were dominated by inaccuracies in the z component with a FREz of 0.76 mm and a TREz of 0.85 mm. A stereotactic mammography and 3D US guided breast biopsy system should include breast compression for stability and safety and dual modality imaging for target localization. The system will provide preprocedural x-ray mammography information in the form of SM imaging along with real-time US imaging for needle guidance to a target. 3D US imaging will also be available for targeting, guidance, and biopsy verification immediately postbiopsy.

Imaging Artifacts of Medical Instruments in Ultrasound-Guided Interventions

Real-time 3-dimensional (3D) ultrasound imaging has the potential to become a dominant imaging technique for minimally invasive surgery. One barrier to its widespread use is that surgical instruments generate imaging artifacts, which can obfuscate their location, orientation, and geometry and obscure nearby tissue. The purpose of this study was to identify and describe the types of artifacts which could be produced by metallic instruments during interventions guided by 3D ultrasound imaging. Three imaging studies were performed. First, imaging artifacts from stainless steel rods were identified in vitro and acoustically characterized. Second, 3 typical minimally invasive instruments were imaged (in vitro and in vivo), and their artifacts were analyzed. The third study compared the intensity of imaging artifacts (in vitro and in vivo) from stainless steel rods with rods composed of 3 different materials and stainless steel rods with roughened and coated surfaces. For the stainless steel rods, all observed artifacts are described and illustrated, and their physical origins are explained. Artifacts from the 3 minimally invasive instruments are characterized with the use of the artifacts observed with the rods. Finally, it is shown that artifacts can be greatly reduced through the use of alternate materials or by surface modification. Instrument artifacts in 3D ultrasound images can be more confusing than those from the same instruments imaged in 2 dimensions. Real-time 3D ultrasound imaging can, however, be used effectively for in vivo imaging of minimally invasive instruments by using artifact mitigation techniques, including careful selection of probe and incision locations, as well as by instrument modification.

Integrated Endoscope for Real-Time 3D Ultrasound Imaging and Hyperthermia: Feasibility Study

The goal of this research is to determine the feasibility of using a single endoscopic probe for the combined purpose of real-time 3D (RT3D) ultrasound imaging of a target organ and the delivery of ultrasound therapy to facilitate the absorption of compounds for cancer treatment. Recent research in ultrasound therapy has shown that ultrasound-mediated drug delivery improves absorption of treatments for prostate, cervical and esophageal cancer. The ability to combine ultrasound hyperthermia and 3D imaging could improve visualization and targeting of cancerous tissues. In this study, numerical modeling and experimental measurements were developed to determine the feasibility of combined therapy and imaging with a 1 cm diameter endoscopic RT3D probe with 504 transmitters and 252 receive channels. This device operates at 5 MHz and has a 6.3 mm x 6.3 mm aperture to produce real time 3D pyramidal scans of 60-120 degrees incorporating 64 x 64 = 4096 image lines at 30 volumes/sec interleaved with a 3D steerable therapy beam. A finite-element mesh was constructed with over 128,000 elements in LS-DYNA to simulate the induced temperature rise from our transducer with a 3 cm deep focus in tissue. Quarter-symmetry of the transducer was used to reduce mesh size and computation time. Based on intensity values calculated in Field II using the transducer's array geometry, a minimum I(SPTA) of 3.6 W/cm2 is required from our endoscope probe in order to induce a temperature rise of 4 degrees C within five minutes. Experimental measurements of the array's power output capabilities were conducted using a PVDF hydrophone placed 3 cm away from the face of the transducer in a watertank. Using a PDA14 Signatec data acquisition board to capture full volumes of transmitted ultrasound data, it was determined that the probe can presently maintain intensity values up to 2.4 W/cm2 over indefinite times for therapeutic applications combined with intermittent 3D scanning to maintain targeting. These values were acquired using 8 cycle bursts at a prf of 6 kHz. Ex vivo heating experiments of excised pork tissue yielded a maximum temperature rises of 2.3 degrees C over 5 minutes of ultrasound exposure with an average rise of 1.8 +/- 0.2 degrees C over 5 trials. Modifications to the power supply and transducer array may enable us to reach the higher intensities required to facilitate drug delivery therapy.

3D ultrasound in robotic surgery: performance evaluation with stereo displays

The recent advent of real-time 3D ultrasound (3DUS) imaging enables a variety of new surgical procedures. These procedures are hampered by the difficulty of manipulating tissue guided by the distorted, low-resolution 3DUS images. To lessen the effects of these limitations, we investigated stereo displays and surgical robots for 3DUS-guided procedures. By integrating real-time stereo rendering of 3DUS with the binocular display of a surgical robot, we compared stereo-displayed 3DUS with normally displayed 3DUS. To test the efficacy of stereo-displayed 3DUS, eight surgeons and eight non-surgeons performed in vitro tasks with the surgical robot. Error rates dropped by 50% with a stereo display. In addition, subjects completed tasks faster with the stereo-displayed 3DUS as compared to normal-displayed 3DUS. A 28% decrease in task time was seen across all subjects. The results highlight the importance of using a stereo display. By reducing errors and increasing speed, it is an important enhancement to 3DUS-guided robotics procedures.

Direct ultrasonic holography: Feasibility demo

Holography is potentially the most powerful method for high spatial resolution real time 3D ultrasound imaging and diagnostics. Although versions of ultrasound holography have existed since the 1970s, they use laser reconstruction, thus losing 3-D resolution. By using transmissive ultrasound with a scanning needle hydrophone, full 3D holographic imaging is proved to be possible, if both amplitude and time delay phase information can be obtained.

Real-Time Three-Dimensional Ultrasound for Guiding Surgical Tasks

Objective: As a stand-alone imaging modality, two-dimensional (2D) ultrasound (US) can only guide basic interventional tasks due to the limited spatial orientation information contained in these images. High-resolution real-time three-dimensional (3D) US can potentially overcome this limitation, thereby expanding the applications for US-guided procedures to include intracardiac surgery and fetal surgery, while potentially improving results of solid organ interventions such as image-guided breast, liver or prostate procedures. The following study examines the benefits of real-time 3D US for performing both basic and complex image-guided surgical tasks.Materials and Methods: Seven surgical trainees performed three tasks in an acoustic testing tank simulating an image-guided surgical environment using 2D US, biplanar 2D US, and 3D US for guidance. Surgeon-controlled US imaging was also tested. The evaluation tasks were (1) bead-in-hole navigation; (2) bead-to-bead navigation; and (3) clip fixation. Performance measures included completion time, tool tip trajectory, and error rates, with endoscope-guided performance serving as a gold-standard reference measure for each subject.Results: Compared to 2D US guidance, completion times decreased significantly with 3D US for both bead-in-hole navigation (50%, p = 0.046) and bead-to-bead navigation (77%, p = 0.009). Furthermore, tool-tip tracking for bead-to-bead navigation demonstrated improved navigational accuracy using 3D US versus 2D US (46%, p = 0.040). Biplanar 2D imaging and surgeon-controlled 2D US did not significantly improve performance as compared to conventional 2D US. In real-time 3D mode, surgeon-controlled imaging and changes in 3D image presentation made by adjusting the perspective of the 3D image did not diminish performance. For clip fixation, completion times proved excessive with 2D US guidance (< 240 s). However, with real-time 3D US imaging, completion times and error rates were comparable to endoscope-guided performance.Conclusions: Real-time 3D US can guide basic surgical tasks more efficiently and accurately than 2D US imaging. Real-time 3D US can also guide more complex surgical tasks which may prove useful for procedures where optical imaging is suboptimal, as in fetal surgery or intracardiac interventions.