Convolutional Beamformer Research Articles

Coherence-based phase aberration correction and beamforming for ring-array ultrasound imaging

Degradation of image quality caused by aberrations and off-axis interferences is common in medical ultrasound imaging. The ring-array echo imaging also suffers from these constraints, where phase aberrations caused by tissue heterogeneity create overlapping of interest target and worsen the interpretability of anatomical structures; while off-axis interferences reduce the spatial resolution and contrast of the reconstructed images. To address them, the signal coherence is available since they can be considered as incoherent interference and noise. The coherence factor (CF) is sensitive to phase aberrations and is thus adopted in this study. Moreover, the convolutional beamforming algorithm (COBA) specifically exploits the autocorrelation operation to improve the signal coherence and effectively reduce noise. Therefore, we first utilize the CF to detect the local coherence and its maximization criterion as a way to estimate the sound speed to correct for phase aberration. Then, CF is used as an adaptive weighting factor to suppress the noise, and based on this, we develop a short-lag COBA to further enhance the image quality, referred to as the CF_SLCOBA method. Simulations and experiments were performed to evaluate the performance of the proposed methods. Results show that, the improvements of the CF_SLCOBA method in resolution is about 26.8% compared with CF; while about 92.0% in contrast ratio (CR) compared with COBA, in the experiments. Meanwhile, the proposed method yields a good performance in phase aberration correction. This demonstrates that the proposed method may provide benefits for rebuilding high-quality images, which also reveals that it offers a certain potential for practical applications.

Compressed Fourier-Domain Convolutional Beamforming for Sub-Nyquist Ultrasound Imaging.

Efficient ultrasound (US) systems that produce high-quality images can improve current clinical diagnosis capabilities by making the imaging process much more affordable and accessible to users. The most common technique for generating B-mode US images is delay-and-sum (DAS) beamforming, where an appropriate delay is introduced to signals sampled and processed at each transducer element. However, sampling rates that are much higher than the Nyquist rate of the signal are required for high-resolution DAS beamforming, leading to large amounts of data, making remote processing of channel data impractical. Moreover, the production of US images that exhibit high resolution and good image contrast requires a large set of transducer elements, which further increases the data size. Previous works suggest methods for reduction in sampling rate and in array size. In this work, we introduce compressed Fourier domain convolutional beamforming, combining Fourier domain beamforming (FDBF), sparse convolutional beamforming, and compressed sensing methods. This allows reducing both the number of array elements and the sampling rate in each element while achieving high-resolution images. Using in vivo data, we demonstrate that the proposed method can generate B-mode images using 142 times less data than DAS. Our results pave the way toward efficient US and demonstrate that high-resolution US images can be produced using sub-Nyquist sampling in time and space.

Switching Independent Vector Analysis and its Extension to Blind and Spatially Guided Convolutional Beamforming Algorithms

This paper develops a framework that can accurately perform denoising, dereverberation, and source separation using a relatively small number of microphones. It has been empirically confirmed that Independent Vector Analysis (IVA) can blindly separate <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><tex-math notation="LaTeX">$N$</tex-math></inline-formula> sources from their sound mixture even with diffuse noise when a sufficiently large number ( <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><tex-math notation="LaTeX">$=M$</tex-math></inline-formula> ) of microphones are available (i.e., <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><tex-math notation="LaTeX">$M\gg N)$</tex-math></inline-formula> . However, the estimation accuracy is seriously degraded when the number of microphones, or more specifically <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><tex-math notation="LaTeX">$M-N$</tex-math></inline-formula> <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><tex-math notation="LaTeX">$(\geq 0)$</tex-math></inline-formula> , decreases. To overcome this IVA limitation, we propose switching IVA (swIVA) in this paper. With swIVA, the time frames of an observed signal with time-varying characteristics are clustered into several groups, each of which can be well handled by IVA with a small number of microphones, and thus accurate estimation can be achieved by individually applying IVA to each group. Conventionally, a switching mechanism was introduced into a Minimum-Variance Distortionless Response (MVDR) beamformer, and this paper extends the mechanism to work with a blind source separation algorithm. To incorporate dereverberation capability, we further extend swIVA to a blind Convolutional beamforming algorithm (swCIVA) that integrates swIVA and switching Weighted Prediction Error-based dereverberation (swWPE) in a jointly optimal way. With swCIVA, two different time-varying characteristics of an observed signal are captured for dereverberation and source separation to achieve effective estimation. We show that both swIVA and swCIVA can be optimized effectively based on blind signal processing, and their performance can be further improved using a spatial guide for initialization. Experiments demonstrate that both the proposed methods largely outperformed conventional IVA and its convolutional beamforming extension (CIVA) in terms of objective signal quality and automatic speech recognition scores when using relatively few microphones.

Flexible Beamforming of Dynamic MIMO Networks Through Fully Convolutional Model

Existing deep learning-based beamforming models’ input sizes are fixed, and they can only be used in multiple-input multiple-output (MIMO) networks containing a fixed number of users and base stations. Therefore, they cannot work and need retraining when the number of users is dynamic. In this letter, a fully convolutional beamforming model named FC-BFNet is proposed, where data of different dimensions can be addressed to adapt to the dynamic environment without retraining the model. Specifically, FC-BFNet has two computational parts which are mainly made up of convolution layers because the convolution operation is not sensitive to the size of the input data. Differently and importantly, the first part extra uses max-pooling to calculate the underlying features of the input and stores max-pooling indices, while the second part extra leverages up-pooling based on stored indices to obtain the expected results from the underlying features and ensure the size consistency of input and output. Extensive experiments demonstrate FC-BFNet has better dynamic environment adaptability and sum-rate performance than other baselines, while maintaining great computing efficiency.

The researches on convolutional beamforming for linear-array photoacoustic tomography

The convolutional beamforming algorithm (COBA) which can be easily implemented by fast Fourier transform (FFT) and is suitable for real-time photoacoustic tomography (PAT) is introduced. In order to reveal the imaging effects of COBA, the photoacoustic images reconstructed by COBA, delay-and-sum algorithm (DAS), and minimum variance (MV) are investigated. The results demonstrate that the COBA significantly improves the lateral resolution and the contrast of the photoacoustic images. Moreover, the coherence factor (CF) as an adaptive weighting is used in COBA, the combined method shows that better lateral resolution and contrast of photoacoustic images can be obtained, which can be a potential imaging method for linear-array PAT.

Sparse Convolutional Beamforming for 3-D Ultrafast Ultrasound Imaging.

Real-time 3-D ultrasound (US) provides a complete visualization of inner body organs and blood vasculature, crucial for diagnosis and treatment of diverse diseases. However, 3-D systems require massive hardware due to the huge number of transducer elements and consequent data size. This increases cost significantly and limit both frame rate and image quality, thus preventing the 3-D US from being common practice in clinics worldwide. A recent study presented a technique called sparse convolutional beamforming algorithm (SCOBA), which obtains improved image quality while allowing notable element reduction in the context of 2-D focused imaging. In this article, we build upon previous work and introduce a nonlinear beamformer for 3-D imaging, called COBA-3D, consisting of 2-D spatial convolution of the in-phase and quadrature received signals. The proposed technique considers diverging-wave transmission and achieves improved image resolution and contrast compared with standard delay-and-sum beamforming while enabling a high frame rate. Incorporating 2-D sparse arrays into our method creates SCOBA-3D: a sparse beamformer that offers significant element reduction and, thus, allows performing 3-D imaging with the resources typically available for 2-D setups. To create 2-D thinned arrays, we present a scalable and systematic way to design 2-D fractal sparse arrays. The proposed framework paves the way for affordable ultrafast US devices that perform high-quality 3-D imaging, as demonstrated using phantom and ex-vivo data.

Independent Vector Extraction for Fast Joint Blind Source Separation and Dereverberation

We address a blind source separation (BSS) problem in a noisy reverberant environment in which the number of microphones $M$ is greater than the number of sources of interest, and the other noise components can be approximated as stationary and Gaussian distributed. Conventional BSS algorithms for the optimization of a multi-input multi-output convolutional beamformer have suffered from a huge computational cost when $M$ is large. We here propose a computationally efficient method that integrates a weighted prediction error (WPE) dereverberation method and a fast BSS method called independent vector extraction (IVE), which has been developed for less reverberant environments. We show that, given the power spectrum for each source, the optimization problem of the new method can be reduced to that of IVE by exploiting the stationary condition, which makes the optimization easy to handle and computationally efficient. An experiment of speech signal separation shows that, compared to a conventional method that integrates WPE and independent vector analysis, our proposed method achieves much faster convergence while maintaining its separation performance.

Jointly Optimal Denoising, Dereverberation, and Source Separation

This paper proposes methods that can optimize a Convolutional BeamFormer (CBF) for jointly performing denoising, dereverberation, and source separation (DN+DR+SS) in a computationally efficient way. Conventionally, cascade configuration composed of a Weighted Prediction Error minimization (WPE) dereverberation filter followed by a Minimum Variance Distortionless Response beamformer has been usedas the state-of-the-art frontend of far-field speech recognition, however, overall optimality of this approach is not guaranteed. In the blind signal processing area, an approach for jointly optimizing dereverberation and source separation (DR+SS) has been proposed, however, this approach requires huge computing cost, and has not been extended for application to DN+DR+SS. To overcome the above limitations, this paper develops new approaches for jointly optimizing DN+DR+SS in a computationally much more efficient way. To this end, we first present an objective function to optimize a CBF for performing DN+DR+SS based on the maximum likelihood estimation, on an assumption that the steering vectors of the target signals are given or can be estimated, e.g., using a neural network. This paper refers to a CBF optimized by this objective function as a weighted Minimum-Power Distortionless Response (wMPDR) CBF. Then, we derive two algorithms for optimizing a wMPDR CBF based on two different ways of factorizing a CBF into WPE filters and beamformers. Experiments using noisy reverberant sound mixtures show that the proposed optimization approaches greatly improve the performance of the speech enhancement in comparison with the conventional cascade configuration in terms of the signal distortion measures and ASR performance. It is also shown that the proposed approaches can greatly reduce the computing cost with improved estimation accuracy in comparison with the conventional joint optimization approach.

Minkowski-Algebra-Based Super-Sparse Array Design for Super-Resolution Ultrasound Imaging

Sparse arrays give rise to the possibility of miniaturization of sensor arrays for ultrasound imaging. The design of sparse arrays that preserves the full-array beampattern has received much attention in the recent past. Based on the transmit/receive pair array synthesis model proposed by Hoctor and Kassam, issues related to producing effective apertures twice their corresponding physical arrays have been addressed. We consider two sparse array designs -SCOBA and SCOBAR - proposed recently and investigate the sparsity of their acquisition apertures and sub-apertures. We constructively formulate the problem of designing sparse arrays using fundamental properties from Minkowski algebra. Our investigation leads to two novel super-sparse array designs, which are sparser than SCOBA and SCOBAR and computationally more efficient for performing convolutional beamforming. They also have identical beampatterns and consequently similar lateral resolution as SCOBA and SCOBAR. We substantiate our findings using Field-II simulations.

A Unified Convolutional Beamformer for Simultaneous Denoising and Dereverberation

This paper proposes a method for estimating a convolutional beamformer that can perform denoising and dereverberation simultaneously in an optimal way. The application of dereverberation based on a weighted prediction error (WPE) method followed by denoising based on a minimum variance distortionless response (MVDR) beamformer has conventionally been considered a promising approach, however, the optimality of this approach cannot be guaranteed. To realize the optimal integration of denoising and dereverberation, we present a method that unifies the WPE dereverberation method and a variant of the MVDR beamformer, namely a minimum power distortionless response (MPDR) beamformer, into a single convolutional beamformer, and we optimize it based on a single unified optimization criterion. The proposed beamformer is referred to as a Weighted Power minimization Distortionless response (WPD) beamformer. Experiments show that the proposed method substantially improves the speech enhancement performance in terms of both objective speech enhancement measures and automatic speech recognition (ASR) performance.

Sparse Convolutional Beamforming for Ultrasound Imaging.

The standard technique used by commercial medical ultrasound systems to form B-mode images is delay and sum (DAS) beamforming. However, DAS often results in limited image resolution and contrast that are governed by the center frequency and the aperture size of the ultrasound transducer. A large number of elements lead to improved resolution but at the same time increase the data size and the system cost due to the receive electronics required for each element. Therefore, reducing the number of receiving channels while producing high-quality images is of great importance. In this paper, we introduce a nonlinear beamformer called COnvolutional Beamforming Algorithm (COBA), which achieves significant improvement of lateral resolution and contrast. In addition, it can be implemented efficiently using the fast Fourier transform. Based on the COBA concept, we next present two sparse beamformers with closed-form expressions for the sensor locations, which result in the same beam pattern as DAS and COBA while using far fewer array elements. Optimization of the number of elements shows that they require a minimal number of elements that are on the order of the square root of the number used by DAS. The performance of the proposed methods is tested and validated using simulated data, phantom scans, and in vivo cardiac data. The results demonstrate that COBA outperforms DAS in terms of resolution and contrast and that the suggested beamformers offer a sizable element reduction while generating images with an equivalent or improved quality in comparison with DAS.