High Frame Research Articles

Multispectral multiplexed confocal FLIM for live cell imaging

Abstract Spectrally resolved fluorescence lifetime imaging with high spatial precision offers comprehensive information on species localization and behavior. It is challenging to resolve weak fluorescence signals in multiple dimensions (spatial, spectral, and temporal) at high frame rates, especially in dynamic live cell processes, as photobleaching and phototoxicity limit acceptable photon count rates. We developed a multiplexed confocal FLIM technique, which uses a prism-based imaging spectrometer to separate a 10x10 array of confocal foci into their spectral components. This allows the sampling of the spectra by a time-resolved image sensor to produce a multispectral time-resolved data set used for generating multispectral lifetime images. This system captures 300x300 pixel fluorescence lifetime images containing 12 unique spectral bands covering a 450-700 nm spectral range in 1.8 seconds of exposure. Its performance was demonstrated in fixed stained samples and in multispectral imaging of FLIM-FRET in live cells.

Value of high frame rate contrast-enhanced ultrasound in predicting microvascular invasion of hepatocellular carcinoma.

To investigate the value of vascular morphology on high frame rate contrast-enhanced ultrasound (H-CEUS) and CEUS Li-RADS in predicting microvascular invasion (MVI), Ki-67 expression and recurrence of hepatocellular carcinoma (HCC). This retrospective study enrolled 78 patients with single HCC diagnosed by postoperative pathology between January 1, 2021, and June 30, 2022. All patients underwent ultrasound and H-CEUS examination before operation. H-CEUS image features and CEUS Li-RADS were compared in different MVI status and Ki-67 level. Multiple logistic regression analysis was performed to select independent variables for MVI. Differences in recurrence among different H-CEUS image features, MVI status and Ki-67 level were further analyzed. Tumor shape, vascular morphology, LR-M category, necrosis and AFP level were different between the MVI-positive group and MVI-negative group (p < 0.05). Vascular morphology and LR-M category were independent risk factors related to MVI (p < 0.05). Vascular morphology was also different between the high Ki-67 expression group and low Ki-67 expression group (p < 0.05). Vascular morphology, MVI status and Ki-67 expression were different between the recurrence group and no recurrence group (p < 0.05). The vascular morphology of HCC on H-CEUS can indicate the risk of MVI status, Ki-67 expression and recurrence, which provides a feasible imaging technique for predicting the prognosis before operation. H-CEUS shows the different vascular morphology of HCC in arterial phase and indicates the risk of MVI, Ki-67 expression and recurrence, which provides a feasible imaging technique for clinician to judge the risk of MVI pre-operation and adopt appropriate treatment. H-CEUS can clearly show different vascular morphology of HCC in arterial phase. Vascular morphology on H-CEUS is associated with MVI status, Ki-67 expression and HCC recurrence. Preoperative MVI and Ki-67 expression prediction could help surgeons choose a more appropriate treatment plan.

Abstract 4113716: Natural shear wave imaging as a predictor for left ventricular pressures: Can they reflect raised filling pressures?

Background: Current conventional echocardiographic assessment of diastolic function relies on predicting left ventricular (LV) filling pressure as a surrogate of diastolic function. High frame rate (HFR) Shear wave (SW) imaging is emerging as an innovative parameter for assessing myocardial stiffness, a key determinant of diastolic function. Natural SW are induced by valve closure (i.e. mitral valve closure (MVC)). Little is known so far, to which extent SWs could reflect changes in diastolic LV filling pressures. Purpose: We aimed at investigating the relationship between natural SW after MVC and LV diastolic pressures in an attempt to set up a cut-off value beyond which, elevated LV pressure can be suspected indicating diastolic dysfunction. Methods: Thirty patients (mean age 68.4±9.9 years) scheduled for clinically indicated left heart catheterization were prospectively recruited. Left ventricular end-diastolic pressure (LVEDP) was measured during the catheterization. Immediately afterwards, conventional as well as HFR (1167 ±86 Hz) echocardiography was performed. We drew an anatomical M-mode along the anteroseptal wall in the parasternal long axis view from base to apex and the display was colour coded for tissue acceleration. SWs appeared immediately after MVC as tilted green bands and their propagation velocity was measured semi-automatically (Figure 1) . Results: LVEDP in our cohort ranged from 7.5 to 29.5 mmHg. From conventional echocardiographic parameters, only mitral inflow to mitral relaxation velocity ratio (E/e’) correlated moderately with LVEDP (r=0.51, p=0.006). SW velocities after MVC showed strong positive correlation with LVEDP (r=0.78, p&lt;0.001) (Figure 2) . A cut-off value for SW velocity of 5.8 m/s showed an excellent ability to discriminate normal from elevated LVEDP (AUC: 0.98; Sensitivity: 90%, specificity: 100%, accuracy: 97%) (Figure 3) . Conclusions: Our data showed that SW velocities at end-diastole after MVC could predict elevated LV filling pressures accurately. Natural shear wave imaging appears as a promising innovative tool for assessment of diastolic function.

Dyssynchronous Fetal Heart Failure in Maternal Diabetes: Evaluation with Speckle Tracking Echocardiography and Novel M-Mode Software

ObjectivesThis study aimed to investigate dyssynchronous heart failure in fetuses of mothers with diabetes mellitus (FDM) and fetal controls (FC) using two-dimensional speckle tracking echocardiography (2D-STE) and novel M-mode prototype software (PS). MethodsIn this cohort study 174 fetuses were analyzed, 87 in the FDM-cohort and 87 gestational age-matched fetuses in the FC-cohort. A subgroup of 38 fetuses formed the final case group, with a high median frame rate of approximately 160 frames/s. Using 2D Cardiac Performance Analysis software (TOMTEC, Unterschleissheim, Germany) we measured global longitudinal strain (GLS). TOMTEC PS detected annular displacement by assessing an artificial M-mode on the previously generated tracking. Dyssynchrony (DYS) was calculated as the inter- and intraventricular difference in time to peak GLS or annular displacement. ResultsGreater DYS was observed in all basal myocardial measurement sites and software between FDM-cohort compared to FC-cohort and no significant correlation was found between DYS measurements and gestational age. Intraventricular DYS between the basal segments was statistically significant (all p ≤ 0.036, Wald test of univariate regression models). The PS performed best in DYS measurements identifying right ventricular DYS as potentially predicting FDM (FDM: median, 18.5 (interquartile range [IQR], 13.9–25.0) ms vs. FC: median, 2.7 [IQR, 1.5–3.5] ms; p < 0.001). ConclusionIncreased intraventricular DYS demonstrated an impact of maternal diabetes mellitus on fetal hearts independent of gestational age. The prototype M-mode method identified cardiac dysfunction with higher accuracy than the conventional analysis. High-quality echocardiographic image acquisition is imperative for clinical application of 2D-STE and related advanced technologies.

The infrared thermography system on the MAST-U tokamak

Power loading from plasma in the scrape-off layer limits the lifetime of plasma-facing components in tokamak-based power plants. The Mega Ampere Spherical Tokamak Upgrade [W. Morris et al., IEEE Trans. Plasma Sci. 46(5), 1217–1226 (2018)] (MAST-U) features four divertor strike points (SP) owing to its up-down symmetry. This paper introduces the five-camera infrared thermography system, covering all four SPs and their mode of operation on MAST-U. The system employs both medium and long wavelength cameras, offering high frame rates up to 4 kHz and spatial resolutions of down to 3 mm. Postprocessing involves artifact elimination and heat flux calculation using in-house analysis software that incorporates the inverse heat transfer code, THEODOR (THermal Energy Onto DivertOR).

Normal values and distribution of ventricular global longitudinal strain in 513 healthy fetuses measured by two-dimensional speckle-tracking echocardiography: a multi-institutional cohort study.

This study aimed to determine the normal reference values and distribution of global longitudinal strain (GLS) in the right and left ventricles of healthy Japanese fetuses during pregnancy. This multi-institutional cohort study included healthy Japanese fetuses during normal pregnancies without maternal or fetal complications between 18 and 40weeks of gestation. Two-dimensional fetal echocardiographic images of the four-chamber view with a high frame rate were acquired and stored as DICOM clips. Data were collected and analyzed in a central laboratory to measure the left ventricular (LV) and right ventricular (RV) GLS using two-dimensional speckle tracking. In total, 513 fetuses were enrolled. The mean LV-GLS and RV-GLS were - 24.3% ± 3.5% and - 23.5% ± 3.7%, respectively. The magnitude of the GLS, with normal limits in both ventricles, decreased with advancing gestation. LV values were r = 0.34 (95% confidence interval, 0.27-0.42) and p < 0.0001; RV values were r = 0.33 (95% confidence interval, 0.25-0.41) and p < 0.0001. The normal values of healthy Japanese fetuses in healthy pregnancies is the first to be established by the large-scale, multi-institutional cohort study as LV-GLS of 24.3% ± 3.5% and RV-GLS of - 23.5% ± 3.7%, respectively. This can serve as a basic reference for assessing the cardiac functions in Japanese fetuses with various heart diseases.

Efficient Vehicle Detection and Optimization in Multi-Graph Mode Considering Multi-Section Tracking Based on Geographic Similarity

Vehicle detection is an important part of modern intelligent transportation systems. At present, complex deep learning algorithms are often used for vehicle detection and tracking, but high-precision detection results are often obtained at the cost of time, and the existing research rarely considers optimization algorithms for vehicle information. Based on this, we propose an efficient method for vehicle detection in multi-graph mode and optimization method considering multi-section tracking based on geographic similarity. In this framework, we design a vehicle extraction method based on multi-graph mode and a vehicle detection technology based on traffic flow characteristics, which can cope with the challenge of vehicle detection under an unstable environment. Further, a multi-section tracking optimization technology based on geographic similarity at a high video frame rate is proposed, which can efficiently identify lane change behavior and match, track, and optimize vehicles. Experiments are carried out on several road sections, and the model performance and optimization effect are analyzed. The experimental results show that the vehicle detection and optimization algorithm proposed in this paper has the best effect and high detection accuracy and robustness. The average results of Recall, Precision, and F1 are 0.9715, 0.979, and 0.9752, respectively, all of which are above 0.97, showing certain competitiveness in the field of vehicle detection.

Mechanical wave velocities in acute myocardial infarction: an exploratory study using three-dimensional high frame rate echocardiography

Abstract Background Evaluation of cardiac function is crucial for management of patients with acute myocardial infarction (AMI). Recently, high frame rate (HFR) echocardiography has enabled identification of fast-propagating mechanical waves (MW) within the myocardium. These waves have the potential to offer unique insights into myocardial tissue properties, including edema and fibrosis. However, the potential of 3D HFR echocardiography to accurately quantify MW velocities and thereby assess myocardial stiffness in AMI patients remains unexplored. Purpose To assess the feasibility of a novel method for estimating MW velocities using 3D HFR echocardiography in patients with AMI compared to healthy controls. Methods Twenty patients with first time ST-elevation myocardial infarction were included within 48 hours after reperfusion therapy. We used a commercially available ultrasound scanner to acquire conventional 3D high-quality (~20 frames per second) acquisitions and subsequent 3D HFR recordings (~820 frames per second). The high-quality recording was used to extract a myocardial mask to define the region of interest in the HFR acquisition to detect the atrial kick wave and generate a comprehensive 3D map of MW propagation and velocities. We compared MW velocities between these patients and twenty age- and sex-matched healthy controls. Results MW velocities were successfully measured in 93% of participants (17 patients and 20 controls). Global MW velocities were significantly higher in AMI patients compared to healthy controls (2.1±0.6m/s vs. 1.5±0.2m/s, p&amp;lt;0.001). Territorial values, corresponding to the theoretical perfusion area of the three main coronary arteries, were significantly higher in infarct-related territories in patients when compared to same territories in controls for all coronary territories: Right coronary artery: 1.9±0.7 m/s vs. 1.4±0.3m/s, p&amp;lt;0.05; Circumflex artery: 3.1±1.5m/s vs. 1.7±0.4m/s, p&amp;lt;0.01; and Left anterior descending artery: 1.8±0.5m/s vs. 1.4±0.2m/s, p&amp;lt;0.01. Conclusions Estimation of MW velocities using a novel 3D HFR echocardiography method was feasible in most patients with AMI and all healthy controls. MW velocities were higher in patients compared to healthy controls and infarcted compared to non-infarcted coronary territories. These findings confirm the potential of non-invasive myocardial tissue characterization by MW imaging.Boxplot of MW velocities3D HFR MW visualisation

Early detection of cardiac dysfunction using shear wave imaging: insights into reduced cardiorespiratory fitness in childhood cancer survivors

Abstract Background Diastolic dysfunction is thought to be the earliest cardiotoxic sequel after cancer therapy among childhood cancer survivors. Despite many survivors do exhibit reduced cardiorespiratory fitness (CRF) potentially due to cardiotoxicity, current echocardiographic parameters fail to detect hidden diastolic dysfunction early after therapy (1). High frame rate (HFR) shear wave imaging (SWI) is a novel tool that could give insights about myocardial stiffness, which is a key determining factor of diastolic function. Purpose We aimed at testing the ability of SWI to detect early alterations in myocardial stiffness among childhood cancer survivors and its relation with the reduced CRF. Methods Fifty childhood cancer survivors (mean 20 ±3 years) who received chemo-and/or- radiotherapy (mean time after treatment: 4 ±3 years) and thirty-two matched healthy volunteers (HV) were recruited. Conventional as well as HFR echocardiographic images (ca. 1200 frames/second) were acquired at rest using a modified commercial echocardiography machine. All participants underwent an incremental, symptom-limited cardiopulmonary exercise test on a treadmill measuring peak oxygen consumption (VO2 peak). HFR data were analysed offline. An anatomical M mode was drawn along the ventricular septum, and tissue Doppler acceleration maps were extracted to measure SW velocities after mitral valve closure (MVC) (Figure 1). Results Among cancer survivors, left ventricular ejection fraction (LVEF) and global longitudinal strain were significantly lower compared to HV (56 % ±4 vs 59 % ±4, and 17.6 % ±1.6 vs 19.1 % ±1.2, respectively; p &amp;lt;0.001). However, both LVEF and GLS were within the normal range and none of them correlated with the peak VO2 (Figure 2A&amp;B). None of the echocardiographic diastolic parameters (e.g. mitral E, E/e’, left atrial volume or TR jet velocity) showed significant difference between both groups (P &amp;gt; 0.05). The mean SW velocities were significantly higher in cancer survivors compared to HV (3.9 ±0.6 m/s vs 3.2 ±0.3 m/s respectively; p &amp;lt;0.001). Interestingly, SW velocities among cancer survivors showed moderate significant negative correlation with the VO2 peak (r= -0.590, p &amp;lt;0.001) indicating increasing myocardial stiffness as the cardiorespiratory fitness declined (Figure 2C). Conclusions Our data indicate that myocardial stiffness in cancer survivors is significantly increased. We hypothesize that this increased stiffness may at least in part explain the significantly reduced cardiorespiratory fitness in this population. Echocardiographic shear wave elastography appears as a promising non-invasive tool for early detection of diastolic dysfunction in follow-up of childhood cancer survivors.Figure 1.Figure 2.

Can examining shear wave elastography predict elevated filling pressures? - A comparative evaluation against the current guideline algorithm

Abstract Background The clinical assessment of left ventricular diastolic function is complex, as there is no single non-invasive parameter that provides a direct measurement of myocardial relaxation, myocardial compliance, or–as a surrogate-LV filling pressure. The estimation of diastolic function involves therefore a combination of various parameters. Shear wave (SW) elastography (SWE) is a novel method based on high frame rate echocardiography. SWs are generated following mechanical excitation of the myocardium, such as after mitral valve closure (MVC), and their propagation velocity is directly linked to myocardial stiffness (MS) and is therefore a potential marker of diastolic function. Purpose The aim of this study was to investigate if the propagation velocities of natural shear waves are related to invasively measured mid-(LVMDP) and end-diastolic LV filling pressures (LVEDP) and, thus, could be used as echocardiographic estimate of left ventricular diastolic function. Methods We prospectively enrolled 95 patients with a wide range of diastolic function, scheduled for heart catheterization so that LVMDP and LVEDP could be invasively measured. Patients with myocardial pathology or dysfunction of the anteroseptal wall, as well as severe aortic stenosis, and a more than moderate mitral regurgitation were excluded. Echocardiography was performed immediately after catheterization. SW elastography in parasternal long axis views of the left ventricle (LV) was performed using an experimental scanner (HD-PULSE) at 1040±200 frames per second. An anatomical M-mode was extracted from the midline of the LV septum and color coded for tissue acceleration. The SW propagation velocity at MVC was measured as slope on the M-mode (A). Standard echocardiographic parameters were obtained with a high-end ultrasound machine (Vivid 95, GE Vingmed Ultrasound). The algorithm for evaluating diastolic dysfunction as recommended by the European Association of Cardiovascular Imaging expert consensus 2021 was applied to categorize LV filling pressure as normal or elevated. Results SW velocities correlated significantly with both, LVMDP (r=0.47; p&amp;lt;0,001) and LVEDP (r=0.71, p&amp;lt;0.001). They could excellently detect elevated LVEDP (AUC=0.95, Sensitivity=0.92, Specificity=0.94) and detected elevated LVMDP with AUC=0.79, Sensitivity=0.87, Specificity= 0.65, similar to the guideline approach (AUC=0.78, Sensitivity=0.62, Specificity=0.94). Conclusions SW velocities, measured by high frame rate echocardiography, show a strong correlation with the end-diastolic and a good correlation with mid-diastolic filling pressures. The method could excellently distinguish normal and elevated LVEDP and could–through a single measurement-differentiate normal and elevated LVMDP as good as the current guideline algorithm with its combination of four parameters in a decision tree. Our data suggest a potential clinical value of the new method for the non-invasive assessment of diastolic function.

Mechanical wave velocities by clutter filter wave imaging detects myocardial dysfunction in acute coronary syndrome

Abstract Background/introduction Mechanical waves within the myocardium arising from physiologic events in the cardiac cycle such as the atrial kick (AK), mitral valve closure (MVC) and aortic valve closure (AVC) offer insight to tissue stiffness and can be measured by high frame rate echocardiography. Purpose To investigate the feasibility of measuring mechanical wave velocities in the left ventricle by clutter filter wave imaging (CFWI) and its potential for detecting regional myocardial dysfunction in patients with acute coronary syndrome. Methods We examined 60 patients (66±9 years of age, 72% male) with acute coronary syndrome by high frame rate echocardiography after revascularisation, imaging the left ventricle from the parasternal long axis view and three apical projections. Intrinsic mechanical waves generated by the AK, MVC and AVC were analysed off-line by CFWI of all walls using custom software (PyMWI) on 2000 frames of in-phase and quadrature component data per view extracted from a Vivid E95 scanner. Results We analysed a total number of 2372 waves recorded with a frame rate of 1180 (1134-1199) frames per second. The feasibility for measuring AK waves was high in all regions (mean 89%), but lower for the MVC and AVC waves with significant variability between regions (mean 44% and 46%, respectively; p&amp;lt;0.001). Feasibility declined from basal to apical segments for all waves (p=0.0001). Mean mechanical wave velocity was slowest for the AK wave at 2.5 (2.0-3.0) m/s, faster for the AVC wave at 5.1 (3.5-6.3) m/s and fastest for the MVC wave at 6.6 (4.9-8.6) m/s (p=0.0001). Basal AK wave velocity was faster in patients with basal wall motion abnormalities compared to those without (2.7 vs. 2.0 m/s, p=0.0004) and could detect the presence of wall motion abnormalities adjusting for age, gender and parameters of diastolic function (univariable OR 3.4, 95% CI 1.5-7.7, p&amp;lt;0.01; multivariable OR 4.4, 95% CI 1.4-14.1, p=0.01). Basal AK wave velocity detected wall motion abnormalities with an AUC of 0.78 with cut-off speeds of 2.3 m/s and 3.0 m/s, both correctly classifying 73% of cases (sensitivity/specificity 81%/68% and 43%/89%, respectively). Mechanical wave velocities of other waves and in other regions were not consistently and only weakly associated with echocardiographic parameters of systolic and diastolic function. Conclusion(s) Mechanical wave velocities by CFWI detects myocardial dysfunction in acute coronary syndrome. Elevated basal AK wave velocity was independently associated with myocardial dysfunction where AK wave velocity ≥2.3 m/s provided a good sensitivity and ≥3.0 m/s a good specificity for detecting regional wall motion abnormalities. The feasibility of measuring the AK wave was good, whereas MVC and AVC waves had lower feasibility and were inadequate for assessment of myocardial function. Feasibility variations between AK and MVC/AVC waves suggest differences in wave propagation dynamics or intrinsic wave properties.Illustration Clutter Filter Wave ImagingRisk of myocardial dysfunction

A Two-Stage Facial Kinematic Control Strategy for Humanoid Robots Based on Keyframe Detection and Keypoint Cubic Spline Interpolation

A plentiful number of facial expressions is the basis of natural human–robot interaction for high-fidelity humanoid robots. The facial expression imitation of humanoid robots involves the transmission of human facial expression data to servos situated within the robot’s head. These data drive the servos to manipulate the skin, thereby enabling the robot to exhibit various facial expressions. However, since the mechanical transmission rate cannot keep up with the data processing rate, humanoid robots often suffer from jitters in the imitation. We conducted a thorough analysis of the transmitted facial expression sequence data and discovered that they are extremely redundant. Therefore, we designed a two-stage strategy for humanoid robots based on facial keyframe detection and facial keypoint detection to achieve more natural and smooth expression imitation. We first built a facial keyframe detection model based on ResNet-50, combined with optical flow estimation, which can identify key expression frames in the sequence. Then, a facial keypoint detection model is used on the keyframes to obtain the facial keypoint coordinates. Based on the coordinates, the cubic spline interpolation method is used to obtain the motion trajectory parameters of the servos, thus realizing the robust control of the humanoid robot’s facial expression. Experiments show that, unlike before where the robot’s imitation would stutter at frame rates above 25 fps, our strategy allows the robot to maintain good facial expression imitation similarity (cosine similarity of 0.7226), even at higher frame rates.

An immersive labeling method for large point clouds

3D point clouds, such as those produced by 3D scanners, often require labeling – the accurate classification of each point into structural or semantic categories – before they can be used in their intended application. However, in the absence of fully automated methods, such labeling must be performed manually, which can prove extremely time and labor intensive. To address this we present a virtual reality tool for accelerating and improving the manual labeling of very large 3D point clouds. The labeling tool provides a variety of 3D interactions for efficient viewing, selection and labeling of points using the controllers of consumer VR-kits. The main contribution of our work is a mixed CPU/GPU-based data structure that supports rendering, selection and labeling with immediate visual feedback at high frame rates necessary for a convenient VR experience. Our mixed CPU/GPU data structure supports fluid interaction with very large point clouds in VR, what is not possible with existing continuous level-of-detail rendering algorithms. We evaluate our method with 25 users on tasks involving point clouds of up to 50 million points and find convincing results that support the case for VR-based point cloud labeling.

A heterogeneous ultrasound open scanner for the real-time implementation of computationally demanding imaging methods.

Ultrasound open scanners have recently boosted the development and validation of novel imaging techniques. They are usually split into hardware- or software-oriented systems, depending on whether they process the echo data using embedded FPGAs/DSPs or a GPU on a host PC. The goal of this work was to realize a high-performance heterogeneous open scanner capable of leveraging the strengths of both hardware and software-oriented systems. The elaboration power of the 256-channel ultrasound advanced open platform (ULA-OP 256) was further enhanced by embedding a compact co-processing GPU system-on-module (SoM). By carefully avoiding latencies and overheads through low-level optimization work, an efficient PCIe communication interface was established between the GPU and the processing devices onboard the ULA-OP 256. As a proof of concept of the enhanced system, the high frame rate color flow mapping technique was implemented on the GPU SoM and tested. Compared to a previous DSP-based implementation, higher real-time frame rates were achieved together with unprecedented flexibility in setting crucial parameters such as the ensemble length (EL). For example, by setting EL=64 and a continuous-time high-pass filter, the flow was investigated with high temporal and spatial resolution in the femoral vein bifurcation (frame rate = 1.1 kHz) and carotid artery bulb (4.3 kHz), highlighting the flow disturbances due to valve aperture and secondary velocity components, respectively. The results of this work promote the development of other computational-expensive processing algorithms in real-time and may inspire the next generation of ultrasound high-performance heterogeneous scanners.

Non-contact measurement of structural dynamic displacement based on improved edge detection and video interpolation

In structural health monitoring (SHM), smartphones are increasingly used for non-contact dynamic displacement measurement using computer vision. To overcome limitations in capturing high-frame-rate data, a non-contact measurement method of structural dynamic displacement based on an improved edge detection algorithm and video frame interpolation is proposed. Initially, a smartphone is employed to capture the structure’s vibration video and then generates intermediary frames between adjacent frames that match the structure’s motion state by using a video frame interpolation algorithm to obtain a video with a high frame rate. Subsequently, the improved edge detection algorithm is applied to measure the displacement within the interpolated video. In order to address the problem that traditional edge detection may have false edges leading to the degradation of measurement accuracy, a feature point tracking technique is proposed based on the traditional edge detection technique, which effectively excludes the interference of false edges in ROI and improves the accuracy of displacement monitoring. Experimental validation on a cantilever beam and steel frame bridge demonstrates the method’s viability and precision, highlighting its effectiveness in improving displacement measurement accuracy compared to traditional methods.

An 11-bit two-step column-shared ADC based on Flash/SS architecture for CMOS image sensor

Traditional single-slope analog-to-digital converter (SS ADC) faces a speed limitation that constrains the exposure speed of CMOS image sensors (CIS). To enhance the conversion speed of SS ADCs used in high frame rate CIS, a two-step column-shared ADC based on Flash/SS architecture is proposed. The ADC design approach is based on the concepts of time compression and multi-column sharing. On one hand, a Flash ADC and differential ramps are introduced while two comparators are multiplexed to enhance the conversion speed. On the other hand, a multi-column shared design is employed in some circuits to reduce the average area and power consumption per column. Under a design environment of 256 × 256 pixel resolution, the simulation results show that the row time of ADC is 5.4μs, the column-level average power consumption is 129.5 μW, and the FoMa is 527 fJ/step. Compared to the conventional 11-bit two-step SS ADC, the proposed ADC not only optimizes quantization speed but also simplifies the redundant calibration structure.

A Generative Adversarial Network for Upsampling of Direct Volume Rendering Images

AbstractDirect volume rendering (DVR) is an important tool for scientific and medical imaging visualization. Modern GPU acceleration has made DVR more accessible; however, the production of high‐quality rendered images with high frame rates is computationally expensive. We propose a deep learning method with a reduced computational demand. We leveraged a conditional generative adversarial network (cGAN) to upsample DVR images (a rendered scene), with a reduced sampling rate to obtain similar visual quality to that of a fully sampled method. Our dvrGAN is combined with a colour‐based loss function that is optimized for DVR images where different structures such as skin, bone, etc. are distinguished by assigning them distinct colours. The loss function highlights the structural differences between images, by examining pixel‐level colour, and thus helps identify, for instance, small bones in the limbs that may not be evident with reduced sampling rates. We evaluated our method in DVR of human computed tomography (CT) and CT angiography (CTA) volumes. Our method retained image quality and reduced computation time when compared to fully sampled methods and outperformed existing state‐of‐the‐art upsampling methods.

The 4D Camera: An 87 kHz Direct Electron Detector for Scanning/Transmission Electron Microscopy.

We describe the development, operation, and application of the 4D Camera-a 576 by 576 pixel active pixel sensor for scanning/transmission electron microscopy which operates at 87,000 Hz. The detector generates data at ∼480 Gbit/s which is captured by dedicated receiver computers with a parallelized software infrastructure that has been implemented to process the resulting 10-700 Gigabyte-sized raw datasets. The back illuminated detector provides the ability to detect single electron events at accelerating voltages from 30 to 300 kV. Through electron counting, the resulting sparse data sets are reduced in size by 10--300× compared to the raw data, and open-source sparsity-based processing algorithms offer rapid data analysis. The high frame rate allows for large and complex scanning diffraction experiments to be accomplished with typical scanning transmission electron microscopy scanning parameters.

Detection of natural pulse waves (PWs) in 3D using high frame rate imaging for anisotropy characterization

IntroductionNumerous studies have shown that natural mechanical waves have the potential to assess the elastic properties of the myocardium. When the Aortic and Mitral valves close, a shear wave is produced, which provides insights into tissue stiffness. In addition, the Atrial Kick (AK) generates a wave similar to Pulse Waves (PWs) in arteries, providing another way to assess tissue stiffness. However, tissue anisotropy can also impact PW propagation, which is currently underexplored. This study aims to address this gap by investigating the impact of anisotropy on PW propagation in a phantom.MethodsTube phantoms were created using Polyvinyl Alcohol (PVA). Anisotropy was induced between two sets of two freeze-thaw cycles by stretching and twisting the material. The study first tests and validates the procedure of making helical anisotropic vessel phantoms using the shear wave imaging technique (by estimating the shear wave speed at different probe angles). Using plane wave ultrasound tomography synchronized with a peristaltic pump, 3D high frame rate imaging is performed and used to detect the 3D propagation pattern of PW for each manufactured vessel phantom. Finally, the study attempts to extract the anisotropic coefficient of the vessel using pulse wave propagation angle.ResultsThe Shear wave imaging results obtained for the isotropic vessel show very similar values for each probe angle. On the contrary, the results obtained for the axial anisotropy vessel show a region with a higher shear wave speed at about 0°, corresponding to the long axis of the vessel. Finally, the results obtained for the helical anisotropy depicted increasing shear wave velocity value from −20° to 20°. For the axial phantom, the wavefront of the pulse wave is perpendicular to the long axis of the vessel, while oriented for the helical anisotropic vessels phantom. The pulse wave propagation angle increased with the number of twists made during the vessel manufacturing.DiscussionThe results show that anisotropy can be induced in PVA vessel phantoms by stretching and twisting the material in freeze-thaw cycles. The findings also suggest that vessel anisotropy affects pulse wave propagation angles. Estimating the pulse wave propagation angle may be interesting in characterizing tissue anisotropy in organs where such waves are naturally present.

Microbubble tracking based on partial smoothing-based adaptive generalized labelled Multi-Bernoulli filter for super-resolution imaging

Super-resolution ultrasound (SRUS) can image the vasculature at microscopic resolution according to microbubble (MB) localization, with velocity vector maps obtained based on MB tracking information. High MB concentrations can reduce the acquisition time of SRUS imaging, however adjacent and intersecting vessels are difficult to distinguish, thus decreasing resolution. Low acquisition frame rates affect the precision of flow velocity estimation. This study proposes a partial smoothing-based adaptive generalized labeled multi-Bernoulli filter (SAGLMB) to precisely track the MB motion at different flow velocities. SAGLMB employs a generalized labelled multi-Bernoulli filter (GLMB) for MB trajectory allocation to separate adjacent and intersecting vessels. Furthermore, the nonlinear motion of MB was predicted by an unscented Kalman filter, and a cardinalized probability hypothesis density filter was applied to suppress clutter interference. Finally, the trajectories were smoothed by unscented Rauch-Tung-Striebel to improve the resolution of the SRUS image. The simulation results demonstrate that SAGLMB outperforms the conventional bipartite graph-based tracking at high MB concentrations, achieving at least an 8.55 % improvement in the correctly paired precision, with 3 times increase in the structural similarity index measure. Moreover, SAGLMB can obtain more precise flow velocity estimations with a 4 times improvement than the conventional method. The SRUS results of rabbit kidney show that the proposed method significantly improves resolution of adjacent and intersecting vessels at higher MB concentrations and maintains this performance as the acquisition frame rate decreases. Furthermore, the rat brain microvascular network was reconstructed with 9.21 μm (λ/11.1) resolution. Therefore, SAGLMB can achieve robust SRUS imaging at high concentrations and low acquisition frame rates.