Time-domain Fluorescence Lifetime Imaging Microscopy Research Articles

Emission Properties of Individual AIE‐Luminogens in Solution at Room Temperature†

Comprehensive SummaryHere, we combined the photon antibunching analysis, fluorescence correlation spectroscopy, and time‐domain fluorescence lifetime imaging microscopy (TD‐FLIM) to study the emission properties of a representative AIE‐luminogen—4,4’‐(benzo[c][1,2,5] thiadiazole‐4,7‐diyl)bis(N,N‐diphenylaniline) (TPA‐BT) at the single emitter level in a tetrahydrofuran (THF)/water solution where water is a non‐solvent for TPA‐BT. Our findings suggest that, at a constant water fraction in the solution, the size of TPA‐BT aggregates increases with the TPA‐BT concentration; TPA‐BT aggregates are not a quantum emitter at room temperature in the solution. Moreover, utilizing TD‐FLIM and a gel trapping technique allowed us to study the fluorescence lifetime of individual TPA‐BT aggregates. Adding a polar solvent like water does not result in an overall decrease in fluorescence lifetime. Rather, it causes the fluorescence lifetime distribution to become wider, and only some molecules experience a decrease in their fluorescence lifetime. These results could represent a step forward in further understanding the photophysics of AIE‐luminogens.

Use of nanosecond excitation pulses in fluorescence lifetime measurement via phasor analysis.

We investigated the possibility of using long excitation pulses in fluorescence lifetime imaging microscopy (FLIM) using phasor analysis. It has long been believed that the pulse width of an excitation laser must be shorter than the lifetime of a fluorophore in a time-domain FLIM system. Even though phasor analysis can effectively minimize the pulse effect by using deconvolution, the precision of a measured lifetime can be degraded seriously. Here, we provide a fundamental theory on pulse-width-dependent measurement precisions in lifetime measurement in the phasor plane. Our theory predicts that high-precision lifetimes can be obtained even with a laser whose pulse width is four times larger than the lifetime of a fluorophore. We have experimentally demonstrated this by measuring the lifetimes of fluorescence probes with 2.57 ns and 3.75 ns lifetimes by using various pulse widths (0.52-38 ns) and modulation frequencies (10-200 MHz). We believe our results open a new possibility of using long pulse-width lasers for high-precision FLIM.

Simple phasor-based deep neural network for fluorescence lifetime imaging microscopy

Fluorescence lifetime imaging microscopy (FLIM) is a powerful technique to probe the molecular environment of fluorophores. The analysis of FLIM images is usually performed with time consuming fitting methods. For accelerating this analysis, sophisticated deep learning architectures based on convolutional neural networks have been developed for restrained lifetime ranges but they require long training time. In this work, we present a simple neural network formed only with fully connected layers able to analyze fluorescence lifetime images. It is based on the reduction of high dimensional fluorescence intensity temporal decays into four parameters which are the phasor coordinates, the mean and amplitude-weighted lifetimes. This network called Phasor-Net has been applied for a time domain FLIM system excited with an 80 MHz laser repetition frequency, with negligible jitter and afterpulsing. Due to the restricted time interval of 12.5 ns, the training range of the lifetimes was limited between 0.2 and 3.0 ns; and the total photon number was lower than 106, as encountered in live cell imaging. From simulated biexponential decays, we demonstrate that Phasor-Net is more precise and less biased than standard fitting methods. We demonstrate also that this simple architecture gives almost comparable performance than those obtained from more sophisticated networks but with a faster training process (15 min instead of 30 min). We finally apply successfully our method to determine biexponential decays parameters for FLIM experiments in living cells expressing EGFP linked to mCherry and fused to a plasma membrane protein.

Single-photon peak event detection (SPEED): a computational method for fast photon counting in fluorescence lifetime imaging microscopy.

Fluorescence lifetime imaging microscopy (FLIM) characterizes samples by examining the temporal properties of fluorescence emission, providing useful contrast within samples based on the local physical and biochemical environment of fluorophores. Despite this, FLIM applications have been limited in scope by either poor accuracy or long acquisition times. Here, we present a method for computational single-photon counting of directly sampled time-domain FLIM data that is capable of accurate fluorescence lifetime and intensity measurements while acquiring over 160 Mega-counts-per-second with sub-nanosecond time resolution between consecutive photon counts. We demonstrate that our novel method of Single-photon PEak Event Detection (SPEED) is more accurate than direct pulse sampling and faster than established photon counting FLIM methods. We further show that SPEED can be implemented for imaging and quantifying samples that benefit from higher -throughput and -dynamic range imaging with real-time GPU-accelerated processing and use this capability to examine the NAD(P)H-related metabolic dynamics of apoptosis in human breast cancer cells. Computational methods for photon counting such as SPEED open up more opportunities for fast and accurate FLIM imaging and additionally provide a basis for future innovation into alternative FLIM techniques.

Real-time pixelwise phasor analysis for video-rate two-photon fluorescence lifetime imaging microscopy.

Two-photon fluorescence lifetime imaging microscopy (FLIM) is a widely used technique in biomedical optical imaging. Presently, many two-photon time-domain FLIM setups are limited by long acquisition and postprocessing times that decrease data throughput and inhibit the ability to image fast sub-second processes. Here, we present a versatile two-photon FLIM setup capable of video-rate (up to 25 fps) imaging with graphics processing unit (GPU)-accelerated pixelwise phasor analysis displayed and saved simultaneously with acquisition. The system uses an analog output photomultiplier tube in conjunction with 12-bit digitization at 3.2 GHz to overcome the limited maximum acceptable photon rate associated with the photon counting electronics in many FLIM systems. This allows for higher throughput FLIM acquisition and analysis, and additionally enables the user to assess sample fluorescence lifetime in real-time. We further explore the capabilities of the system to examine the kinetics of Rhodamine B uptake by human breast cancer cells and characterize the effect of pixel dwell time on the reduced nicotinamide adenine dinucleotide and reduced nicotinamide adenine dinucleotide phosphate (NAD(P)H) autofluorescence lifetime estimation accuracy.

Fluorescence Lifetime Imaging Microscopy Maps Fluorophore Concentrations, a Gaussian Process Approach

Fluorescence microscopy techniques have made many contributions to unravel rules of biological processes in the past few decades. These procedures make use of different properties, such as life-time, emission spectrum and intensity of fluorophores to learn about sub-cellular environments. In particular, fluorescence lifetime imaging microscopy (FLIM) makes use of lifetimes of fluorescent dyes to map sub-cellular environment variations, such as temperature, pH, molecule concentrations, and protein-protein interactions. In FLIM, the number of photons collected by the detector depends on the lifetimes and concentrations of the fluorescent dyes present in the sample. Therefore, FLIM equips us with a powerful tool to learn the fluorophore concentrations with high spatial resolution. FLIM analysis can be performed in either time or frequency domain. In time domain, photon arrival times are fitted to a mixture of decay profiles, which are convolutions of exponential components and the instrument response function. The current time domain approaches group the input data into multiple bins which leads to loss of information. Moreover, these techniques report sub-cellular heterogeneity with a resolution limited to the pixel size. We developed a time domain FLIM data analysis technique in a Bayesian paradigm that uses Gaussian processes to map the fluorophore concentrations with sub-pixel resolution. This method efficiently uses all the available photon arrival time information and, as such, requires a minimum number of photons to infer accurate fluorophore concentrations. The approach was validated using both empirical and simulated data.

Nonparametric empirical Bayesian framework for fluorescence-lifetime imaging microscopy.

Fluorescence lifetime imaging microscopy (FLIM) is a powerful imaging tool used to study the molecular environment of flurophores. In time domain FLIM, extracting lifetime from fluorophores signals entails fitting data to a decaying exponential distribution function. However, most existing techniques for this purpose need large amounts of photons at each pixel and a long computation time, thus making it difficult to obtain reliable inference in applications requiring either short acquisition or minimal computation time. In this work, we introduce a new nonparametric empirical Bayesian framework for FLIM data analysis (NEB-FLIM), leading to both improved pixel-wise lifetime estimation and a more robust and computationally efficient integral property inference. This framework is developed based on a newly proposed hierarchical statistical model for FLIM data and adopts a novel nonparametric maximum likelihood estimator to estimate the prior distribution. To demonstrate the merit of the proposed framework, we applied it on both simulated and real biological datasets and compared it with previous classical methods on these datasets.

Fast single-cell biochemistry: theory, open source microscopy and applications

Fluorescence lifetime sensing enables researchers to probe the physicochemical environment of a fluorophore providing a window through which we can observe the complex molecular make-up of the cell. Fluorescence lifetime imaging microscopy (FLIM) quantifies and maps cell biochemistry, a complex ensemble of dynamic processes. Unfortunately, typical high-resolution FLIM systems exhibit rather limited acquisition speeds, often insufficient to capture the time evolution of biochemical processes in living cells. Here, we describe the theoretical background that justifies the developments of high-speed single photon counting systems. We show that systems with low dead-times not only result in faster acquisition throughputs but also improved dynamic range and spatial resolution. We also share the implementation of hardware and software as an open platform, show applications of fast FLIM biochemical imaging on living cells and discuss strategies to balance precision and accuracy in FLIM. The recent innovations and commercialisation of fast time-domain FLIM systems are likely to popularise FLIM within the biomedical community, to impact biomedical research positively and to foster the adoption of other FLIM techniques as well. While supporting and indeed pursuing these developments, with this work we also aim to warn the community about the possible shortcomings of fast single photon counting techniques and to highlight strategies to acquire data of high quality.

Application of fluorescence lifetime imaging microscopy of DNA binding dyes to assess radiation-induced chromatin compaction changes.

In recent years several approaches have been developed to address the chromatin status and its changes in eukaryotic cells under different conditions—but only few are applicable in living cells. Fluorescence lifetime imaging microscopy (FLIM) is a functional tool that can be used for the inspection of the molecular environment of fluorophores in living cells. Here, we present the use of single organic minor groove DNA binder dyes in FLIM for measuring chromatin changes following modulation of chromatin structure in living cells. Treatment with histone deacetylase inhibitors led to an increased fluorescence lifetime indicating global chromatin decompaction, whereas hyperosmolarity decreased the lifetime of the used dyes, thus reflecting the expected compaction. In addition, we demonstrate that time domain FLIM data based on single photon counting should be optimized using pile-up and counting loss correction, which affect the readout even at moderate average detector count rates in inhomogeneous samples. Using these corrections and utilizing Hoechst 34580 as chromatin compaction probe, we measured a pan nuclear increase in the lifetime following irradiation with X-rays in living NIH/3T3 cells thus providing a method to measure radiation-induced chromatin decompaction.

Selective plane illumination microscopy (SPIM) with time-domain fluorescence lifetime imaging microscopy (FLIM) for volumetric measurement of cleared mouse brain samples.

We have developed an imaging technique which combines selective plane illumination microscopy with time-domain fluorescence lifetime imaging microscopy (SPIM-FLIM) for three-dimensional volumetric imaging of cleared mouse brains with micro- to mesoscopic resolution. The main features of the microscope include a wavelength-adjustable pulsed laser source (Ti:sapphire) (near-infrared) laser, a BiBO frequency-doubling photonic crystal, a liquid chamber, an electrically focus-tunable lens, a cuvette based sample holder, and an air (dry) objective lens. The performance of the system was evaluated with a lifetime reference dye and micro-bead phantom measurements. Intensity and lifetime maps of three-dimensional human embryonic kidney (HEK) cell culture samples and cleared mouse brain samples expressing green fluorescent protein (GFP) (donor only) and green and red fluorescent protein [positive Förster (fluorescence) resonance energy transfer] were acquired. The results show that the SPIM-FLIM system can be used for sample sizes ranging from single cells to whole mouse organs and can serve as a powerful tool for medical and biological research.

Estimating fluorescence lifetimes using extended Kalman filter

The extended Kalman filter (EKF) has been widely used in communication, signal processing and navigation control. In this Letter, the authors applied EKF, for the first time to their knowledge, to simultaneously estimate fluorescence lifetimes and instrument response functions (IRF) for time-domain fluorescence lifetime imaging microscopy (FLIM) systems (we focus on gating and time-correlated single-photon counting techniques in this work). Monte-Carlo simulations were performed to test its performances in comparison with previously reported methods. Simulation results show that the proposed algorithm can achieve comparable or better results than the others. More importantly, with EKF there is no need to measure the IRF of the FLIM system.

Multimodal optical coherence tomography and fluorescence lifetime imaging with interleaved excitation sources for simultaneous endogenous and exogenous fluorescence.

Multimodal imaging probes a variety of tissue properties in a single image acquisition by merging complimentary imaging technologies. Exploiting synergies amongst the data, algorithms can be developed that lead to better tissue characterization than could be accomplished by the constituent imaging modalities taken alone. The combination of optical coherence tomography (OCT) with fluorescence lifetime imaging microscopy (FLIM) provides access to detailed tissue morphology and local biochemistry. The optical system described here merges 1310 nm swept-source OCT with time-domain FLIM having excitation at 355 and 532 nm. The pulses from 355 and 532 nm lasers have been interleaved to enable simultaneous acquisition of endogenous and exogenous fluorescence signals, respectively. The multimodal imaging system was validated using tissue phantoms. Nonspecific tagging with Alexa Flour 532 in a Watanbe rabbit aorta and active tagging of the LOX-1 receptor in human coronary artery, demonstrate the capacity of the system for simultaneous acquisition of OCT, endogenous FLIM, and exogenous FLIM in tissues.

GPU acceleration of time-domain fluorescence lifetime imaging.

Fluorescence lifetime imaging microscopy (FLIM) plays a significant role in biological sciences, chemistry, and medical research. We propose a Graphic Processing Units (GPUs) based FLIM analysis tool suitable for high-speed and flexible time-domain FLIM applications. With a large number of parallel processors, GPUs can significantly speed up lifetime calculations compared to CPU - OpenMP (parallel computing with multiple CPU cores) based analysis. We demonstrate how to implement and optimize FLIM algorith ms on GPUs for both iterative and non-iterative FLIM analysis algorithms. The implemented algorithms have been tested on both synthesized and experimental FLIM data. The results show that at the same precision the GPU analysis can be up to 24-fold faster than its CPU - OpenMP counterpart. This means that even for high precision but time-consuming iterative FLIM algorithms, GPUs enable fast or even real-time analysis.

Time-Domain Fluorescence Lifetime Imaging Microscopy: A Quantitative Method to Follow Transient Protein–Protein Interactions in Living Cells

Quantitative analysis in Förster resonance energy transfer (FRET) imaging studies of protein-protein interactions within live cells is still a challenging issue. Many cellular biology applications aim at the determination of the space and time variations of the relative amount of interacting fluorescently tagged proteins occurring in cells. This relevant quantitative parameter can be, at least partially, obtained at a pixel-level resolution by using fluorescence lifetime imaging microscopy (FLIM). Indeed, fluorescence decay analysis of a two-component system (FRET and no FRET donor species), leads to the intrinsic FRET efficiency value (E) and the fraction of the donor-tagged protein that undergoes FRET (fD). To simultaneously obtain fD and E values from a two-exponential fit, data must be acquired with a high number of photons, so that the statistics are robust enough to reduce fitting ambiguities. This is a time-consuming procedure. However, when fast-FLIM acquisitions are used to monitor dynamic changes in protein-protein interactions at high spatial and temporal resolutions in living cells, photon statistics and time resolution are limited. In this case, fitting procedures are unreliable, even for single lifetime donors. We introduce the concept of a minimal fraction of donor molecules involved in FRET (mfD), obtained from the mathematical minimization of fD. Here, we discuss different FLIM techniques and the compromises that must be made between precision and time invested in acquiring FLIM measurements. We show that mfD constitutes an interesting quantitative parameter for fast FLIM because it gives quantitative information about transient interactions in live cells.

Application of non-negative matrix factorization to multispectral FLIM data analysis

Existing methods of interpreting fluorescence lifetime imaging microscopy (FLIM) images are based on comparing the intensity and lifetime values at each pixel with those of known fluorophores. This method becomes unwieldy and subjective in many practical applications where there are several fluorescing species contributing to the bulk fluorescence signal, and even more so in the case of multispectral FLIM. Non-negative matrix factorization (NMF) is a multivariate data analysis technique aimed at extracting non-negative signatures of pure components and their non-negative abundances from an additive mixture of those components. In this paper, we present the application of NMF to multispectral time-domain FLIM data to obtain a new set of FLIM features (relative abundance of constituent fluorophores). These features are more intuitive and easier to interpret than the standard fluorescence intensity and lifetime values. The proposed approach, unlike several FLIM data analysis methods, is not limited by the number of constituent fluorescing species or their possibly complex decay dynamics. Moreover, the new set of FLIM features can be obtained by processing raw multispectral FLIM intensity data, thereby rendering time deconvolution unnecessary and resulting in lesser computational time and relaxed SNR requirements. The performance of the NMF method was validated on simulated and experimental multispectral time-domain FLIM data. The NMF features were also compared against the standard intensity and lifetime features, in terms of their ability to discriminate between different types of atherosclerotic plaques.

Non fitting based FRET-FLIM analysis approaches applied to quantify protein-protein interactions in live cells.

New imaging methodologies in quantitative fluorescence microscopy and nanoscopy have been developed in the last few years and are beginning to be extensively applied to biological problems, such as the localization and quantification of protein interactions. Fluorescence resonance energy transfer (FRET) detected by fluorescence lifetime imaging microscopy (FLIM) is currently employed not only in biophysics or chemistry but also in bio-medicine, thanks to new advancements in technology and also new developments in data treatment. FRET-FLIM can be a very useful tool to ascertain protein interactions occurring in single living cells. In this review, we stress the importance of increasing the acquisition speed when working in vivo employing Time-Domain FLIM. The development of the new mathematical-based non-fitting methods allows the determining of the fraction of interacting donor without the requirement of high count statistics, and thus allows the performing of high speed acquisitions in FRET-FLIM to still be quantitative.

Upgrading time domain FLIM using an adaptive Monte Carlo data inflation algorithm

Fluorescence Lifetime Imaging Microscopy (FLIM) is a powerful technique to investigate the local environment of fluorophores in living cells. To correctly estimate all lifetime parameters, time domain FLIM imaging requires a high number of photons and consequently long laser exposure times. This is an issue because long exposure times are incompatible with the observation of dynamic molecular events and induce cellular stress. To minimize exposure time, we have developed an original approach that statistically inflates the number of collected photons. Our approach, called Adaptive Monte Carlo Data Inflation (AMDI), combines the well-known bootstrap technique with an adaptive Parzen kernel. We here demonstrate using both Monte Carlo simulations and live cells that our robust method accurately estimate fluorescence lifetimes with exposure time reduced up to 50 times for monoexponential decays (corresponding to a minimum of 20 photons/pixel), and 10 times for biexponential decays (corresponding to a minimum of 5,000 photons/pixel), compared to standard fitting method. Thanks to AMDI, in Förster resonance energy transfer experiments, it is possible to estimate all fitting parameters accurately without constraining any parameters. By reducing the commonly used spatial binning factor, our technique also improves the spatial resolution of FLIM images.

Precise measurement of protein interacting fractions with fluorescence lifetime imaging microscopy

Precise quantification of endogenous protein-protein interactions across live cells would be a major boon to biology. Such precise measurement is theoretically possible with fluorescence lifetime imaging microscopy (FLIM) but requires first properly addressing multiple biological, instrumental, statistical, and photophysical challenges. We present a detailed investigation of the last three FLIM-specific challenges. Using an efficient, highly accurate analysis code for time-domain FLIM data that accounts for all significant instrumental artifacts (in part, through use of a parametrized model for the instrument response function) and is rigorously based on both conventional statistics (full lifetime histogram fitting by χ(2) minimization) and novel statistics (single pixel fitting of lifetime populations using "maximum fidelity"), we address multiple photophysical challenges, including the proper side-by-side statistical comparison of fluorophore monoexponentiality, the precise assessment of fluorophore lifetimes and lifetime photostability, and the determination of acceptor dark state fractions. Finally, we demonstrate the feasibility of precise measurement of the interacting fraction of a protein across live cells with FLIM.

Quantitative comparison of polar approach versus fitting method in time domain FLIM image analysis

We calculate here analytically the performance of the polar approach (or phasor) in terms of signal-to-noise ratio and F values when performing time-domain Fluorescence Lifetime Imaging Microscopy (FLIM) to determine the minimal number of photons necessary for FLIM measurements (which is directly related to the F value), and compare them to those obtained from a well-known fitting strategy using the Least Square Method (LSM). The importance of the fluorescence background on the lifetime measurement precision is also investigated. We demonstrate here that the LSM does not provide the best estimator of the lifetime parameter for fluorophores exhibiting mono-exponential intensity decays as soon as fluorescence background is superior to 5%. The polar approach enables indeed to determine more precisely the lifetime values for a limited range corresponding to usually encountered fluorescence lifetime values. These theoretical results are corroborated with Monte Carlo simulations. We finally demonstrate experimentally that the polar approach allows distinguishing in living cells two fluorophores undetectable with usual time-domain LSM fitting software.

Loose interaction between glyceraldehyde-3-phosphate dehydrogenase and phosphoglycerate kinase revealed by fluorescence resonance energy transfer-fluorescence lifetime imaging microscopy in living cells

Loose interaction between the glycolytic enzymes glyceraldehyde-3-phosphate dehydrogenase (GAPDH) and phosphoglycerate kinase (PGK) was visualized in living CHO-K1 cells by fluorescence resonance energy transfer (FRET), using time-domain fluorescence lifetime imaging microscopy. FRET between active tetrameric subunits of GAPDH linked to cerulean or citrine was observed, and this FRET signal was significantly attenuated by coexpression of PGK. Also, direct interaction between GAPDH-citrine and PGK-cerulean was observed by FRET. The strength of FRET signals between them was dependent on linkers that connect GAPDH to citrine and PGK to cerulean. A coimmunoprecipitation assay using hemagglutinin-tagged GAPDH and FLAG-tagged PGK coexpressed in CHO-K1 cells supported the FRET observation. Taken together, these results demonstrate that a complex of GAPDH and PGK is formed in the cytoplasm of living cells.