Bioimage Data Research Articles

Setting up an institutional OMERO environment for bioimage data: Perspectives from both facility staff and users.

Modern bioimaging core facilities at research institutions are essential for managing and maintaining high-end instruments, providing training and support for researchers in experimental design, image acquisition and data analysis. An important task for these facilities is the professional management of complex multidimensional bioimaging data, which are often produced in large quantity and very different file formats. This article details the process that led to successfully implementing the OME Remote Objects system (OMERO) for bioimage-specific research data management (RDM) at the Core Facility Cellular Imaging (CFCI) at the Technische Universität Dresden (TU Dresden). Ensuring compliance with the FAIR (findable, accessible, interoperable, reusable) principles, we outline here the challenges that we faced in adapting data handling and storage to a new RDM system. These challenges included the introduction of a standardised group-specific naming convention, metadata curation with tagging and Key-Value pairs, and integration of existing image processing workflows. By sharing our experiences, this article aims to provide insights and recommendations for both individual researchers and educational institutions intending to implement OMERO as a management system for bioimaging data. We showcase how tailored decisions and structured approaches lead to successful outcomes in RDM practices.

A practical guide to bioimaging research data management in core facilities.

Bioimage data are generated in diverse research fields throughout the life and biomedical sciences. Its potential for advancing scientific progress via modern, data-driven discovery approaches reaches beyond disciplinary borders. To fully exploit this potential, it is necessary to make bioimaging data, in general, multidimensional microscopy images and image series, FAIR, that is, findable, accessible, interoperable and reusable. These FAIR principles for research data management are now widely accepted in the scientific community and have been adopted by funding agencies, policymakers and publishers. To remain competitive and at the forefront of research, implementing the FAIR principles into daily routines is an essential but challenging task for researchers and research infrastructures. Imaging core facilities, well-established providers of access to imaging equipment and expertise, are in an excellent position to lead this transformation in bioimaging research data management. They are positioned at the intersection of research groups, IT infrastructure providers, the institution´s administration, and microscope vendors. In the frame of German BioImaging - Society for Microscopy and Image Analysis (GerBI-GMB), cross-institutional working groups and third-party funded projects were initiated in recent years to advance the bioimaging community's capability and capacity for FAIR bioimage data management. Here, we provide an imaging-core-facility-centric perspective outlining the experience and current strategies in Germany to facilitate the practical adoption of the FAIR principles closely aligned with the international bioimaging community. We highlight which tools and services are ready to be implemented and what the future directions for FAIR bioimage data have to offer.

Segmentation and Tracking of Mammary Epithelial Organoids in Brightfield Microscopy.

We present an automated and deep-learning-based workflow to quantitatively analyze the spatiotemporal development of mammary epithelial organoids in two-dimensional time-lapse (2D+t) sequences acquired using a brightfield microscope at high resolution. It involves a convolutional neural network (U-Net), purposely trained using computer-generated bioimage data created by a conditional generative adversarial network (pix2pixHD), to infer semantic segmentation, adaptive morphological filtering to identify organoid instances, and a shape-similarity-constrained, instance-segmentation-correcting tracking procedure to reliably cherry-pick the organoid instances of interest in time. By validating it using real 2D+t sequences of mouse mammary epithelial organoids of morphologically different phenotypes, we clearly demonstrate that the workflow achieves reliable segmentation and tracking performance, providing a reproducible and laborless alternative to manual analyses of the acquired bioimage data.

Incorporating A.I. [Artificial Intelligence] into Boar Semen A.I. [Artificial Insemination

Analysis of the U.S swine herd shows variation in pregnancy rate is more attributable to male- factor subfertility than the dam. To date, a limited degree of correlations has been observed between conventional semen analysis parameters and actual fertility after standard quality cutoffs are met. Thus, a clear ability to predict male-factor fertility is lacking. Recent technological advances in flow cytometry, namely image-based flow cytometry, allows for high-throughput, single-cell phenotyping. This allows for multi-million sperm bioimage data sets to be easily attained. These datasets can then be analyzed utilizing machine & deep learning analytic methods and correlated with single sire field fertility data to open the black box of boar fertility prediction. In this presentation, we will discuss recent advancements our lab has made utilizing machine & deep learning, artificial intelligence into boar sperm quality analysis. This includes bioimage, deep learning analysis of boar sperm morphology as well as our latest results related to boar semen fertility prediction. Our findings establish a new era for boar sperm quality analysis and pave the way for accurate fertility prediction in future precision agriculture applications. Work performed here was supported by USDA’s National Institute of Food and Agriculture grant number 2019- 67012-29714 (KK) and 2022-67015-36298 (KK).

Research data management for bioimaging: the 2021 NFDI4BIOIMAGE community survey.

Background: Knowing the needs of the bioimaging community with respect to research data management (RDM) is essential for identifying measures that enable adoption of the FAIR (findable, accessible, interoperable, reusable) principles for microscopy and bioimage analysis data across disciplines. As an initiative within Germany's National Research Data Infrastructure, we conducted this community survey in summer 2021 to assess the state of the art of bioimaging RDM and the community needs. Methods: An online survey was conducted with a mixed question-type design. We created a questionnaire tailored to relevant topics of the bioimaging community, including specific questions on bioimaging methods and bioimage analysis, as well as more general questions on RDM principles and tools. 203 survey entries were included in the analysis covering the perspectives from various life and biomedical science disciplines and from participants at different career levels. Results: The results highlight the importance and value of bioimaging RDM and data sharing. However, the practical implementation of FAIR practices is impeded by technical hurdles, lack of knowledge, and insecurity about the legal aspects of data sharing. The survey participants request metadata guidelines and annotation tools and endorse the usage of image data management platforms. At present, OMERO (Open Microscopy Environment Remote Objects) is the best known and most widely used platform. Most respondents rely on image processing and analysis, which they regard as the most time-consuming step of the bioimage data workflow. While knowledge about and implementation of electronic lab notebooks and data management plans is limited, respondents acknowledge their potential value for data handling and publication. Conclusion: The bioimaging community acknowledges and endorses the value of RDM and data sharing. Still, there is a need for information, guidance, and standardization to foster the adoption of FAIR data handling. This survey may help inspiring targeted measures to close this gap.

The Image Data Explorer: Interactive exploration of image-derived data.

Many bioimage analysis projects produce quantitative descriptors of regions of interest in images. Associating these descriptors with visual characteristics of the objects they describe is a key step in understanding the data at hand. However, as many bioimage data and their analysis workflows are moving to the cloud, addressing interactive data exploration in remote environments has become a pressing issue. To address it, we developed the Image Data Explorer (IDE) as a web application that integrates interactive linked visualization of images and derived data points with exploratory data analysis methods, annotation, classification and feature selection functionalities. The IDE is written in R using the shiny framework. It can be easily deployed on a remote server or on a local computer. The IDE is available at https://git.embl.de/heriche/image-data-explorer and a cloud deployment is accessible at https://shiny-portal.embl.de/shinyapps/app/01_image-data-explorer.

ShapoGraphy: A User-Friendly Web Application for Creating Bespoke and Intuitive Visualisation of Biomedical Data.

Effective visualisation of quantitative microscopy data is crucial for interpreting and discovering new patterns from complex bioimage data. Existing visualisation approaches, such as bar charts, scatter plots and heat maps, do not accommodate the complexity of visual information present in microscopy data. Here we develop ShapoGraphy, a first of its kind method accompanied by an interactive web-based application for creating customisable quantitative pictorial representations to facilitate the understanding and analysis of image datasets (www.shapography.com). ShapoGraphy enables the user to create a structure of interest as a set of shapes. Each shape can encode different variables that are mapped to the shape dimensions, colours, symbols, or outline. We illustrate the utility of ShapoGraphy using various image data, including high dimensional multiplexed data. Our results show that ShapoGraphy allows a better understanding of cellular phenotypes and relationships between variables. In conclusion, ShapoGraphy supports scientific discovery and communication by providing a rich vocabulary to create engaging and intuitive representations of diverse data types.

PScL-DDCFPred: an ensemble deep learning-based approach for characterizing multiclass subcellular localization of human proteins from bioimage data.

Characterization of protein subcellular localization has become an important and long-standing task in bioinformatics and computational biology, which provides valuable information for elucidating various cellular functions of proteins and guiding drug design. Here, we develop a novel bioimage-based computational approach, termed PScL-DDCFPred, to accurately predict protein subcellular localizations in human tissues. PScL-DDCFPred first extracts multiview image features, including global and local features, as base or pure features; next, it applies a new integrative feature selection method based on stepwise discriminant analysis and generalized discriminant analysis to identify the optimal feature sets from the extracted pure features; Finally, a classifier based on deep neural network (DNN) and deep-cascade forest (DCF) is established. Stringent 10-fold cross-validation tests on the new protein subcellular localization training dataset, constructed from the human protein atlas databank, illustrates that PScL-DDCFPred achieves a better performance than several existing state-of-the-art methods. Moreover, the independent test set further illustrates the generalization capability and superiority of PScL-DDCFPred over existing predictors. In-depth analysis shows that the excellent performance of PScL-DDCFPred can be attributed to three critical factors, namely the effective combination of the DNN and DCF models, complementarity of global and local features, and use of the optimal feature sets selected by the integrative feature selection algorithm. https://github.com/csbio-njust-edu/PScL-DDCFPred. Supplementary data are available at Bioinformatics online.

Applications of Neural Networks in Biomedical Data Analysis.

Neural networks for deep-learning applications, also called artificial neural networks, are important tools in science and industry. While their widespread use was limited because of inadequate hardware in the past, their popularity increased dramatically starting in the early 2000s when it became possible to train increasingly large and complex networks. Today, deep learning is widely used in biomedicine from image analysis to diagnostics. This also includes special topics, such as forensics. In this review, we discuss the latest networks and how they work, with a focus on the analysis of biomedical data, particularly biomarkers in bioimage data. We provide a summary on numerous technical aspects, such as activation functions and frameworks. We also present a data analysis of publications about neural networks to provide a quantitative insight into the use of network types and the number of journals per year to determine the usage in different scientific fields.

Research data management for bioimaging: the 2021 NFDI4BIOIMAGE community survey.

Background Knowing the needs of the bioimaging community with respect to research data management (RDM) is essential for identifying measures that enable adoption of the FAIR (findable, accessible, interoperable, reusable) principles for microscopy and bioimage analysis data across disciplines. As an initiative within Germany's National Research Data Infrastructure, we conducted this community survey in summer 2021 to assess the state of the art of bioimaging RDM and the community needs. Methods An online survey was conducted with a mixed question-type design. We created a questionnaire tailored to relevant topics of the bioimaging community, including specific questions on bioimaging methods and bioimage analysis, as well as more general questions on RDM principles and tools. 203 survey entries were included in the analysis covering the perspectives from various life and biomedical science disciplines and from participants at different career levels. Results The results highlight the importance and value of bioimaging RDM and data sharing. However, the practical implementation of FAIR practices is impeded by technical hurdles, lack of knowledge, and insecurity about the legal aspects of data sharing. The survey participants request metadata guidelines and annotation tools and endorse the usage of image data management platforms. At present, OMERO (Open Microscopy Environment Remote Objects) is the best known and most widely used platform. Most respondents rely on image processing and analysis, which they regard as the most time-consuming step of the bioimage data workflow. While knowledge about and implementation of electronic lab notebooks and data management plans is limited, respondents acknowledge their potential value for data handling and publication. Conclusions The bioimaging community acknowledges and endorses the value of RDM and data sharing. Still, there is a need for information, guidance, and standardization to foster the adoption of FAIR data handling. This survey may help inspiring targeted measures to close this gap.

A Practical Guide to Supervised Deep Learning for Bioimage Analysis: Challenges and good practices

The variety of bioimage data and their quality have dramatically increased over the last decade. In parallel, the number of proposed deep learning (DL) models for their analysis grows by the day. Yet, the adequate reuse of published tools by practitioners without DL expertise still raises many practical questions. In this article, we explore four categories of challenges faced by researchers when using supervised DL models in bioimaging applications. We provide examples in which each challenge arises and review the consequences that inadequate decisions may have. We then outline good practices that can be implemented to address the challenges of each category in a scientifically sound way. We provide pointers to the resources that are already available or in active development to help in this endeavor and advocate for the development of further community-driven standards. While primarily intended as a practical tutorial for life scientists, this article also aims at fostering discussions among method developers around the formulation of guidelines for the adequate deployment of DL, with the ultimate goal of accelerating the adoption of novel DL technologies in the biology community.

Deep learning for bioimage analysis in developmental biology.

ABSTRACTDeep learning has transformed the way large and complex image datasets can be processed, reshaping what is possible in bioimage analysis. As the complexity and size of bioimage data continues to grow, this new analysis paradigm is becoming increasingly ubiquitous. In this Review, we begin by introducing the concepts needed for beginners to understand deep learning. We then review how deep learning has impacted bioimage analysis and explore the open-source resources available to integrate it into a research project. Finally, we discuss the future of deep learning applied to cell and developmental biology. We analyze how state-of-the-art methodologies have the potential to transform our understanding of biological systems through new image-based analysis and modelling that integrate multimodal inputs in space and time.

TAPAS: Towards Automated Processing and Analysis of multi-dimensional bioimage data

Modern microscopy is based on reproducible quantitative analysis, image data should be batch-processed by a standardized system that can be shared and easily reused by others. Furthermore, such system should require none or minimal programming from the users. We developed TAPAS (Towards an Automated Processing and Analysis System). The goal is to design an easy system for describing and exchanging processing workflows. The protocols are simple text files comprising a linear list of commands used to process and analyse the images. An extensive set of 60 modules is already available, mostly based on the tools proposed in the 3D ImageJ Suite. We propose a wizard, called TAPAS menu, to help the user design the protocol by listing the available modules and the parameters associated. Most modules will have default parameters values for most common tasks. Once the user has designed the protocol, he/she can apply the protocol to a set of images, that can be either stored locally or on a OMERO database. An extensive documentation including the list of modules, various tutorials and link to the source code is available at https://imagej.net/TAPAS.

14 Opening the Black Box of Fertility Prediction

Abstract Analysis of the U.S. swine herd shows variation in pregnancy rate is more attributable to male-factor subfertility than the dam. To date, a limited degree of correlations has been observed between conventional semen analysis parameters and actual fertility after standard quality cutoffs are met. Thus, a clear ability to predict male-factor fertility is lacking. Knowledge of what makes fertilization competent spermatozoa has been long sought after for centuries. It was only in the last half-century that we understood spermatozoa undergo a biological process after ejaculation to acquire the capacity to fertilize. Since then, work has been done to elucidate the molecular pathways involved in sperm capacitation. Recent technological advances in flow cytometry, namely image-based flow cytometry, allows for high-throughput, single-cell phenotyping. Single-cell phenotyping with biomarkers reflecting significant sperm capacitation events, mitochondrial status, cell health, and more, allows multi-million bioimage data sets to be easily attained. These datasets can then be analyzed utilizing machine and deep learning analytic methods and correlated with single sire field fertility data to open the black box of boar fertility prediction. Our findings establish a new paradigm in sperm function and pave the way for accurate fertility prediction in future precision agriculture applications. This work was supported by the National Institute of Food and Agriculture (NIFA), U.S. Department of Agriculture (USDA) award number 2019-67012-29714.

WebTDat: A Web-Based, Real-Time, 3D Visualization Framework for Mesoscopic Whole-Brain Images.

The popularity of mesoscopic whole-brain imaging techniques has increased dramatically, but these techniques generate teravoxel-sized volumetric image data. Visualizing or interacting with these massive data is both necessary and essential in the bioimage analysis pipeline; however, due to their size, researchers have difficulty using typical computers to process them. The existing solutions do not consider applying web visualization and three-dimensional (3D) volume rendering methods simultaneously to reduce the number of data copy operations and provide a better way to visualize 3D structures in bioimage data. Here, we propose webTDat, an open-source, web-based, real-time 3D visualization framework for mesoscopic-scale whole-brain imaging datasets. webTDat uses an advanced rendering visualization method designed with an innovative data storage format and parallel rendering algorithms. webTDat loads the primary information in the image first and then decides whether it needs to load the secondary information in the image. By performing validation on TB-scale whole-brain datasets, webTDat achieves real-time performance during web visualization. The webTDat framework also provides a rich interface for annotation, making it a useful tool for visualizing mesoscopic whole-brain imaging data.

TAPAS: Towards Automated Processing and Analysis of multi-dimensional bioimage data

Modern microscopy is based on reproducible quantitative analysis, image data should be batch-processed by a standardized system that can be shared and easily reused by others. Furthermore, such system should require none or minimal programming from the users. We developed TAPAS (Towards an Automated Processing and Analysis System). The goal is to design an easy system for describing and exchanging processing workflows. The protocols are simple text files comprising a linear list of commands used to process and analyse the images. An extensive set of 60 modules is already available, mostly based on the tools proposed in the 3D ImageJ Suite. We propose a wizard, called TAPAS menu, to help the user design the protocol by listing the available modules and the parameters associated. Most modules will have default parameters values for most common tasks. Once the user has designed the protocol, he/she can apply the protocol to a set of images, that can be either stored locally or on a OMERO database. An extensive documentation including the list of modules, various tutorials and link to the source code is available at https://imagej.net/TAPAS.

TAPAS: Towards Automated Processing and Analysis of multi-dimensional bioimage data.

Modern microscopy is based on reproducible quantitative analysis, image data should be batch-processed by a standardized system that can be shared and easily reused by others. Furthermore such system should require none or minimal programming from the users. We developed TAPAS (Towards an Automated Processing and Analysis System). The goal is to design an easy system for describing and exchanging processing workflows. The protocols are simple text files comprising a linear list of commands used to process and analyse the images. An extensive set of 60 modules is already available, mostly based on the tools proposed in the 3D ImageJ Suite. We propose a wizard, called TAPAS menu, to help the user design her protocol by listing the available modules and the parameters associated. Most modules will have default parameters values for most common tasks. Once the user has designed her protocol, she can apply the protocol to a set of images, that can be either stored locally or on a OMERO database. An extensive documentation including the list of modules, various tutorials and link to the source code is available at https://imagej.net/TAPAS.

Digital Spindle: A New Way to Explore Mitotic Functions by Whole Cell Data Collection and a Computational Approach.

From cells to organisms, every living system is three-dimensional (3D), but the performance of fluorescence microscopy has been largely limited when attempting to obtain an overview of systems’ dynamic processes in three dimensions. Recently, advanced light-sheet illumination technologies, allowing drastic improvement in spatial discrimination, volumetric imaging times, and phototoxicity/photobleaching, have been making live imaging to collect precise and reliable 3D information increasingly feasible. In particular, lattice light-sheet microscopy (LLSM), using an ultrathin light-sheet, enables whole-cell 3D live imaging of cellular processes, including mitosis, at unprecedented spatiotemporal resolution for extended periods of time. This technology produces immense and complex data, including a significant amount of information, raising new challenges for big image data analysis and new possibilities for data utilization. Once the data are digitally archived in a computer, the data can be reused for various purposes by anyone at any time. Such an information science approach has the potential to revolutionize the use of bioimage data, and provides an alternative method for cell biology research in a data-driven manner. In this article, we introduce examples of analyzing digital mitotic spindles and discuss future perspectives in cell biology.

Machine learning metrology of cell confinement in melt electrowritten three-dimensional biomaterial substrates

Tuning cell shape by altering the biophysical properties of biomaterial substrates on which cells operate would provide a potential shape-driven pathway to control cell phenotype. However, there is an unexplored dimensional scale window of three-dimensional (3D) substrates with precisely tunable porous microarchitectures and geometrical feature sizes at the cell’s operating length scales (10–100 μm). This paper demonstrates the fabrication of such high-fidelity fibrous substrates using a melt electrowriting (MEW) technique. This advanced manufacturing approach is biologically qualified with a metrology framework that models and classifies cell confinement states under various substrate dimensionalities and architectures. Using fibroblasts as a model cell system, the mechanosensing response of adherent cells is investigated as a function of variable substrate dimensionality (2D vs. 3D) and porous microarchitecture (randomly oriented, “non-woven” vs. precision-stacked, “woven”). Single-cell confinement states are modeled using confocal fluorescence microscopy in conjunction with an automated single-cell bioimage data analysis workflow that extracts quantitative metrics of the whole cell and sub-cellular focal adhesion protein features measured. The extracted multidimensional dataset is employed to train a machine learning algorithm to classify cell shape phenotypes. The results show that cells assume distinct confinement states that are enforced by the prescribed substrate dimensionalities and porous microarchitectures with the woven MEW substrates promoting the highest cell shape homogeneity compared to non-woven fibrous substrates. The technology platform established here constitutes a significant step towards the development of integrated additive manufacturing—metrology platforms for a wide range of applications including fundamental mechanobiology studies and 3D bioprinting of tissue constructs to yield specific biological designs qualified at the single-cell level.

Image Data Resource: a bioimage data integration and publication platform

This Resource describes the Image Data Resource (IDR), a prototype online system for biological image data that links experimental and analytic data across multiple data sets and promotes image data sharing and reanalysis.