Abstract
A custom convolutional neural network (CNN) integrated with convolutional long short-term memory (LSTM) achieves accurate 3D (2D + time) segmentation in cross-sectional videos of the Drosophila heart acquired by an optical coherence microscopy (OCM) system. While our previous FlyNet 1.0 model utilized regular CNNs to extract 2D spatial information from individual video frames, convolutional LSTM, FlyNet 2.0, utilizes both spatial and temporal information to improve segmentation performance further. To train and test FlyNet 2.0, we used 100 datasets including 500,000 fly heart OCM images. OCM videos in three developmental stages and two heartbeat situations were segmented achieving an intersection over union (IOU) accuracy of 92%. This increased segmentation accuracy allows morphological and dynamic cardiac parameters to be better quantified.
Highlights
Drosophila melanogaster, widely known as the fruit fly, shows many similarities with vertebrates in the early stages of heart development [1]
Employing the convolutional long short-term memory (LSTM) network found correlations between single fly heart Optical coherence microscopy (OCM) images separated by many frames, and these correlations can help us extract time-dependent information features of the fly heartbeat. With this well-trained FlyNet 2.0, we examined fly heart OCM videos taken in three developmental stages and two heartbeat situations
With reference to the intersection over union (IOU) test, the segmentation accuracy of FlyNet 2.0 was 92% which improved over the 86% value of the FlyNet 1.0
Summary
Drosophila melanogaster, widely known as the fruit fly, shows many similarities with vertebrates in the early stages of heart development [1]. As a powerful genetic model, Drosophila has been used to investigate heart development and cardiac diseases [5,6,7,8,9]. The penetration image depth of an OCM system is around 500 μm, deep enough to image a fruit fly heart, which is around 200 μm below the surface of the fly’s cuticle. Due to the large data size of the Drosophila cardiac OCM recording, a robust and fast method to segment the fruit fly heart is needed
Sign-in/Register to view highlights & summary Sign-in/Register to access full text options 
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a callDisclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.
