Applications, promises, and pitfalls of deep learning for fluorescence image reconstruction.

Deep learning technologies and applications demonstrate one of the most important upcoming developments in radiology. The impact and influence of these technologies on image acquisition and reporting might change daily clinical practice. The aim of this review was to present current deep learning technologies, with a focus on magnetic resonance image reconstruction. The first part of this manuscript concentrates on the basic technical principles that are necessary for deep learning image reconstruction. The second part highlights the translation of these techniques into clinical practice. The third part outlines the different aspects of image reconstruction techniques, and presents a review of the current literature regarding image reconstruction and image post-processing in MRI. The promising results of the most recent studies indicate that deep learning will be a major player in radiology in the upcoming years. Apart from decision and diagnosis support, the major advantages of deep learning magnetic resonance imaging reconstruction techniques are related to acquisition time reduction and the improvement of image quality. The implementation of these techniques may be the solution for the alleviation of limited scanner availability via workflow acceleration. It can be assumed that this disruptive technology will change daily routines and workflows permanently.

Deep learning is progressively emerging as a vital tool for image reconstruction in light field microscopy. The present review provides a comprehensive examination of the latest advancements in light field image reconstruction techniques based on deep learning algorithms. First, the review briefly introduced the concept of light field and deep learning techniques. Following that, the application of deep learning in light field image reconstruction was discussed. Subsequently, we classified deep learning-based light field microscopy reconstruction algorithms into three types based on the contribution of deep learning, including fully deep learning-based method, deep learning enhanced raw light field image with numerical inversion volumetric reconstruction, and numerical inversion volumetric reconstruction with deep learning enhanced resolution, and comprehensively analyzed the features of each approach. Finally, we discussed several challenges, including deep neural approaches for increasing the accuracy of light field microscopy to predict temporal information, methods for obtaining light field training data, strategies for data enhancement using existing data, and the interpretability of deep neural networks.

The rapid development of Internet technology has made the whole society enter the era of big data. In recent years, the development trend of artificial intelligence and machine learning has also risen sharply. Informatization has become an important feature of the current era. As an indispensable common information carrier, images not only facilitate people’s communication, but also promote the development of deep learning processing image technology. Based on this, this paper analyzes the application of computer deep learning in image processing. Firstly, the deep learning is summarized, its concept and origin are briefly introduced, and then the technical classification, development process and processing purpose of image processing are expounded. Finally, the application of computer deep learning in four aspects is analyzed in detail in image recognition, image denoising, image classification and image enhancement, and it has certain significance for promoting the research and application of deep learning.

In recent years, deep learning technology has made remarkable progress in medical image reconstruction and enhancement, and has become one of the research hotspots in the field of medical image processing. This paper discusses the latest research progress and application of deep learning in medical image reconstruction and enhancement. Firstly, the importance of medical image reconstruction and enhancement and the limitations of traditional methods are introduced. Then, a detailed discussion was conducted on the application of deep learning models, including Convolutional Neural Networks (CNN), Generative Adversarial Networks (GAN), and Autoencoders, in medical image processing. Specifically, an analysis and comparison were conducted on the image reconstruction ability of CNN models, the image enhancement effect of GAN models, and the image denoising and reconstruction of Autoencoder models. Then, the advantages and challenges of deep learning model in medical image processing are discussed, and the future development direction is discussed. Finally, the research results of this paper are summarized and the prospect of future research is put forward. The research in this paper provides some enlightenment and reference for researchers and practitioners in the field of medical image processing, which is helpful to promote the continuous innovation and progress of medical image processing technology.

Objective The automation of brachytherapy is the direction of future development. This article retrospectively studied the application of deep learning in brachytherapy of cervical cancer and clarified the status quo of development. Method This survey reviewed the application of machine learning and deep learning in brachytherapy for cervical cancer in the past 10 years. The survey retrieved and reviewed electronic journal articles in scientific databases such as Google Scholar and IEEE. The three sets of keywords used 1) deep learning, brachytherapy, 2) machine learning, brachytherapy, 3) automation, brachytherapy. Results Through research on the application of deep learning in brachytherapy, it is found that the U-net model is basically based on convolutional neural networks or some attention mechanisms are added to it, and it is applied to brachytherapy of prostate or cervical cancer. The automatic segmentation and reconstruction of the mid-source applicator (interpolation needle), target area delineation, optimization in the treatment planning system and dose calculation have achieved good results, proving that deep learning can be applied to the clinical treatment of brachytherapy. Conclusion The research on the application of deep learning in brachytherapy confirmed that deep learning can effectively promote the development of brachytherapy.

Recently, deep learning has become a popular area of research, and has revolutionized the diagnosis and prediction of ocular diseases, especially fundus diseases. This study aimed to conduct a bibliometric analysis of deep learning in the field of ophthalmology to describe international research trends and examine the current research directions. This cross-sectional bibliometric analysis examined the development of research on deep learning in the field of ophthalmology and its sub-topics from 2015 to 2024. Visualization of similarities (VOS)-viewer was used to analyze and evaluate 3,055 articles. Data from the articles were collected on a specific date (September 11, 2024) and downloaded from the Web of Science Core Collection (WOSCC) in plain-text format. A total of 3,055 relevant articles on the WOSCC published from 2015 to 2024 were included in this analysis. The first article on the application of deep learning to ophthalmology was published in 2015, and the number of articles on the subject has grown significantly since 2019. China was the most productive country (n=1,187), followed by the United States (n=673). Sun Yat-sen University was the institution with the most publications. Cheng and Bogunovic were the most frequently published authors. The following four different clusters were identified based on a co-occurrence cluster analysis of high-frequency keywords: (I) deep learning for the segmentation and feature extraction of ophthalmic images; (II) deep learning for the automatic detection and classification of ophthalmic images; (III) application of deep learning to ophthalmic imaging techniques; and (IV) deep learning for the diagnosis and management of ophthalmic diseases. The analysis of fundus images and the clinical application of deep learning techniques have emerged as prominent research areas in the field of ophthalmology. The substantial increase in publications and citations signifies the expanding impact and global collaboration in the application of deep learning research to ophthalmology. By identifying four distinct clusters representing sub-topics in deep learning ophthalmology research, this study contributes to the understanding of current trends and potential future advancements in the field.

Structured illumination microscopy (SIM) has emerged as a pivotal super-resolution technique in biological imaging. This review aims to introduce the fundamental principles of SIM, primarily focuses on the latest developments in super-resolution SIM imaging, such as the light illumination and modulation devices, and the image reconstruction algorithms. Additionally, the application of deep learning (DL) technology in SIM imaging is explored, which is employed to enhance image quality, accelerate imaging and reconstruction speed or replace the current image reconstruction method. Furthermore, the key evaluation metrics are proposed and discussed for assessment of deep-learning neural networks, especially for their employment in SIM. Finally, the future integration of artificial intelligence (AI) with SIM system and the perspective of smart microscope are also discussed.

Deep learning has exploded in the public consciousness, primarily as predictive and analytical products suffuse our world, in the form of numerous human-centered smart-world systems, including targeted advertisements, natural language assistants and interpreters, and prototype self-driving vehicle systems. Yet to most, the underlying mechanisms that enable such human-centered smart products remain obscure. In contrast, researchers across disciplines have been incorporating deep learning into their research to solve problems that could not have been approached before. In this paper, we seek to provide a thorough investigation of deep learning in its applications and mechanisms. Specifically, as a categorical collection of state of the art in deep learning research, we hope to provide a broad reference for those seeking a primer on deep learning and its various implementations, platforms, algorithms, and uses in a variety of smart-world systems. Furthermore, we hope to outline recent key advancements in the technology, and provide insight into areas, in which deep learning can improve investigation, as well as highlight new areas of research that have yet to see the application of deep learning, but could nonetheless benefit immensely. We hope this survey provides a valuable reference for new deep learning practitioners, as well as those seeking to innovate in the application of deep learning.

Deep learning has been successfully explored in addressing different multimedia topics recent years, ranging from object detection, semantic classification, entity annotation, to multimedia captioning, multimedia question answering and storytelling. Open source libraries and platforms such as Tensorflow, Caffe, MXnet significantly help promote the wide deployment of deep learning in solving real-world applications. On one hand, deep learning practitioners, while not necessary to understand the involved math behind, are able to set up and make use of a complex deep network. One recent deep learning tool based on Keras even provides the graphical interface to enable straightforward 'drag and drop' operation for deep learning programming. On the other hand, however, some general theoretical problems of learning such as the interpretation and generalization, have only achieved limited progress. Most deep learning papers published these days follow the pipeline of designing/modifying network structures - tuning parameters - reporting performance improvement in specific applications. We have even seen many deep learning application papers without one single equation. Theoretical interpretation and the science behind the study are largely ignored. While excited about the successful application of deep learning in classical and novel problems, we multimedia researchers are responsible to think and solve the fundamental topics in deep learning science. Prof. Guanrong Chen recently wrote an editorial note titled 'Science and Technology, not SciTech' [1]. This panel falls into similar discussion and aims to invite prestigious multimedia researchers and active deep learning practitioners to discuss the positioning of deep learning research now and in the future. Specifically, each panelist is asked to present their opinions on the following five questions: 1)How do you think the current phenomenon that deep learning applications are explosively growing, while the general theoretical problems remain slow progress? 2)Do you agree that deployment of deep learning techniques is getting easy (with a low barrier), while deep learning research is difficult (with a high barrier) 3)What do you think are the core problems for deep learning techniques? 4)What do you think are the core problems for deep learning science? 5)What's your suggestion on the multimedia research in the post-deep learning era?

Deep learning practitioners are often interested in improving their model accuracy rather than the interpretability of their models. As a result, deep learning applications are inherently complex in their structures. They also need to continuously evolve in terms of code changes and model updates. Given these confounding factors, there is a great chance of violating the recommended programming practices by the developers in their deep learning applications. In particular, the code quality might be negatively affected due to their drive for the higher model performance. Unfortunately, the code quality of deep learning applications has rarely been studied to date. In this paper, we conduct an empirical study to investigate the distribution of code smells in deep learning applications. To this end, we perform a comparative analysis between deep learning and traditional open-source applications collected from GitHub. We have several major findings. First, long lambda expression, long ternary conditional expression, and complex container comprehension smells are frequently found in deep learning projects. That is, deep learning code involves more complex or longer expressions than the traditional code does. Second, the number of code smells increases across the releases of deep learning applications. Third, we found that there is a co-existence between code smells and software bugs in the studied deep learning code, which confirms our conjecture on the degraded code quality of deep learning applications.

Applications of deep learning (DL) are essential to realizing an effective adaptive radiotherapy (ART) workflow. Despite the promise demonstrated by DL approaches in several critical ART tasks, there remain unsolved challenges to achieve satisfactory generalizability of a trained model in a clinical setting. Foremost among these is the difficulty of collecting a task-specific training dataset with high-quality, consistent annotations for supervised learning applications. In this study, we propose a tailored DL framework for patient-specific performance that leverages the behavior of a model intentionally overfitted to a patient-specific training dataset augmented from the prior information available in an ART workflow-an approach we term Intentional Deep Overfit Learning (IDOL). Implementing the IDOL framework in any task in radiotherapy consists of two training stages: (1) training a generalized model with a diverse training dataset of patients, just as in the conventional DL approach, and (2) intentionally overfitting this general model to a small training dataset-specific the patient of interest ( ) generated through perturbations and augmentations of the available task- and patient-specific prior information to establish a personalized IDOL model. The IDOL framework itself is task-agnostic and is, thus, widely applicable to many components of the ART workflow, three of which we use as a proof of concept here: the autocontouring task on replanning CTs for traditional ART, the MRI super-resolution (SR) task for MRI-guided ART, and the synthetic CT (sCT) reconstruction task for MRI-only ART. In the replanning CT autocontouring task, the accuracy measured by the Dice similarity coefficient improves from 0.847 with the general model to 0.935 by adopting the IDOL model. In the case of MRI SR, the mean absolute error (MAE) is improved by 40% using the IDOL framework over the conventional model. Finally, in the sCT reconstruction task, the MAE is reduced from 68 to 22 HU by utilizing the IDOL framework. In this study, we propose a novel IDOL framework for ART and demonstrate its feasibility using three ART tasks. We expect the IDOL framework to be especially useful in creating personally tailored models in situations with limited availability of training data but existing prior information, which is usually true in the medical setting in general and is especially true in ART.

This review gives an overview of the current state of deep learning research in breast cancer imaging. Breast imaging plays a major role in detecting breast cancer at an earlier stage, as well as monitoring and evaluating breast cancer during treatment. The most commonly used modalities for breast imaging are digital mammography, digital breast tomosynthesis, ultrasound and magnetic resonance imaging. Nuclear medicine imaging techniques are used for detection and classification of axillary lymph nodes and distant staging in breast cancer imaging. All of these techniques are currently digitized, enabling the possibility to implement deep learning (DL), a subset of Artificial intelligence, in breast imaging. DL is nowadays embedded in a plethora of different tasks, such as lesion classification and segmentation, image reconstruction and generation, cancer risk prediction, and prediction and assessment of therapy response. Studies show similar and even better performances of DL algorithms compared to radiologists, although it is clear that large trials are needed, especially for ultrasound and magnetic resonance imaging, to exactly determine the added value of DL in breast cancer imaging. Studies on DL in nuclear medicine techniques are only sparsely available and further research is mandatory. Legal and ethical issues need to be considered before the role of DL can expand to its full potential in clinical breast care practice.

This review paper investigates applications of machine learning and deep learning in trading, with a particular emphasis on recent advances in deep learning. It provides an overview of algorithms, including support vector machines (SVMs), random forests, deep neural networks (DNNs), long short-term memory networks (LSTM networks), and deep reinforcement learning (DRL). Findings show that while machine learning and deep learning models were able to surpass traditional strategies in general in terms of profitability, they were also better at risk management. However, despite their performances showing superiority, their performances varied significantly under different market conditions, including markets during periods of high and low volatility. In particular, LSTM networks and random forests can generate substantial returns, higher Sharpe ratios, and lower drawdowns compared to the benchmarks, whereas DNNs struggled during highly volatile periods, as reflected in the returns in the periods. Moreover, the improved DRL agent TradeNet-CR can manage risk significantly better than another, despite not surpassing the original TradeNet-CR model.

Ecological resources are an important material foundation for the survival, development, and self-realization of human beings. In-depth and comprehensive research and understanding of ecological resources are beneficial for the sustainable development of human society. Advances in observation technology have improved the ability to acquire long-term, cross-scale, massive, heterogeneous, and multi-source data. Ecological resource research is entering a new era driven by big data. Traditional statistical learning and machine learning algorithms have problems with saturation in dealing with big data. Deep learning is a method for automatically extracting complex high-dimensional nonlinear features, which is increasingly used for scientific and industrial data processing because of its ability to avoid saturation with big data. To promote the application of deep learning in the field of ecological resource research, here, we first introduce the relationship between deep learning theory and research on ecological resources, common tools, and datasets. Second, applications of deep learning in classification and recognition, detection and localization, semantic segmentation, instance segmentation, and graph neural network in typical spatial discrete data are presented through three cases: species classification, crop breeding, and vegetation mapping. Finally, challenges and opportunities for the application of deep learning in ecological resource research in the era of big data are summarized by considering the characteristics of ecological resource data and the development status of deep learning. It is anticipated that the cooperation and training of cross-disciplinary talents may promote the standardization and sharing of ecological resource data, improve the universality and interpretability of algorithms, and enrich applications with the development of hardware.

Motion artifacts in magnetic resonance imaging (MRI) are one of the frequently occurring artifacts due to patient movements during scanning. Motion is estimated to be present in approximately 30% of clinical MRI scans; however, motion has not been explicitly modeled within deep learning image reconstruction models. Deep learning (DL) algorithms have been demonstrated to be effective for both the image reconstruction task and the motion correction task, but the two tasks are considered separately. The image reconstruction task involves removing undersampling artifacts such as noise and aliasing artifacts, whereas motion correction involves removing artifacts including blurring, ghosting, and ringing. In this work, we propose a novel method to simultaneously accelerate imaging and correct motion. This is achieved by integrating a motion module into the DL-based MRI reconstruction process, enabling detection and correction of motion. We model motion as a tightly integrated auxiliary layer in the DL model during training, making the DL model "motion-informed".During inference, image reconstruction is performed from undersampled raw k-space data using a trained motion-informed DL model. Experimental results demonstrate that the proposed motion-informed DL image reconstruction network outperformed the conventional image reconstruction network for motion-degraded MRI datasets.