Browsing by Author "Han, Shuo"

Now showing 1 - 8 of 8
  • Thumbnail Image
    Item
    Center-Extraction-Based Three Dimensional Nuclei Instance Segmentation of Fluorescence Microscopy Images
    (IEEE, 2019-05) Ho, David Joon; Han, Shuo; Fu, Chichen; Salama, Paul; Dunn, Kenneth W.; Delp, Edward J.; Electrical and Computer Engineering, School of Engineering and Technology
    Fluorescence microscopy is an essential tool for the analysis of 3D subcellular structures in tissue. An important step in the characterization of tissue involves nuclei segmentation. In this paper, a two-stage method for segmentation of nuclei using convolutional neural networks (CNNs) is described. In particular, since creating labeled volumes manually for training purposes is not practical due to the size and complexity of the 3D data sets, the paper describes a method for generating synthetic microscopy volumes based on a spatially constrained cycle-consistent adversarial network. The proposed method is tested on multiple real microscopy data sets and outperforms other commonly used segmentation techniques.
  • Thumbnail Image
    Item
    DeepSynth: Three-dimensional nuclear segmentation of biological images using neural networks trained with synthetic data
    (Nature Research, 2019-12-04) Dunn, Kenneth W.; Fu, Chichen; Ho, David Joon; Lee, Soonam; Han, Shuo; Salama, Paul; Delp, Edward J.; Medicine, School of Medicine
    The scale of biological microscopy has increased dramatically over the past ten years, with the development of new modalities supporting collection of high-resolution fluorescence image volumes spanning hundreds of microns if not millimeters. The size and complexity of these volumes is such that quantitative analysis requires automated methods of image processing to identify and characterize individual cells. For many workflows, this process starts with segmentation of nuclei that, due to their ubiquity, ease-of-labeling and relatively simple structure, make them appealing targets for automated detection of individual cells. However, in the context of large, three-dimensional image volumes, nuclei present many challenges to automated segmentation, such that conventional approaches are seldom effective and/or robust. Techniques based upon deep-learning have shown great promise, but enthusiasm for applying these techniques is tempered by the need to generate training data, an arduous task, particularly in three dimensions. Here we present results of a new technique of nuclear segmentation using neural networks trained on synthetic data. Comparisons with results obtained using commonly-used image processing packages demonstrate that DeepSynth provides the superior results associated with deep-learning techniques without the need for manual annotation.
  • Thumbnail Image
    Item
    DINAVID: A Distributed and Networked Image Analysis System for Volumetric Image Data
    (Cold Spring Harbor Laboratory, 2022-05-11) Han, Shuo; Chen , Alain; Lee, Soonam; Fu, Chichen; Yang, Changye; Wu, Liming; Winfree, Seth; El-Achkar, Tarek M.; Dunn, Kenneth W.; Salama, Paul; Delp, Edward J.; Electrical and Computer Engineering, School of Engineering and Technology
    Background: The advancement of high content optical microscopy has enabled the acquisition of very large 3D image datasets. Image analysis tools and three dimensional visualization are critical for analyzing and interpreting 3D image volumes. The analysis of these volumes require more computational resources than a biologist may have access to in typical desktop or laptop computers. This is especially true if machine learning tools are being used for image analysis. With the increased amount of data analysis and computational complexity, there is a need for a more accessible, easy-to-use, and efficient network-based/cloud-based 3D image processing system. Results: The Distributed and Networked Analysis of Volumetric Image Data (DINAVID) system was developed to enable remote analysis of 3D microscopy images for biologists. DINAVID is a server/cloud-based system with a simple web interface that allows biologists to upload 3D volumes for analysis and visualization. DINAVID is designed using open source tools and has two main sub-systems, a computational system for 3D microscopy image processing and analysis as well as a 3D visualization system. Conclusions: In this paper, we will present an overview of the DINAVID system and compare it to other tools currently available for microscopy image analysis.
  • Thumbnail Image
    Item
    Nuclei counting in microscopy images with three dimensional generative adversarial networks
    (SPIE, 2019-03) Han, Shuo; Lee, Soonam; Fu, Chichen; Salama, Paul; Dunn, Kenneth W.; Delp, Edward J.; Electrical and Computer Engineering, School of Engineering and Technology
    Microscopy image analysis can provide substantial information for clinical study and understanding of biological structures. Two-photon microscopy is a type of fluorescence microscopy that can image deep into tissue with near-infrared excitation light. We are interested in methods that can detect and characterize nuclei in 3D fluorescence microscopy image volumes. In general, several challenges exist for counting nuclei in 3D image volumes. These include “crowding” and touching of nuclei, overlapping of nuclei, and shape and size variances of the nuclei. In this paper, a 3D nuclei counter using two different generative adversarial networks (GAN) is proposed and evaluated. Synthetic data that resembles real microscopy image is generated with a GAN and used to train another 3D GAN that counts the number of nuclei. Our approach is evaluated with respect to the number of groundtruth nuclei and compared with common ways of counting used in the biological research. Fluorescence microscopy 3D image volumes of rat kidneys are used to test our 3D nuclei counter. The accuracy results of proposed nuclei counter are compared with the ImageJ’s 3D object counter (JACoP) and the 3D watershed. Both the counting accuracy and the object-based evaluation show that the proposed technique is successful for counting nuclei in 3D.
  • Thumbnail Image
    Item
    RCNN-SliceNet: A Slice and Cluster Approach for Nuclei Centroid Detection in Three-Dimensional Fluorescence Microscopy Images
    (IEEE, 2021) Wu, Liming; Han, Shuo; Chen, Alain; Salama, Paul; Dunn, Kenneth W.; Delp, Edward J.; Electrical and Computer Engineering, School of Engineering and Technology
    Robust and accurate nuclei centroid detection is important for the understanding of biological structures in fluorescence microscopy images. Existing automated nuclei localization methods face three main challenges: (1) Most of object detection methods work only on 2D images and are difficult to extend to 3D volumes; (2) Segmentation-based models can be used on 3D volumes but it is computational expensive for large microscopy volumes and they have difficulty distinguishing different instances of objects; (3) Hand annotated ground truth is limited for 3D microscopy volumes. To address these issues, we present a scalable approach for nuclei centroid detection of 3D microscopy volumes. We describe the RCNN-SliceNet to detect 2D nuclei centroids for each slice of the volume from different directions and 3D agglomerative hierarchical clustering (AHC) is used to estimate the 3D centroids of nuclei in a volume. The model was trained with the synthetic microscopy data generated using Spatially Constrained Cycle-Consistent Adversarial Networks (SpCycle-GAN) and tested on different types of real 3D microscopy data. Extensive experimental results demonstrate that our proposed method can accurately count and detect the nuclei centroids in a 3D microscopy volume.
  • Thumbnail Image
    Item
    Three Dimensional Blind Image Deconvolution for Fluorescence Microscopy using Generative Adversarial Networks
    (IEEE, 2019) Lee, Soonam; Han, Shuo; Salama, Paul; Dunn, Kenneth W.; Delp, Edward J.; Electrical and Computer Engineering, School of Engineering and Technology
    Due to image blurring image deconvolution is often used for studying biological structures in fluorescence microscopy. Fluorescence microscopy image volumes inherently suffer from intensity inhomogeneity, blur, and are corrupted by various types of noise which exacerbate image quality at deeper tissue depth. Therefore, quantitative analysis of fluorescence microscopy in deeper tissue still remains a challenge. This paper presents a three dimensional blind image deconvolution method for fluorescence microscopy using 3way spatially constrained cycle-consistent adversarial networks. The restored volumes of the proposed deconvolution method and other well-known deconvolution methods, denoising methods, and an inhomogeneity correction method are visually and numerically evaluated. Experimental results indicate that the proposed method can restore and improve the quality of blurred and noisy deep depth microscopy image visually and quantitatively.
  • Thumbnail Image
    Item
    Three Dimensional Fluorescence Microscopy Image Synthesis and Segmentation
    (IEEE, 2018-06) Fu, Chichen; Lee, Soonam; Ho, David Joon; Han, Shuo; Salama, Paul; Dunn, Kenneth W.; Delp, Edward J.; Electrical and Computer Engineering, School of Engineering and Technology
    Advances in fluorescence microscopy enable acquisition of 3D image volumes with better image quality and deeper penetration into tissue. Segmentation is a required step to characterize and analyze biological structures in the images and recent 3D segmentation using deep learning has achieved promising results. One issue is that deep learning techniques require a large set of groundtruth data which is impractical to annotate manually for large 3D microscopy volumes. This paper describes a 3D deep learning nuclei segmentation method using synthetic 3D volumes for training. A set of synthetic volumes and the corresponding groundtruth are generated using spatially constrained cycle-consistent adversarial networks. Segmentation results demonstrate that our proposed method is capable of segmenting nuclei successfully for various data sets.
  • Thumbnail Image
    Item
    Three Dimensional Nuclei Segmentation and Classification of Fluorescence Microscopy Images
    (IEEE, 2020-04) Han, Shuo; Lee, Soonam; Chen, Alain; Yang, Changye; Salama, Paul; Dunn, Kenneth W.; Delp, Edward J.; Electrical and Computer Engineering, School of Engineering and Technology
    Segmentation and classification of cell nuclei in fluorescence 3D microscopy image volumes are fundamental steps for image analysis. However, accurate cell nuclei segmentation and detection in microscopy image volumes are hampered by poor image quality, crowding of nuclei, and large variation in nuclei size and shape. In this paper, we present an unsupervised volume to volume translation approach adapted from the Recycle-GAN using modified Hausdorff distance loss for synthetically generating nuclei with better shapes. A 3D CNN with a regularization term is used for nuclei segmentation and classification followed by nuclei boundary refinement. Experimental results demonstrate that the proposed method can successfully segment nuclei and identify individual nuclei.