Segmentation of cellular patterns in confocal images of melanocytic lesions in vivo via a multiscale encoder-decoder network (MED-Net).
Cast your vote
You can rate an item by clicking the amount of stars they wish to award to this item.
When enough users have cast their vote on this item, the average rating will also be shown.
Your vote was cast
Thank you for your feedback
Thank you for your feedback
Dy, Jennifer G
Brooks, Dana H
In vivo segmentation
Reflectance confocal microscopy
Journal titleMedical image analysis
Publication Begin page101841
MetadataShow full item record
AbstractIn-vivo optical microscopy is advancing into routine clinical practice for non-invasively guiding diagnosis and treatment of cancer and other diseases, and thus beginning to reduce the need for traditional biopsy. However, reading and analysis of the optical microscopic images are generally still qualitative, relying mainly on visual examination. Here we present an automated semantic segmentation method called "Multiscale Encoder-Decoder Network (MED-Net)" that provides pixel-wise labeling into classes of patterns in a quantitative manner. The novelty in our approach is the modeling of textural patterns at multiple scales (magnifications, resolutions). This mimics the traditional procedure for examining pathology images, which routinely starts with low magnification (low resolution, large field of view) followed by closer inspection of suspicious areas with higher magnification (higher resolution, smaller fields of view). We trained and tested our model on non-overlapping partitions of 117 reflectance confocal microscopy (RCM) mosaics of melanocytic lesions, an extensive dataset for this application, collected at four clinics in the US, and two in Italy. With patient-wise cross-validation, we achieved pixel-wise mean sensitivity and specificity of 74% and 92%, respectively, with 0.74 Dice coefficient over six classes. In the scenario, we partitioned the data clinic-wise and tested the generalizability of the model over multiple clinics. In this setting, we achieved pixel-wise mean sensitivity and specificity of 77% and 94%, respectively, with 0.77 Dice coefficient. We compared MED-Net against the state-of-the-art semantic segmentation models and achieved better quantitative segmentation performance. Our results also suggest that, due to its nested multiscale architecture, the MED-Net model annotated RCM mosaics more coherently, avoiding unrealistic-fragmented annotations.
CitationKose K, Bozkurt A, Alessi-Fox C, Gill M, Longo C, Pellacani G, Dy JG, Brooks DH, Rajadhyaksha M. Segmentation of cellular patterns in confocal images of melanocytic lesions in vivo via a multiscale encoder-decoder network (MED-Net). Med Image Anal. 2021 Jan;67:101841. doi: 10.1016/j.media.2020.101841. Epub 2020 Oct 7. PMID: 33142135; PMCID: PMC7885250.
The following license files are associated with this item:
- Creative Commons
Except where otherwise noted, this item's license is described as Copyright © 2020. Published by Elsevier B.V.
- Semantic segmentation of reflectance confocal microscopy mosaics of pigmented lesions using weak labels.
- Authors: D'Alonzo M, Bozkurt A, Alessi-Fox C, Gill M, Brooks DH, Rajadhyaksha M, Kose K, Dy JG
- Issue date: 2021 Feb 11
- Role of In Vivo Reflectance Confocal Microscopy in the Analysis of Melanocytic Lesions.
- Authors: Serban ED, Farnetani F, Pellacani G, Constantin MM
- Issue date: 2018 Apr
- IBA-U-Net: Attentive BConvLSTM U-Net with Redesigned Inception for medical image segmentation.
- Authors: Chen S, Zou Y, Liu PX
- Issue date: 2021 Aug
- A multiple-channel and atrous convolution network for ultrasound image segmentation.
- Authors: Zhang L, Zhang J, Li Z, Song Y
- Issue date: 2020 Dec
- Catheter segmentation in X-ray fluoroscopy using synthetic data and transfer learning with light U-nets.
- Authors: Gherardini M, Mazomenos E, Menciassi A, Stoyanov D
- Issue date: 2020 Aug