Go to JCI Insight
  • About
  • Editors
  • Consulting Editors
  • For authors
  • Publication ethics
  • Publication alerts by email
  • Advertising
  • Job board
  • Contact
  • Clinical Research and Public Health
  • Current issue
  • Past issues
  • By specialty
    • COVID-19
    • Cardiology
    • Gastroenterology
    • Immunology
    • Metabolism
    • Nephrology
    • Neuroscience
    • Oncology
    • Pulmonology
    • Vascular biology
    • All ...
  • Videos
    • Conversations with Giants in Medicine
    • Video Abstracts
  • Reviews
    • View all reviews ...
    • Complement Biology and Therapeutics (May 2025)
    • Evolving insights into MASLD and MASH pathogenesis and treatment (Apr 2025)
    • Microbiome in Health and Disease (Feb 2025)
    • Substance Use Disorders (Oct 2024)
    • Clonal Hematopoiesis (Oct 2024)
    • Sex Differences in Medicine (Sep 2024)
    • Vascular Malformations (Apr 2024)
    • View all review series ...
  • Viewpoint
  • Collections
    • In-Press Preview
    • Clinical Research and Public Health
    • Research Letters
    • Letters to the Editor
    • Editorials
    • Commentaries
    • Editor's notes
    • Reviews
    • Viewpoints
    • 100th anniversary
    • Top read articles

  • Current issue
  • Past issues
  • Specialties
  • Reviews
  • Review series
  • Conversations with Giants in Medicine
  • Video Abstracts
  • In-Press Preview
  • Clinical Research and Public Health
  • Research Letters
  • Letters to the Editor
  • Editorials
  • Commentaries
  • Editor's notes
  • Reviews
  • Viewpoints
  • 100th anniversary
  • Top read articles
  • About
  • Editors
  • Consulting Editors
  • For authors
  • Publication ethics
  • Publication alerts by email
  • Advertising
  • Job board
  • Contact
Artificial intelligence for automating the measurement of histologic image biomarkers
Toby C. Cornish
Toby C. Cornish
Published April 15, 2021
Citation Information: J Clin Invest. 2021;131(8):e147966. https://doi.org/10.1172/JCI147966.
View: Text | PDF
Commentary

Artificial intelligence for automating the measurement of histologic image biomarkers

  • Text
  • PDF
Abstract

Artificial intelligence has been applied to histopathology for decades, but the recent increase in interest is attributable to well-publicized successes in the application of deep-learning techniques, such as convolutional neural networks, for image analysis. Recently, generative adversarial networks (GANs) have provided a method for performing image-to-image translation tasks on histopathology images, including image segmentation. In this issue of the JCI, Koyuncu et al. applied GANs to whole-slide images of p16-positive oropharyngeal squamous cell carcinoma (OPSCC) to automate the calculation of a multinucleation index (MuNI) for prognostication in p16-positive OPSCC. Multivariable analysis showed that the MuNI was prognostic for disease-free survival, overall survival, and metastasis-free survival. These results are promising, as they present a prognostic method for p16-positive OPSCC and highlight methods for using deep learning to measure image biomarkers from histopathologic samples in an inherently explainable manner.

Authors

Toby C. Cornish

×

Figure 1

Direct and indirect application of deep learning to prognosis.

Options: View larger image (or click on image) Download as PowerPoint
Direct and indirect application of deep learning to prognosis.
Generally...
Generally speaking, there are two different ways to use deep learning to derive prognostic information from histologic slides. (A) Both methods begin in a similar fashion, with digitization of stained tumor samples from a patient to create WSIs. The tissue in each WSI is then divided into smaller image patches. (B) The direct approach uses a CNN or similar deep-learning model that has been trained using tumor patches as input and patient outcomes as labels. This process permits the model to directly predict patient outcomes but is not easily explainable using current methods. (C) The indirect method is illustrated with a simplified representation of the GAN-based method used by Koyuncu et al., but other approaches might use fully convolutional networks or other types of CNNs to accomplish the same task. Two generators (GMN and GEP) translate the patches into segmentation masks, and these masks are combined to identify tumor nuclei (black) and multinucleated tumor nuclei (red). The MuNI is calculated for all tumor patches and serves as an intermediate value that can then be used, along with other clinical data, for prognostication.

Copyright © 2025 American Society for Clinical Investigation
ISSN: 0021-9738 (print), 1558-8238 (online)

Sign up for email alerts