Journal Articles
Permanent URI for this collectionhttps://idr.nitk.ac.in/handle/123456789/19884
Browse
12 results
Search Results
Item Computational methods for automated mitosis detection in histopathology images: A review(Elsevier Sp. z o.o., 2021) Mathew, T.; Kini, J.R.; Rajan, J.Mitosis detection is an important step in pathology procedures in the context of cancer diagnosis and prognosis. Prevalent process for this task is by manually observing Hematoxylin and Eosin (H & E) stained histopathology sections on glass slides through a microscope by trained pathologists. This conventional approach is tedious, error-prone, and has shown high inter-observer variability. With the advancement of computational technologies, automating mitosis detection by the use of image processing algorithms has attracted significant research interest. In the past decade, several methods appeared in the literature, addressing this problem and they have shown encouraging incremental progress towards a clinically usable solution. Mitosis count is an important parameter in grading of breast cancer and glioma, unlike other cancer types. Driven by the availability of multiple public datasets and open contests, most of the methods in literature address mitosis detection in breast cancer images. This paper is a comprehensive review of the methods published in the area of automated mitotic cell detection in H & E stained histopathology images of breast cancer in the last 10 years. We also discuss the current trends and future prospects of this clinically relevant task, augmenting humanity's fight against cancer. © 2020 Nalecz Institute of Biocybernetics and Biomedical Engineering of the Polish Academy of SciencesItem Segmentation of intra-retinal cysts from optical coherence tomography images using a fully convolutional neural network model(Institute of Electrical and Electronics Engineers Inc., 2019) Girish, G.N.; Thakur, B.; Chowdhury, S.R.; Kothari, A.R.; Rajan, J.Optical coherence tomography (OCT) is an imaging modality that is used extensively for ophthalmic diagnosis, near-histological visualization, and quantification of retinal abnormalities such as cysts, exudates, retinal layer disorganization, etc. Intra-retinal cysts (IRCs) occur in several macular disorders such as, diabetic macular edema, retinal vascular disorders, age-related macular degeneration, and inflammatory disorders. Automated segmentation of IRCs poses challenges owing to variations in the acquisition system scan intensities, speckle noise, and imaging artifacts. Several segmentation methods have been proposed in the literature for IRC segmentation on vendor-specific OCT images that lack generalizability across imaging systems. In this paper, we propose a fully convolutional network (FCN) model for vendor-independent IRC segmentation. The proposed method counteracts image noise variabilities and trains FCN models on OCT sub-images from the OPTIMA cyst segmentation challenge dataset (with four different vendor-specific images, namely, Cirrus, Nidek, Spectralis, and Topcon). Further, optimal data augmentation and model hyperparametrization are shown to prevent over-fitting for IRC area segmentation. The proposed method is evaluated on the test dataset with a recall/precision rate of 0.66/0.79 across imaging vendors. The Dice correlation coefficient of the proposed method outperforms that of the published algorithms in the OPTIMA cyst segmentation challenge with a Dice rate of 0.71 across the vendors. © 2013 IEEE.Item Segmentation of focal cortical dysplasia lesions from magnetic resonance images using 3D convolutional neural networks(Elsevier Ltd, 2021) Niyas, S.; Chethana Vaisali, S.; Show, I.; Chandrika, T.G.; Vinayagamani, S.; Kesavadas, C.; Rajan, J.Computer-aided diagnosis using advanced Artific ial Intelligence (AI) techniques has become much popular over the last few years. This work automates the segmentation of Focal Cortical Dysplasia (FCD) lesions from three-dimensional (3D) Magnetic Resonance (MR) images. FCD is a type of neuronal malformation in the brain cortex and is the leading cause of intractable epilepsy, irrespective of gender or age differences. Since the neuron related abnormalities are usually resistant to drug therapy, surgical resection has been the main treatment approach for patients with intractable epilepsy. Automating the identification and segmentation of FCD is useful for neuroradiologists in pre-surgical evaluations. Convolutional Neural Networks (CNNs) have the ability to learn appropriate features from the training data without any human intervention. But, most of the state-of-the-art FCD segmentation approaches use two-dimensional (2D) CNN models despite the availability of 3D Magnetic resonance imaging (MRI) volumes, and hence fail to leverage the inter-slice information present in the MRI volumes. The major hurdles in considering a 3D CNN model are the need for a large 3D dataset, big memory, and high computation cost. A deep 3D CNN segmentation model, which can extract inter-slice information and overcomes the drawbacks of conventional 3D CNN methods to an extent, is proposed in this paper. The model uses a 3D version of U-Net with residual blocks that works on shallow depth 3D sub-volumes generated from MRI volumes. The proposed method shows superior performance over the state-of-the-art FCD segmentation methods in both qualitative and quantitative analysis. © 2021 Elsevier LtdItem Stroke classification from computed tomography scans using 3D convolutional neural network(Elsevier Ltd, 2022) Neethi, A.S.; Niyas, S.; Kannath, S.K.; Mathew, J.; Anzar, A.M.; Rajan, J.Stroke is a cerebrovascular condition with a significant morbidity and mortality rate and causes physical disabilities for survivors. Once the symptoms are identified, it requires a time-critical diagnosis with the help of the most commonly available imaging techniques. Computed tomography (CT) scans are used worldwide for preliminary stroke diagnosis. It demands the expertise and experience of a radiologist to identify the stroke type, which is critical for initiating the treatment. This work attempts to gather those domain skills and build a model from CT scans to diagnose stroke. The non-contrast computed tomography (NCCT) scan of the brain comprises volumetric images or a 3D stack of image slices. So, a model that aims to solve the problem by targeting a 2D slice may fail to address the volumetric nature. We propose a 3D-based fully convolutional classification model to identify stroke cases from CT images that take into account the contextual longitudinal composition of volumetric data. We formulate a custom pre-processing module to enhance the scans and aid in improving the classification performance. Some of the significant challenges faced by 3D CNN are the less number of training samples, and the number of scans is mostly biased in favor of normal patients. In this work, the limitation of insufficient training volume and class imbalanced data have been rectified with the help of a strided slicing approach. A block-wise design was used to formulate the proposed network, with the initial part focusing on adjusting the dimensionality, at the same time retaining the features. Later on, the accumulated feature maps were effectively learned utilizing bundled convolutions and skip connections. The results of the proposed method were compared against 3D CNN stroke classification models on NCCT, various 3D CNN architectures on other brain imaging modalities, and 3D extensions of some of the classical CNN architectures. The proposed method achieved an improvement of 14.28% in the F1-score over the state-of-the-art 3D CNN stroke classification model. © 2022 Elsevier LtdItem A novel deep classifier framework for automated molecular subtyping of breast carcinoma using immunohistochemistry image analysis(Elsevier Ltd, 2022) Mathew, T.; Niyas, S.; Johnpaul, C.I.; Kini, J.; Rajan, J.Breast carcinoma has various subtypes based on the genetic factors involved in the pathogenesis of the malignancy. Identifying the exact subtype and providing targeted treatment to the patient can improve the survival chances. Molecular subtyping through immunohistochemistry analysis is a pathology procedure to determine the subtype of breast cancer. The existing manual procedure is tedious and involves assessing the status of the four vital molecular biomarkers present in the tumor tissues. In this paper, a deep learning-based framework for automated molecular subtyping of breast cancer is proposed. Digital slide images of the four biomarkers are separately processed by the proposed framework. In the preprocessing stage, the non-informative background regions from the images are separated. The patches extracted from the foreground regions are classified into target classes using convolutional neural network models trained for this purpose. Classification results are post-processed to predict the status of all the four biomarkers. The predictions for the individual biomarkers are finally consolidated as per clinical guidelines to determine the subtype of the cancer. The proposed system is evaluated for the performance of individual biomarker status prediction and patient-level subtype classification.For patient-level evaluation of biomarkers ER, PR, K67, and HER2, the proposed method gives F1 Scores 1.00, 1.00, 0.90, and 0.94 respectively, whereas for molecular subtyping an F1 score of 0.89 is obtained. In both these aspects, the proposed framework has given significant results that show the effectiveness of our approach. © 2022 Elsevier LtdItem Automated Molecular Subtyping of Breast Carcinoma Using Deep Learning Techniques(Institute of Electrical and Electronics Engineers Inc., 2023) Niyas, S.; Bygari, R.; Naik, R.; Viswanath, B.; Ugwekar, D.; Mathew, T.; Kavya, J.; Kini, J.R.; Rajan, J.Objective: Molecular subtyping is an important procedure for prognosis and targeted therapy of breast carcinoma, the most common type of malignancy affecting women. Immunohistochemistry (IHC) analysis is the widely accepted method for molecular subtyping. It involves the assessment of the four molecular biomarkers namely estrogen receptor (ER), progesterone receptor (PR), human epidermal growth factor receptor 2 (HER2), and antigen Ki67 using appropriate antibody reagents. Conventionally, these biomarkers are assessed manually by a pathologist, who finally combines individual results to identify the molecular subtype. Molecular subtyping necessitates the status of all the four biomarkers together, and to the best of our knowledge, no such automated method exists. This paper proposes a novel deep learning framework for automatic molecular subtyping of breast cancer from IHC images. Methods and procedures: A modified LadderNet architecture is proposed to segment the immunopositive elements from ER, PR, HER2, and Ki67 biomarker slides. This architecture uses long skip connections to pass encoder feature space from different semantic levels to the decoder layers, allowing concurrent learning with multi-scale features. The entire architecture is an ensemble of multiple fully convolutional neural networks, and learning pathways are chosen adaptively based on input data. The segmentation stage is followed by a post-processing stage to quantify the extent of immunopositive elements to predict the final status for each biomarker. Results: The performance of segmentation models for each IHC biomarker is evaluated qualitatively and quantitatively. Furthermore, the biomarker prediction results are also evaluated. The results obtained by our method are highly in concordance with manual assessment by pathologists. Clinical impact: Accurate automated molecular subtyping can speed up this pathology procedure, reduce pathologists' workload and associated costs, and facilitate targeted treatment to obtain better outcomes. © 2013 IEEE.Item A Deep Ensemble Learning-Based CNN Architecture for Multiclass Retinal Fluid Segmentation in OCT Images(Institute of Electrical and Electronics Engineers Inc., 2023) Rahil, M.; Anoop, B.N.; Girish, G.N.; Kothari, A.R.; Koolagudi, S.G.; Rajan, J.Retinal Fluids (fluid collections) develop because of the accumulation of fluid in the retina, which may be caused by several retinal disorders, and can lead to loss of vision. Optical coherence tomography (OCT) provides non-invasive cross-sectional images of the retina and enables the visualization of different retinal abnormalities. The identification and segmentation of retinal cysts from OCT scans is gaining immense attention since the manual analysis of OCT data is time consuming and requires an experienced ophthalmologist. Identification and categorization of the retinal cysts aids in establishing the pathophysiology of various retinal diseases, such as macular edema, diabetic macular edema, and age-related macular degeneration. Hence, an automatic algorithm for the segmentation and detection of retinal cysts would be of great value to the ophthalmologists. In this study, we have proposed a convolutional neural network-based deep ensemble architecture that can segment the three different types of retinal cysts from the retinal OCT images. The quantitative and qualitative performance of the model was evaluated using the publicly available RETOUCH challenge dataset. The proposed model outperformed the state-of-the-art methods, with an overall improvement of 1.8%. © 2013 IEEE.Item StrokeViT with AutoML for brain stroke classification(Elsevier Ltd, 2023) Raj, R.; Mathew, J.; Kannath, S.K.; Rajan, J.Stroke, categorized under cardiovascular and circulatory diseases, is considered the second foremost cause of death worldwide, causing approximately 11% of deaths annually. Stroke diagnosis using a Computed Tomography (CT) scan is considered ideal for identifying whether the stroke is hemorrhagic or ischemic. However, most methods for stroke classification are based on a single slice-level prediction mechanism, meaning that the most imperative CT slice has to be manually selected by the radiologist from the original CT volume. This paper proposes an integration of Convolutional Neural Network (CNN), Vision Transformers (ViT), and AutoML to obtain slice-level predictions as well as patient-wise prediction results. While the CNN with inductive bias captures local features, the transformer captures long-range dependencies between sequences. This collaborative local-global feature extractor improves upon the slice-wise predictions of the CT volume. We propose stroke-specific feature extraction from each slice-wise prediction to obtain the patient-wise prediction using AutoML. While the slice-wise predictions helps the radiologist to verify close and corner cases, the patient-wise predictions makes the outcome clinically relevant and closer to real-world scenario. The proposed architecture has achieved an accuracy of 87% for single slice-level prediction and an accuracy of 92% for patient-wise prediction. For comparative analysis of slice-level predictions, standalone architectures of VGG-16, VGG-19, ResNet50, and ViT were considered. The proposed architecture has outperformed the standalone architectures by 9% in terms of accuracy. For patient-wise predictions, AutoML considers 13 different ML algorithms, of which 3 achieve an accuracy of more than 90%. The proposed architecture helps in reducing the manual effort by the radiologist to manually select the most imperative CT from the original CT volume and shows improvement over other standalone architectures for classification tasks. The proposed architecture can be generalized for volumetric scans aiding in the patient diagnosis of head and neck, lungs, diseases of hepatobiliary tract, genitourinary diseases, women's imaging including breast cancer and various musculoskeletal diseases. Code for proposed stroke-specific feature extraction with the pre-trained weights of the trained model is available at: https://github.com/rishiraj-cs/StrokeViT_With_AutoML. © 2022 Elsevier LtdItem A deep learning based classifier framework for automated nuclear atypia scoring of breast carcinoma(Elsevier Ltd, 2023) Mathew, T.; Johnpaul, C.I.; Ajith, B.; Kini, J.R.; Rajan, J.Nuclear atypia scoring is an essential procedure in the grading of breast carcinoma. Manual procedure of nuclear atypia scoring is error-prone, and marked by pathologists’ disagreement and low reproducibility. Automated methods are actively attempted by researchers to solve the problems of manual scoring. In this work, we propose a novel deep learning-based framework for automated nuclear atypia scoring of breast cancer from histopathology slide images. The framework consists of three major phases namely preprocessing, deep learning, and postprocessing. The original three-class problem of atypia scoring at slide level is not suitable for direct application of deep learning algorithms. This is due to the large dimensions and structural complexity of slide images, compounded by the small sample size of the available dataset. Redesign of this problem into a six-class nuclei classification problem through a set of preprocessing steps to facilitate effective use of deep learning algorithms, and the flexibility of the proposed three-phase framework to use different algorithms in each phase are the novel aspects of the proposed work. We used the publicly available slide image dataset MITOS-ATYPIA that contains 600 slide images of high spatial dimension for the experiments. A five-fold cross validation with the train-test sample ratio 80:20 in each fold is used for the performance evaluation. The performance of the method based on this framework exceeds the state-of-the-art with the results 0.8766, 0.8760, and 0.8745 for the metrics precision, recall, and F1 score respectively. © 2023 Elsevier LtdItem Multilevel Multimodal Framework for Automatic Collateral Scoring in Brain Stroke(Institute of Electrical and Electronics Engineers Inc., 2024) Raj, R.; Dayananda, D.; Gupta, A.; Mathew, J.; Kannath, S.K.; Prakash, A.; Rajan, J.In patients with ischemic brain stroke, collateral circulation plays a crucial role in selecting patients suitable for endovascular therapy. The presence of well-developed collaterals improves the patient's chances of recovery. In clinical practice, the presence of collaterals is diagnosed on a Computed Tomography Angiography scan. The radiologist grades it on the basis of subjective visual assessment, which is prone to interobserver and intraobserver variability. Computer-based methods of collateral assessment face the challenge of non-uniform scan volume, leading to manual selection of slices, meaning that the most imperative slices have to be manually selected by the radiologist. This paper proposes a multilevel multimodal hierarchical framework for automated collateral scoring. Specifically, we propose deploying a Convolutional Neural Network for image selection based on the visibility of collaterals and a multimodal model for comparing the occluded and contralateral sides of the brain for collateral scoring. We also generate a patient-level prediction by integrating automated machine learning in the proposed framework. While the proposed multimodal predictor contributes to Artificial Intelligence, the proposed end-to-end framework is an application in engineering. The proposed framework has been trained and tested on 116 patients, with five-fold cross-validation, achieving an accuracy of 91.17% for multi-class collateral scores and 94.118% for binary class collateral scores. The proposed multimodal predictor achieved a weighted F1 score of 0.86 and 0.95 on multi-class and binary-class collateral scores, respectively. The proposed framework is fast, efficient, and scalable for real-world deployments. Automated evaluation of collaterals with attention maps for explainability would complement radiologists' efforts. Code for the proposed framework is available at: https://github.com/rishiraj-cs/collaterals_ML_MM. © 2013 IEEE.