Articles producció científica> Enginyeria Informàtica i Matemàtiques

Deep learning-based survival prediction of brain tumor patients using attention-guided 3D convolutional neural network with radiomics approach from multimodality magnetic resonance imaging

  • Identification data

    Identifier: imarina:9333730
    Authors:
    Mazher, MQayyum, APuig, DAbdel-Nasser, M
    Abstract:
    Automatic survival prediction of gliomas from brain magnetic resonance imaging (MRI) volumes is an essential step for a patient's prognosis analysis. Radiomics research delivers beneficial feature information from MRI imaging which is substantially required by clinicians and oncologists for predicting disease prognosis for precise surgical treatment and planning. In recent years, the success of deep learning has been vast in the field of medical imaging, and it shows state-of-the-art performance in applications like segmentation, classification, regression, and detection. Therefore, in this paper, we proposed a collective method using deep learning and radiomics techniques for the survival prediction of brain tumor patients. We first propose a hierarchical channel attention (HAM) module and a multi-scale-aware feature enhancement (MSAFE) to efficiently fuse adjacent hierarchical features in the proposed segmentation model. After segmentation, deep/latent features (LCNN) are extracted from the bottom layer of the proposed segmentation model. Later, we extracted selected radiomics features (histogram, location, and shape) using input images and segmented masks from the proposed segmentation model. Further, the 3D deep learning regressor has been trained for 3D regressor-based deep feature extraction. We proposed the method of overall survival prediction for the brain tumor patients by combining all the meaningful features including clinical features (age) that also favorably contribute to the survival days prediction for the glioma's patients. To predict the survival days for each patient, the selected features are trained to analyze the performance of various regression techniques like random forest (RF), decision tree (DT), and XGBoost. Our proposed combined feature-bas
  • Others:

    Author, as appears in the article.: Mazher, M; Qayyum, A; Puig, D; Abdel-Nasser, M
    Department: Enginyeria Informàtica i Matemàtiques
    URV's Author/s: Mazher, Moona / Puig Valls, Domènec Savi
    Keywords: Survival prediction Segmentation Radiomics Multimodal brain tumor Model Medical image processing Deep learning Brain tumor prognosis Brain tumor survival prediction segmentation radiomics multimodal brain tumor mri medical image processing deep learning brain tumor prognosis
    Abstract: Automatic survival prediction of gliomas from brain magnetic resonance imaging (MRI) volumes is an essential step for a patient's prognosis analysis. Radiomics research delivers beneficial feature information from MRI imaging which is substantially required by clinicians and oncologists for predicting disease prognosis for precise surgical treatment and planning. In recent years, the success of deep learning has been vast in the field of medical imaging, and it shows state-of-the-art performance in applications like segmentation, classification, regression, and detection. Therefore, in this paper, we proposed a collective method using deep learning and radiomics techniques for the survival prediction of brain tumor patients. We first propose a hierarchical channel attention (HAM) module and a multi-scale-aware feature enhancement (MSAFE) to efficiently fuse adjacent hierarchical features in the proposed segmentation model. After segmentation, deep/latent features (LCNN) are extracted from the bottom layer of the proposed segmentation model. Later, we extracted selected radiomics features (histogram, location, and shape) using input images and segmented masks from the proposed segmentation model. Further, the 3D deep learning regressor has been trained for 3D regressor-based deep feature extraction. We proposed the method of overall survival prediction for the brain tumor patients by combining all the meaningful features including clinical features (age) that also favorably contribute to the survival days prediction for the glioma's patients. To predict the survival days for each patient, the selected features are trained to analyze the performance of various regression techniques like random forest (RF), decision tree (DT), and XGBoost. Our proposed combined feature-based method achieved the highest performance for survival days prediction over the state-of-the-art methods. We also perform extensive experiments to show the effectiveness of each feature extraction method. The experimental results infer that deep learning-based features along with radiomic features and clinical features are truly vital paradigms to estimate survival days.
    Thematic Areas: Software Optics Imaging science & photographic technology Engineering, electrical & electronic Engenharias iv Electronic, optical and magnetic materials Electrical and electronic engineering Computer vision and pattern recognition Ciência da computação Astronomia / física
    licence for use: https://creativecommons.org/licenses/by/3.0/es/
    Author's mail: domenec.puig@urv.cat moona.mazher@estudiants.urv.cat
    Author identifier: 0000-0002-0562-4205 0000-0003-4444-5776
    Record's date: 2024-01-13
    Papper version: info:eu-repo/semantics/publishedVersion
    Papper original source: International Journal Of Imaging Systems And Technology.
    APA: Mazher, M; Qayyum, A; Puig, D; Abdel-Nasser, M (2023). Deep learning-based survival prediction of brain tumor patients using attention-guided 3D convolutional neural network with radiomics approach from multimodality magnetic resonance imaging. International Journal Of Imaging Systems And Technology, (), -. DOI: 10.1002/ima.23010
    Licence document URL: https://repositori.urv.cat/ca/proteccio-de-dades/
    Entity: Universitat Rovira i Virgili
    Journal publication year: 2023
    Publication Type: Journal Publications
  • Keywords:

    Computer Vision and Pattern Recognition,Electrical and Electronic Engineering,Electronic, Optical and Magnetic Materials,Engineering, Electrical & Electronic,Imaging Science & Photographic Technology,Optics,Software
    Survival prediction
    Segmentation
    Radiomics
    Multimodal brain tumor
    Model
    Medical image processing
    Deep learning
    Brain tumor prognosis
    Brain tumor
    survival prediction
    segmentation
    radiomics
    multimodal brain tumor
    mri
    medical image processing
    deep learning
    brain tumor prognosis
    Software
    Optics
    Imaging science & photographic technology
    Engineering, electrical & electronic
    Engenharias iv
    Electronic, optical and magnetic materials
    Electrical and electronic engineering
    Computer vision and pattern recognition
    Ciência da computação
    Astronomia / física
  • Documents:

  • Cerca a google

    Search to google scholar