ABSTRACT
Pancreatic ductal adenocarcinoma (PDAC) is a highly aggressive and lethal form of cancer with limited prognostic accuracy using traditional factors. This has led to the exploration of innovative prognostic models, including convolutional neural networks (CNNs), in PDAC. CNNs, a type of artificial intelligence algorithm, have shown promise in various medical applications, including image analysis and pattern recognition. Their ability to extract complex features from medical images makes them suitable for improving prognostication in PDAC. However, implementing CNNs in clinical practice poses challenges, such as data availability and interpretability. Future research should focus on multi-center studies, integrating multiple data modalities, and combining CNN outputs with biomarker panels. Collaborative efforts and patient autonomy should be considered to ensure the ethical implementation of CNN-based prognostic models. Further validation and optimisation of CNN-based models are necessary to enhance their reliability and clinical utility in PDAC prognostication.
KEYWORDS:
Pancreatic neoplasms; prognosis; convolutional neural networks; artificial intelligence; multimodal imaging
RESUMO
Contexto
O adenocarcinoma ductal pancreático (ACDP) é uma forma de câncer altamente agressiva e letal com precisão prognóstica limitada usando fatores tradicionais. Isso levou à exploração de modelos prognósticos inovadores, incluindo redes neurais convolucionais (CNNs), no ACDP. As CNNs, um tipo de algoritmo de inteligência artificial, mostraram promessa em várias aplicações médicas, incluindo análise de imagem e reconhecimento de padrões. Sua capacidade de extrair características complexas de imagens médicas as torna adequadas para melhorar o prognóstico no ACDP. No entanto, a implementação de CNNs na prática clínica apresenta desafios, como a disponibilidade de dados e a interpretabilidade. Pesquisas futuras devem se concentrar em estudos multicêntricos, integrando múltiplas modalidades de dados e combinando saídas de CNN com painéis de biomarcadores. Esforços colaborativos e autonomia do paciente devem ser considerados para garantir a implementação ética de modelos prognósticos baseados em CNN. Mais validação e otimização de modelos baseados em CNN são necessárias para aumentar sua confiabilidade e utilidade clínica na prognostico do ACDP.
Palavras-chave:
Neoplasias pancreáticas; prognóstico; redes neurais convolucionais; inteligência artificial; imagem multimodal
HIGHLIGHTS
•Pancreatic ductal adenocarcinoma (PDAC) is an aggressive cancer with limited prognostic accuracy through traditional methods.
•Convolutional neural networks (CNNs) are being explored for prognostic models in PDAC.
•They can extract complex features from images, aiding PDAC prognostication.
•Further validation and optimization of CNN-based models are needed for better reliability and clinical utility in PDAC.
INTRODUCTION
Pancreatic ductal adenocarcinoma (PDAC) is a highly aggressive and lethal form of cancer that arises from the cells lining the pancreatic ducts. It accounts for a significant number of cancer-related deaths worldwide, with a five-year survival rate of less than 10%. PDAC is often diagnosed at advanced stages, when treatment options are limited, contributing to its poor prognosis11. Orth M, Metzger P, Gerum S, Mayerle J, Schneider G, Belka C, et al. Pancreatic ductal adenocarcinoma: biological hallmarks, current status, and future perspectives of combined modality treatment approaches. Radiat Oncol. 2019;14:141. doi:10.1186/s13014-019-1345-6.
https://doi.org/10.1186/s13014-019-1345-...
. Due to the aggressive nature of PDAC and the challenges associated with its early detection, accurate prognostic indicators are crucial for guiding treatment decisions and predicting patient outcomes. Traditional prognostic tools, such as tumour stage, histological grade, and lymph node involvement, have limitations in accurately predicting individual patient outcomes22. Sarantis P, Koustas E, Papadimitropoulou A, Papavassiliou AG, Karamouzis MV. Pancreatic ductal adenocarcinoma: Treatment hurdles, tumor microenvironment and immunotherapy. World J Gastrointest Oncol. 2020;12:173-81. doi:10.4251/wjgo.v12.i2.173.
https://doi.org/10.4251/wjgo.v12.i2.173...
,33. Adamska A, Domenichini A, Falasca M. Pancreatic ductal adenocarcinoma: Current and evolving therapies. Int J Mol Sci. 2017;18. doi:10.3390/ijms18071338.
https://doi.org/10.3390/ijms18071338...
. As a result, there is a pressing need for more robust and reliable prognostic indicators that can aid in personalised treatment strategies and improve patient outcomes.
Convolutional neural networks (CNNs) have demonstrated immense potential in the field of medical imaging and prognostication. Their ability to analyse complex patterns and extract meaningful features from medical images has opened up new possibilities for improving diagnosis, prognosis, and treatment planning44. Sarvamangala DR, Kulkarni RV. Convolutional neural networks in medical image understanding: a survey. Evol Intell. 2022;15:1-22. doi:10.1007/s12065-020-00540-3.
https://doi.org/10.1007/s12065-020-00540...
. In recent years, there has been growing interest in exploring the potential of CNNs, a type of artificial intelligence (AI) algorithm, as prognostic indicators in PDAC. CNNs have shown promising results in various medical applications, including image analysis and pattern recognition, and their ability to extract complex features from medical images and clinical data makes them an attractive tool for prognostication55. Huang B, Huang H, Zhang S, Zhang D, Shi Q, Liu J, et al. Artificial intelligence in pancreatic cancer. Theranostics. 2022;12:6931-54. doi:10.7150/thno.77949.
https://doi.org/10.7150/thno.77949...
.
When it comes to prognostication, CNNs can utilise not only imaging data but also incorporate other clinical variables to predict patient outcomes. By analysing a combination of imaging features, clinical data, and relevant biomarkers, CNNs can generate personalised prognostic models that provide valuable insights into disease progression, treatment response, and overall survival66. Lobato-Delgado B, Priego-Torres B, Sanchez-Morillo D. Combining molecular, imaging, and clinical data analysis for predicting cancer prognosis. Cancers (Basel). 2022;14:3215. doi:10.3390/cancers14133215.
https://doi.org/10.3390/cancers14133215...
. These models can aid clinicians in making informed decisions about treatment strategies, identifying patients at higher risk, and selecting appropriate therapeutic interventions. This commentary highlights the challenges associated with prognostication in PDAC and emphasises the urgent need for more accurate and reliable prognostic indicators.
CHALLENGES ASSOCIATED WITH PROGNOSTICATION IN PDAC
Limitations of traditional prognostic factors
Traditional prognostic factors in PDAC have certain limitations that hinder their accuracy and reliability. These factors often fail to capture the complex biology and heterogeneity of PDAC, leading to limited prognostic accuracy. Associated limitations include:
Tumour stage and size: traditional staging systems, such as the TNM classification, rely on tumour size and extent of local invasion. However, these factors alone fail to capture the complex biology and heterogeneity of PDAC, resulting in limited prognostic accuracy77. Cong L, Liu Q, Zhang R, Cui M, Zhang X, Gao X, et al. Tumor size classification of the 8th edition of TNM staging system is superior to that of the 7th edition in predicting the survival outcome of pancreatic cancer patients after radical resection and adjuvant chemotherapy. Sci Rep. 2018;8:10383. doi:10.1038/s41598-018-28193-4.
https://doi.org/10.1038/s41598-018-28193...
.
Histopathological features: histological parameters, including tumour grade and histological subtype, provide important prognostic information but may not fully reflect the aggressive nature of PDAC. Additionally, inter-observer variability in histopathological interpretation poses challenges in standardising prognostic assessment88. Liu Q, Zhang J, Jiang M, Zhang Y, Chen T, Zhang J, et al. Evaluating the histopathology of pancreatic ductal adenocarcinoma by intravoxel incoherent motion-diffusion weighted imaging comparing with diffusion-weighted imaging. Front Oncol. 2021;11:670085. doi:10.3389/fonc.2021.670085.
https://doi.org/10.3389/fonc.2021.670085...
.
Serum biomarkers: several serum biomarkers, such as CA 19-9, have been used as prognostic indicators in PDAC. However, their utility is limited by variability in expression levels among patients and their inability to reliably predict individual patient outcomes99. Azizian A, Rühlmann F, Krause T, Bernhardt M, Jo P, König A, et al. CA19-9 for detecting recurrence of pancreatic cancer. Sci Rep. 2020;10:1332. doi:10.1038/s41598-020-57930-x.
https://doi.org/10.1038/s41598-020-57930...
.
Incomplete representation of patient characteristics: traditional prognostic factors may not fully consider individual patient characteristics, such as age, comorbidities, performance status, and treatment response. These factors can significantly influence prognosis and treatment outcomes, but their integration into traditional prognostic models is often limited1010. Kriegsmann M, Kriegsmann K, Steinbuss G, Zgorzelski C, Kraft A, Gaida MM. Deep learning in pancreatic tissue: Identification of anatomical structures, pancreatic intraepithelial neoplasia, and ductal adenocarcinoma. Int J Mol Sci. 2021;22:5385. doi:10.3390/ijms22105385.
https://doi.org/10.3390/ijms22105385...
.
Limitations of scoring systems
Scoring systems commonly used for prognostication in PDAC have their own limitations that affect their predictive power. These scoring systems often rely on a limited set of clinical and pathological parameters, which may not fully capture the complexities and nuances of the disease. Associated limitations include:
AJCC staging system: While the American Joint Committee on Cancer (AJCC) staging system is widely used for PDAC prognostication, it has limitations in capturing the heterogeneity of the disease and providing personalised prognostic information1111. Nagaria TS, Wang H. Modification of the 8th AJCC staging system of pancreatic ductal adenocarcinoma. Hepatobiliary Surg Nutr. 2020;9(1):95-97. doi:10.21037/hbsn.2019.08.01
https://doi.org/10.21037/hbsn.2019.08.01...
.
Charlson Comorbidity Index (CCI): CCI is commonly used to assess comorbidities and predict overall survival in PDAC. However, it may not adequately account for the unique challenges and complexities associated with this aggressive malignancy1212. Gulla A, Hashimoto D, Wagner D, Damaseviciute R, Strupas K, Satoi S. Interdisciplinary approach of establishing PDAC resectability: Biochemical, radiological and NAT regimen prognostic factors-literature review. Medicina (Kaunas). 2022;58:756. doi:10.3390/medicina58060756.
https://doi.org/10.3390/medicina58060756...
.
Performance status scales: performance status scales, such as the Eastern Cooperative Oncology Group (ECOG) performance status, are often used to evaluate patients’ functional status. However, they may not fully capture the impact of PDAC-related symptoms and overall prognosis1313. Sohal DPS, Kennedy EB, Khorana A, Copur MS, Crane CH, Garrido-Laguna I, et al. Metastatic pancreatic cancer: ASCO clinical practice guideline update. J Clin Oncol. 2018;36:2545-56. doi:10.1200/JCO.2018.78.9636.
https://doi.org/10.1200/JCO.2018.78.9636...
.
The need for more accurate and reliable prognostic indicators
Despite advancements in prognostic tools and scoring systems, there is a pressing need for more accurate and reliable prognostic indicators in PDAC. The limitations of traditional factors and scoring systems underscore the necessity for improved prognostic approaches. The need for more accurate and reliable prognostic indicators in PDAC is driven by the following factors:
Enhanced risk stratification: PDAC is characterised by significant heterogeneity, both in terms of tumour biology and patient outcomes. More accurate prognostic indicators can help stratify patients into distinct risk groups, enabling personalised treatment strategies and improved clinical decision-making1414. Ju J, Wismans LV, Mustafa DAM, Reinders MJT, van Eijck CHJ, Stubbs AP, et al. Robust deep learning model for prognostic stratification of pancreatic ductal adenocarcinoma patients. iScience. 2021;24:103415. doi:10.1016/j.isci.2021.103415.
https://doi.org/10.1016/j.isci.2021.1034...
.
Prediction of treatment response: reliable prognostic indicators can aid in predicting individual patient responses to specific treatment modalities. This can assist clinicians in tailoring therapies to maximise treatment efficacy and minimise unnecessary interventions for patients who are unlikely to benefit1515. Ahmed H, Shedeed HA, Hamad S, Hussein AS. Convolutional neural network for cancer treatment response prediction. In: 2022 18th International Computer Engineering Conference (ICENCO). Vol 1. IEEE; 2022:14-8..
Facilitating clinical trial design: accurate prognostic indicators are crucial in the design of clinical trials, especially for identifying patient subgroups that are more likely to respond to investigational therapies. Such indicators can help optimise trial enrolment and improve the chances of successful outcomes1616. Hasenstab KA, Tabalon J, Yuan N, Retson T, Hsiao A. CNN-based Deformable Registration facilitates fast and accurate air trapping measurements at inspiratory and expiratory CT. Radiol Artif Intell. 2022;4:e210211. doi:10.1148/ryai.2021210211.
https://doi.org/10.1148/ryai.2021210211...
.
Patient counselling and support: prognostic information plays a crucial role in patient counselling and shared decision-making. More accurate prognostic indicators can provide patients and their families with a clearer understanding of their disease trajectory, enabling them to make informed choices regarding treatment options, supportive care, and end-of-life planning1717. Beesley VL, Turner J, Chan RJ, Yates P, Gordon LG, Burge M, et al. Supporting patients and carers affected by pancreatic cancer: A feasibility study of a counselling intervention. Eur J Oncol Nurs. 2020;46:101729. doi:10.1016/j.ejon.2020.101729.
https://doi.org/10.1016/j.ejon.2020.1017...
.
Advancing precision medicine: precision medicine aims to deliver tailored therapies based on individual patient characteristics. Improved prognostic indicators can contribute to the development of precision medicine approaches in PDAC, allowing for targeted treatments and improved patient outcomes33. Adamska A, Domenichini A, Falasca M. Pancreatic ductal adenocarcinoma: Current and evolving therapies. Int J Mol Sci. 2017;18. doi:10.3390/ijms18071338.
https://doi.org/10.3390/ijms18071338...
.
Role of CNNs in PDAC prognostication
CNNs have emerged as powerful tools in medical image analysis and have shown promise in improving prognostication in PDAC. CNNs are deep learning algorithms specifically designed for analysing visual data, such as medical images, by automatically learning hierarchical representations and patterns. CNNs have several key features that make them suitable for prognostication in PDAC:
Feature extraction: CNNs excel at automatically extracting relevant features from medical images, capturing both local and global patterns. This capability is particularly valuable in PDAC, where tumour characteristics and their spatial distribution play a crucial role in prognosis1818. Ziegelmayer S, Kaissis G, Harder F, Jungmann F, Müller T, Makowski M, et al. Deep convolutional neural network-assisted feature extraction for diagnostic discrimination and feature visualization in pancreatic ductal adenocarcinoma (PDAC) versus autoimmune pancreatitis (AIP). J Clin Med. 2020;9:4013. doi:10.3390/jcm9124013.
https://doi.org/10.3390/jcm9124013...
.
Nonlinear mapping: CNNs can capture complex nonlinear relationships between image features and clinical outcomes, which traditional prognostic factors may overlook. This nonlinear mapping ability allows for a more comprehensive and accurate assessment of prognostic information1616. Hasenstab KA, Tabalon J, Yuan N, Retson T, Hsiao A. CNN-based Deformable Registration facilitates fast and accurate air trapping measurements at inspiratory and expiratory CT. Radiol Artif Intell. 2022;4:e210211. doi:10.1148/ryai.2021210211.
https://doi.org/10.1148/ryai.2021210211...
.
Scalability and generalisability: CNNs can be trained on large datasets, enabling the analysis of diverse patient populations and accounting for the heterogeneity of PDAC. Once trained, CNN models can generalise their learning to new cases, facilitating the application of prognostic models in clinical practice44. Sarvamangala DR, Kulkarni RV. Convolutional neural networks in medical image understanding: a survey. Evol Intell. 2022;15:1-22. doi:10.1007/s12065-020-00540-3.
https://doi.org/10.1007/s12065-020-00540...
.
In a recent study by Liu et al., the diagnostic performance of CNNs in detecting pancreatic cancer on computed tomography (CT) imaging was evaluated1919. Hayashi H, Uemura N, Matsumura K, Zhao L, Sato H, Shiraishi Y, et al. Recent advances in artificial intelligence for pancreatic ductal adenocarcinoma. World J Gastroenterol. 2021;27:7480-96. doi:10.3748/wjg.v27.i43.7480.
https://doi.org/10.3748/wjg.v27.i43.7480...
. The findings demonstrated promising results for CNN-based analysis. In the local test sets, the CNN achieved high sensitivity, specificity, and accuracy, with an area under the curve (AUC) close to 1. The CNN outperformed radiologists in terms of sensitivity, particularly for tumours smaller than 2 cm. Notably, the CNN correctly classified the majority of pancreatic cancers missed by radiologists.
Ma et al., utilised a dataset of CT images obtained from patients with pathologically confirmed pancreatic cancer and patients with normal pancreas2020. Ma H, Liu ZX, Zhang JJ, Xu CF, Shen Z, Yu CH, et al. Construction of a convolutional neural network classifier developed by computed tomography images for pancreatic cancer diagnosis. World J Gastroenterol . 2020;26:5156-68. doi:10.3748/wjg.v26.i34.5156.
https://doi.org/10.3748/wjg.v26.i34.5156...
. The approach was evaluated using binary classification (cancer or not) and ternary classification (no cancer, cancer at tail/body, cancer at head/neck). The overall diagnostic accuracy of the binary classifier was high, ranging from 95.15% to 95.76%, across the different image phases. The sensitivity scores were also favorable, with no significant differences among the phases. The plain phase showed comparable sensitivity, easier accessibility, and lower radiation compared to the arterial and venous phases, making it more suitable for the binary classifier. Furthermore, the CNN classifier achieved higher accuracies than trainee gastroenterologists on plain scan diagnosis. Although there was no significant difference between the CNN and board-certified gastroenterologists, the CNN’s performance suggests its potential as a reliable diagnostic tool. In the ternary classifier, the CNN achieved satisfactory diagnostic accuracy across the image phases. The sensitivity scores for detecting cancers in the tail and head varied among the phases, with the arterial phase demonstrating the highest sensitivity for cancers in the head.
Similarly, Tonozuka et al., conducted a study aiming to develop a computer-assisted diagnosis (CAD) system using deep learning analysis of endoscopic ultrasound (EUS) images for the detection of PDAC2121. Tonozuka R, Itoi T, Nagata N, Kojima H, Sofuni A, Tsuchiya T, et al. Deep learning analysis for the detection of pancreatic cancer on endosonographic images: a pilot study. J Hepatobiliary Pancreat Sci. 2021;28:95-104. doi:10.1002/jhbp.825.
https://doi.org/10.1002/jhbp.825...
. The results demonstrated the efficacy of the EUS-CAD system for detecting PDAC. The areas under the receiver operating characteristic curve were 0.924 and 0.940 in the validation and test settings, respectively, indicating good discriminative ability. In the analysis of misdirection, no factors were identified on univariate analysis among PDAC cases. However, in non-PDAC cases, mass formation was found to be associated with over-diagnosis of tumors on multivariate analysis. The findings from Tonozuka et al. pilot study highlight the potential of the EUS-CAD system for PDAC detection. The deep learning-based CAD system achieved high accuracy in distinguishing PDAC from control images, including those from patients with chronic pancreatitis and normal pancreas. This technology has the potential to assist endoscopists in early detection and diagnosis of PDAC, enabling timely intervention and improved patient outcomes.
The application of CNNs and deep learning techniques in pancreatic cancer detection shows great promise. These studies highlight the potential for these technologies to assist in early detection, improve diagnostic accuracy, and ultimately contribute to better patient outcomes. However, further research is needed to address the limitations and challenges associated with these approaches, such as dataset biases, model interpretability, and real-world implementation.
ADVANTAGES AND LIMITATIONS OF CNNs AS PROGNOSTIC MODELS
Advantages of CNNs as prognostic indicators:
Ability to capture complex patterns: CNNs excel at capturing intricate patterns and features in images, including medical images. They can automatically learn and extract relevant features from input data, allowing them to identify subtle details and relationships that may not be easily discernible to human observers. This capability makes CNNs well-suited for analysing complex medical images, such as CT scans or histopathological slides1616. Hasenstab KA, Tabalon J, Yuan N, Retson T, Hsiao A. CNN-based Deformable Registration facilitates fast and accurate air trapping measurements at inspiratory and expiratory CT. Radiol Artif Intell. 2022;4:e210211. doi:10.1148/ryai.2021210211.
https://doi.org/10.1148/ryai.2021210211...
.
Improved accuracy and reliability: CNNs have demonstrated superior accuracy and reliability compared to traditional prognostic tools in various medical applications. Their ability to analyse large amounts of data and extract meaningful information leads to more precise and consistent predictions. By leveraging deep learning algorithms, CNNs can identify and consider a broader range of prognostic factors, potentially leading to more accurate prognostic assessments2222. Alzubaidi L, Zhang J, Humaidi AJ, Al-Dujaili A, Duan Y, Al-Shamma O, et al. Review of deep learning: concepts, CNN architectures, challenges, applications, future directions. J Big Data. 2021;8:53. doi:10.1186/s40537-021-00444-8.
https://doi.org/10.1186/s40537-021-00444...
.
Reduced subjectivity: traditional prognostic tools often rely on manual interpretation and subjective judgment, which can introduce variability and bias. In contrast, CNNs provide an objective and standardised approach to prognostication. They follow predefined algorithms and rules, reducing the influence of personal interpretations and increasing the reproducibility of results44. Sarvamangala DR, Kulkarni RV. Convolutional neural networks in medical image understanding: a survey. Evol Intell. 2022;15:1-22. doi:10.1007/s12065-020-00540-3.
https://doi.org/10.1007/s12065-020-00540...
.
Scalability and efficiency: once trained, CNNs can analyse large volumes of data rapidly, making them scalable for high-throughput analysis. This efficiency is particularly advantageous when dealing with large datasets or time-sensitive prognostic assessments. CNNs can process images and generate prognostic predictions in a timely manner, potentially improving patient care and treatment decision-making2323. Maharana K, Mondal S, Nemade B. A review: Data pre-processing and data augmentation techniques. Global Transitions Proceedings. 2022;3:91-9. doi:10.1016/j.gltp.2022.04.020.
https://doi.org/10.1016/j.gltp.2022.04.0...
.
Adaptability and continuous learning: CNNs have the ability to continuously learn and adapt based on new data. As more patient data becomes available, the CNN model can be updated and refined, incorporating the latest knowledge and improving its prognostic capabilities over time. This adaptability is crucial in the rapidly evolving field of medicine, where new prognostic factors and biomarkers are constantly being discovered1616. Hasenstab KA, Tabalon J, Yuan N, Retson T, Hsiao A. CNN-based Deformable Registration facilitates fast and accurate air trapping measurements at inspiratory and expiratory CT. Radiol Artif Intell. 2022;4:e210211. doi:10.1148/ryai.2021210211.
https://doi.org/10.1148/ryai.2021210211...
,2323. Maharana K, Mondal S, Nemade B. A review: Data pre-processing and data augmentation techniques. Global Transitions Proceedings. 2022;3:91-9. doi:10.1016/j.gltp.2022.04.020.
https://doi.org/10.1016/j.gltp.2022.04.0...
.
Limitations and challenges in implementing CNNs in clinical practice:
Data availability and quality: CNNs require large amounts of high-quality labeled data for training. However, obtaining such datasets, especially for rare diseases or specific subtypes, can be challenging. The availability of comprehensive and diverse datasets is crucial for developing accurate and reliable prognostic CNN models.
Interpretability and explainability: CNNs are often considered black-box models, meaning that their decision-making process is not easily interpretable or explainable. Understanding the underlying reasons for the CNN’s predictions can be difficult, which may limit their acceptance and trust in clinical settings. Efforts are underway to develop techniques for interpreting and explaining CNN decisions, which would enhance their clinical utility2020. Ma H, Liu ZX, Zhang JJ, Xu CF, Shen Z, Yu CH, et al. Construction of a convolutional neural network classifier developed by computed tomography images for pancreatic cancer diagnosis. World J Gastroenterol . 2020;26:5156-68. doi:10.3748/wjg.v26.i34.5156.
https://doi.org/10.3748/wjg.v26.i34.5156...
.
Generalisability: CNNs trained on specific datasets may exhibit limitations in generalising their predictions to new or different patient populations. The performance of CNN models may vary across different imaging modalities, institutions, or demographic groups. Validation on diverse datasets and populations is essential to ensure the generalisability of CNN-based prognostic models.
Integration into clinical workflows: incorporating CNN-based prognostic tools into routine clinical workflows presents practical challenges. Integration with existing electronic health record systems, data management, and interoperability need to be considered. Clinician acceptance, training, and understanding of the limitations and appropriate use of CNN-based prognostic tools are also critical factors.
Ethical and legal considerations: the use of CNNs in clinical practice raises ethical and legal concerns related to patient privacy, data security, and potential biases in the data or algorithmic decision-making. Ensuring data privacy, informed consent, transparency, and addressing biases are crucial aspects that need to be carefully managed.
FUTURE DIRECTIONS AND IMPLICATIONS
Opportunities for future research:
Multi-center studies: conducting multi-centre studies with larger and more diverse patient cohorts can enhance the generalisability and robustness of CNN-based prognostic models. Collaborative efforts involving multiple institutions and international collaborations can provide more comprehensive insights into the performance and applicability of these models across different populations and healthcare settings.
Prospective studies: prospective studies are needed to validate the performance of CNN-based prognostic models in real-time clinical practice. Prospective data collection allows for the evaluation of the models’ effectiveness in guiding treatment decisions, monitoring patient outcomes, and assessing their impact on patient management and overall healthcare outcomes.
Longitudinal studies: longitudinal studies can provide valuable insights into the temporal dynamics of prognostic indicators. By analysing sequential imaging data or serial biomarker measurements over time, CNN-based models can potentially capture disease progression, treatment response, and long-term prognostic trends, allowing for more personalised and dynamic prognostication.
External validation and comparison studies: it is crucial to externally validate CNN-based prognostic models on independent datasets from different populations and clinical settings. Comparing the performance of CNN models with established prognostic tools and incorporating them into existing prognostic algorithms can help assess their incremental value and potential integration into clinical practice2424. Oliveira E Carmo L, van den Merkhof A, Olczak J, Gordon M, Jutte PC, Jaarsma RL et al. An increasing number of convolutional neural networks for fracture recognition and classification in orthopaedics: are these externally validated and ready for clinical application? Bone Jt Open. 2021;2:879-885. doi:10.1302/2633-1462.210.BJO-2021-0133.
https://doi.org/10.1302/2633-1462.210.BJ...
.
Integration of CNNs with other clinical and molecular factors:
Multi-modal data fusion: integrating CNN-based image analysis with other clinical data, such as patient demographics, clinical history, laboratory results, and genetic/molecular information, can enhance the accuracy and comprehensive nature of prognostic models. Combining multiple data modalities may provide a more holistic understanding of disease prognosis and enable personalised prognostication.
Fusion of CNN outputs with biomarker panels: CNN-based image analysis can be combined with molecular biomarker panels to develop composite prognostic models. By integrating imaging features captured by CNNs with genetic, proteomic, or transcriptomic markers, more accurate and comprehensive prognostic assessments can be achieved, potentially leading to personalised treatment strategies2525. Ganguly S, Bhowal P, Oliva D, Sarkar R. BLeafNet: A Bonferroni mean operator based fusion of CNN models for plant identification using leaf image classification. Ecol Inform. 2022;69:101585. doi:10.1016/j.ecoinf.2022.101585.
https://doi.org/10.1016/j.ecoinf.2022.10...
.
Ethical considerations and potential pitfalls of relying solely on CNN-based prognostication:
Bias and fairness: CNNs are susceptible to biases present in the training data, which may lead to biased predictions and unequal treatment recommendations. Care should be taken to address and mitigate biases related to demographics, race, gender, or socioeconomic factors. Regular monitoring and evaluation of the model’s fairness and bias should be conducted to ensure equitable and unbiased prognostication.
Lack of human expertise: relying solely on CNN-based prognostication may overlook the valuable clinical expertise and judgment of healthcare professionals. Human interpretation and clinical context are essential for understanding the individual patient’s unique circumstances, considering comorbidities, and making informed treatment decisions. CNN-based models should be used as decision support tools, augmenting rather than replacing human expertise.
Patient autonomy and informed consent: patients should be adequately informed about the utilization of CNN-based prognostic models and their implications. Transparency in the limitations, uncertainties, and potential risks of using these models should be ensured. Respecting patient autonomy and preferences is crucial, and decisions should be made collaboratively between healthcare professionals and patients, taking into account individual values and preferences.
Legal and regulatory considerations: implementation of CNN-based prognostic models in clinical practice necessitates compliance with relevant legal and regulatory frameworks. Data privacy, security, and compliance with regulations governing medical device usage should be carefully addressed. Ethical guidelines and standards specific to the development, deployment, and maintenance of AI-based prognostic models should be adhered to.
CONCLUSION
In conclusion, the use of CNNs as prognostic indicators in PDAC shows great promise. CNNs offer advantages over traditional tools by accurately distinguishing pancreatic cancer from benign tissue in CT images and providing objective assessments of tumor characteristics and prognosis. However, challenges remain, and further research is needed to validate and optimize CNN-based prognostic models, ensuring their reliability across diverse patient populations. Integrating CNNs with other clinical and molecular factors could enhance prognostication accuracy and personalization. Ethical considerations surrounding data privacy and responsible AI use must be addressed. Despite these challenges, CNNs have the potential to revolutionise PDAC prognostication, leading to improved patient outcomes and more effective treatment strategies.
REFERENCES
-
1Orth M, Metzger P, Gerum S, Mayerle J, Schneider G, Belka C, et al. Pancreatic ductal adenocarcinoma: biological hallmarks, current status, and future perspectives of combined modality treatment approaches. Radiat Oncol. 2019;14:141. doi:10.1186/s13014-019-1345-6.
» https://doi.org/10.1186/s13014-019-1345-6 -
2Sarantis P, Koustas E, Papadimitropoulou A, Papavassiliou AG, Karamouzis MV. Pancreatic ductal adenocarcinoma: Treatment hurdles, tumor microenvironment and immunotherapy. World J Gastrointest Oncol. 2020;12:173-81. doi:10.4251/wjgo.v12.i2.173.
» https://doi.org/10.4251/wjgo.v12.i2.173 -
3Adamska A, Domenichini A, Falasca M. Pancreatic ductal adenocarcinoma: Current and evolving therapies. Int J Mol Sci. 2017;18. doi:10.3390/ijms18071338.
» https://doi.org/10.3390/ijms18071338 -
4Sarvamangala DR, Kulkarni RV. Convolutional neural networks in medical image understanding: a survey. Evol Intell. 2022;15:1-22. doi:10.1007/s12065-020-00540-3.
» https://doi.org/10.1007/s12065-020-00540-3 -
5Huang B, Huang H, Zhang S, Zhang D, Shi Q, Liu J, et al. Artificial intelligence in pancreatic cancer. Theranostics. 2022;12:6931-54. doi:10.7150/thno.77949.
» https://doi.org/10.7150/thno.77949 -
6Lobato-Delgado B, Priego-Torres B, Sanchez-Morillo D. Combining molecular, imaging, and clinical data analysis for predicting cancer prognosis. Cancers (Basel). 2022;14:3215. doi:10.3390/cancers14133215.
» https://doi.org/10.3390/cancers14133215 -
7Cong L, Liu Q, Zhang R, Cui M, Zhang X, Gao X, et al. Tumor size classification of the 8th edition of TNM staging system is superior to that of the 7th edition in predicting the survival outcome of pancreatic cancer patients after radical resection and adjuvant chemotherapy. Sci Rep. 2018;8:10383. doi:10.1038/s41598-018-28193-4.
» https://doi.org/10.1038/s41598-018-28193-4 -
8Liu Q, Zhang J, Jiang M, Zhang Y, Chen T, Zhang J, et al. Evaluating the histopathology of pancreatic ductal adenocarcinoma by intravoxel incoherent motion-diffusion weighted imaging comparing with diffusion-weighted imaging. Front Oncol. 2021;11:670085. doi:10.3389/fonc.2021.670085.
» https://doi.org/10.3389/fonc.2021.670085 -
9Azizian A, Rühlmann F, Krause T, Bernhardt M, Jo P, König A, et al. CA19-9 for detecting recurrence of pancreatic cancer. Sci Rep. 2020;10:1332. doi:10.1038/s41598-020-57930-x.
» https://doi.org/10.1038/s41598-020-57930-x -
10Kriegsmann M, Kriegsmann K, Steinbuss G, Zgorzelski C, Kraft A, Gaida MM. Deep learning in pancreatic tissue: Identification of anatomical structures, pancreatic intraepithelial neoplasia, and ductal adenocarcinoma. Int J Mol Sci. 2021;22:5385. doi:10.3390/ijms22105385.
» https://doi.org/10.3390/ijms22105385 -
11Nagaria TS, Wang H. Modification of the 8th AJCC staging system of pancreatic ductal adenocarcinoma. Hepatobiliary Surg Nutr. 2020;9(1):95-97. doi:10.21037/hbsn.2019.08.01
» https://doi.org/10.21037/hbsn.2019.08.01 -
12Gulla A, Hashimoto D, Wagner D, Damaseviciute R, Strupas K, Satoi S. Interdisciplinary approach of establishing PDAC resectability: Biochemical, radiological and NAT regimen prognostic factors-literature review. Medicina (Kaunas). 2022;58:756. doi:10.3390/medicina58060756.
» https://doi.org/10.3390/medicina58060756 -
13Sohal DPS, Kennedy EB, Khorana A, Copur MS, Crane CH, Garrido-Laguna I, et al. Metastatic pancreatic cancer: ASCO clinical practice guideline update. J Clin Oncol. 2018;36:2545-56. doi:10.1200/JCO.2018.78.9636.
» https://doi.org/10.1200/JCO.2018.78.9636 -
14Ju J, Wismans LV, Mustafa DAM, Reinders MJT, van Eijck CHJ, Stubbs AP, et al. Robust deep learning model for prognostic stratification of pancreatic ductal adenocarcinoma patients. iScience. 2021;24:103415. doi:10.1016/j.isci.2021.103415.
» https://doi.org/10.1016/j.isci.2021.103415 -
15Ahmed H, Shedeed HA, Hamad S, Hussein AS. Convolutional neural network for cancer treatment response prediction. In: 2022 18th International Computer Engineering Conference (ICENCO). Vol 1. IEEE; 2022:14-8.
-
16Hasenstab KA, Tabalon J, Yuan N, Retson T, Hsiao A. CNN-based Deformable Registration facilitates fast and accurate air trapping measurements at inspiratory and expiratory CT. Radiol Artif Intell. 2022;4:e210211. doi:10.1148/ryai.2021210211.
» https://doi.org/10.1148/ryai.2021210211 -
17Beesley VL, Turner J, Chan RJ, Yates P, Gordon LG, Burge M, et al. Supporting patients and carers affected by pancreatic cancer: A feasibility study of a counselling intervention. Eur J Oncol Nurs. 2020;46:101729. doi:10.1016/j.ejon.2020.101729.
» https://doi.org/10.1016/j.ejon.2020.101729 -
18Ziegelmayer S, Kaissis G, Harder F, Jungmann F, Müller T, Makowski M, et al. Deep convolutional neural network-assisted feature extraction for diagnostic discrimination and feature visualization in pancreatic ductal adenocarcinoma (PDAC) versus autoimmune pancreatitis (AIP). J Clin Med. 2020;9:4013. doi:10.3390/jcm9124013.
» https://doi.org/10.3390/jcm9124013 -
19Hayashi H, Uemura N, Matsumura K, Zhao L, Sato H, Shiraishi Y, et al. Recent advances in artificial intelligence for pancreatic ductal adenocarcinoma. World J Gastroenterol. 2021;27:7480-96. doi:10.3748/wjg.v27.i43.7480.
» https://doi.org/10.3748/wjg.v27.i43.7480 -
20Ma H, Liu ZX, Zhang JJ, Xu CF, Shen Z, Yu CH, et al. Construction of a convolutional neural network classifier developed by computed tomography images for pancreatic cancer diagnosis. World J Gastroenterol . 2020;26:5156-68. doi:10.3748/wjg.v26.i34.5156.
» https://doi.org/10.3748/wjg.v26.i34.5156 -
21Tonozuka R, Itoi T, Nagata N, Kojima H, Sofuni A, Tsuchiya T, et al. Deep learning analysis for the detection of pancreatic cancer on endosonographic images: a pilot study. J Hepatobiliary Pancreat Sci. 2021;28:95-104. doi:10.1002/jhbp.825.
» https://doi.org/10.1002/jhbp.825 -
22Alzubaidi L, Zhang J, Humaidi AJ, Al-Dujaili A, Duan Y, Al-Shamma O, et al. Review of deep learning: concepts, CNN architectures, challenges, applications, future directions. J Big Data. 2021;8:53. doi:10.1186/s40537-021-00444-8.
» https://doi.org/10.1186/s40537-021-00444-8 -
23Maharana K, Mondal S, Nemade B. A review: Data pre-processing and data augmentation techniques. Global Transitions Proceedings. 2022;3:91-9. doi:10.1016/j.gltp.2022.04.020.
» https://doi.org/10.1016/j.gltp.2022.04.020 -
24Oliveira E Carmo L, van den Merkhof A, Olczak J, Gordon M, Jutte PC, Jaarsma RL et al. An increasing number of convolutional neural networks for fracture recognition and classification in orthopaedics: are these externally validated and ready for clinical application? Bone Jt Open. 2021;2:879-885. doi:10.1302/2633-1462.210.BJO-2021-0133.
» https://doi.org/10.1302/2633-1462.210.BJO-2021-0133 -
25Ganguly S, Bhowal P, Oliva D, Sarkar R. BLeafNet: A Bonferroni mean operator based fusion of CNN models for plant identification using leaf image classification. Ecol Inform. 2022;69:101585. doi:10.1016/j.ecoinf.2022.101585.
» https://doi.org/10.1016/j.ecoinf.2022.101585
-
Disclosure of funding: no funding received
-
Declaration of use of artificial intelligence: none
Publication Dates
-
Publication in this collection
15 Mar 2024 -
Date of issue
2024
History
-
Received
15 Aug 2023 -
Accepted
07 Feb 2024 -
Corrected
20 Apr 2024