Classification of Pulmonary Diseases Using a Deep Learning Stacking Ensemble Model

Ruaa Sadoon, Adala Chaid

Abstract


This paper presents our research in the area of medical imaging diagnostics, focusing specifically on countering the devastating impact of the COVID-19 pandemic and numerous pulmonary pathologies. Using new deep-learning approaches and techniques, we aim to create an advanced classification tool that will be able to capture complex patterns and features in chest image data. This paper introduces the use of state-of-the-art strategies, such as stacked ensemble models, transfer learning, and artificial neural networks, to build a model with unprecedented precision, recall, F1-score, and accuracy. The core idea of our research is to combine different convolutional neural network architectures to bring together their best extraction and classification qualities. The combination of DenseNet, Xception and Inception achieves the best performance and provides the most reliable classification tool. We also use transfer learning to quickly train our model and optimize generalization, making it suitable for the detection of multiple pulmonary pathologies, including COVID-19. Our model also includes an artificial neural network, trained as a meta-learner, which processes the outputs of the CNNs to make classification decisions. We have thoroughly validated and optimized the meng-learner to improve the model’s accuracy on diagnostic images. The provided paper proposed the successful merge of cutting-edge deep-learning methodologies and image-processing algorithms with the medical imaging industry’s specifics. We aim to disrupt the pulmonary disease diagnosis field with our model, offering medical institutions a reliable tool to fight the current and future threats and challenges posed by COVID-19.


Full Text:

PDF

References


Ciotti, M., Ciccozzi, M., Terrinoni, A., Jiang, W. C., Wang, C. B., & Bernardini, S. (2020). The COVID-19 pandemic. Critical reviews in clinical laboratory sciences, 57(6), 365-388.

Wilson, N., Corbett, S., & Tovey, E. (2020). Airborne transmission of covid-19. bmj, 370.

Kevadiya, B. D., Machhi, J., Herskovitz, J., Oleynikov, M. D., Blomberg, W. R., Bajwa, N., ... & Gendelman, H. E. (2021). Diagnostics for SARS-CoV-2 infections. Nature materials, 20(5), 593-605.

Gnanvi, J. E., Salako, K. V., Kotanmi, G. B., & Kakaï, R. G. (2021). On the reliability of predictions on Covid-19 dynamics: A systematic and critical review of modelling techniques. Infectious Disease Modelling, 6, 258-272.

Johnson, K. D., Harris, C., Cain, J. K., Hummer, C., Goyal, H., & Perisetti, A. (2020). Pulmonary and extra-pulmonary clinical manifestations of COVID-19. Frontiers in medicine, 7, 526.

Marginean, C. M., Popescu, M., Vasile, C. M., Cioboata, R., Mitrut, P., Popescu, I. A. S., ... & Neagoe, D. (2022). Challenges in the differential diagnosis of COVID-19 pneumonia: a pictorial review. Diagnostics, 12(11), 2823.

Bhatnagar, R., & Maskell, N. (2015). The modern diagnosis and management of pleural effusions. bmj, 351.

Chen, C. H., Chang, C. K., Tu, C. Y., Liao, W. C., Wu, B. R., Chou, K. T., ... & Huang, T. C. (2018). Radiomic features analysis in computed tomography images of lung nodule classification. PloS one, 13(2), e0192002.

Hussain, A., Noorani, A., Deshpande, R., John, L., Baghai, M., Wendler, O., ... & Khan, H. (2020). Management of pneumothorax in mechanically ventilated COVID-19 patients: early experience.

Interactive CardioVascular and Thoracic Surgery, 31(4), 540-543.

Abdulahi, A. T., Ogundokun, R. O., Adenike, A. R., Shah, M. A., & Ahmed, Y. K. (2024). PulmoNet: a novel deep learning based pulmonary diseases detection model. BMC Medical Imaging, 24(1), 51.

Elharrouss, O., Akbari, Y., Almaadeed, N., & Al-Maadeed, S. (2022). Backbones-review: Feature extraction networks for deep learning and deep reinforcement learning approaches. arXiv preprint arXiv:2206.08016.

Miotto, R., Wang, F., Wang, S., Jiang, X., & Dudley, J. T. (2018). Deep learning for healthcare: review, opportunities and challenges. Briefings in bioinformatics, 19(6), 1236-1246.

Nguyen, T. M., Kim, N., Kim, D. H., Le, H. L., Piran, M. J., Um, S. J., & Kim, J. H. (2021). Deep learning for human disease detection, subtype classification, and treatment response prediction using epigenomic data. Biomedicines, 9(11), 1733.

Aslan, M. F., Sabanci, K., Durdu, A., & Unlersen, M. F. (2022). COVID-19 diagnosis using state-of-the-art CNN architecture features and Bayesian Optimization. Computers in biology and medicine, 142, 105244.

Fatani, A., Dahou, A., Al-Qaness, M. A., Lu, S., & Elaziz, M. A. (2021). Advanced feature extraction and selection approach using deep learning and Aquila optimizer for IoT intrusion detection system. Sensors, 22(1), 140.

Elharrouss, O., Akbari, Y., Almaadeed, N., & Al-Maadeed, S. (2022). Backbones-review: Feature extraction networks for deep learning and deep reinforcement learning approaches. arXiv preprint arXiv:2206.08016.

Akinyelu, A. A., & Blignaut, P. (2022). COVID-19 diagnosis using deep learning neural networks applied to CT images. Frontiers in Artificial Intelligence, 5, 919672.

Aljondi, R., & Alghamdi, S. (2020). Diagnostic value of imaging modalities for COVID-19: scoping review. Journal of medical Internet research, 22(8), e19673.

Benmalek, E., Elmhamdi, J., & Jilbab, A. (2021). Comparing CT scan and chest X-ray imaging for COVID-19 diagnosis. Biomedical Engineering Advances, 1, 100003.

Sun, J., Pi, P., Tang, C., Wang, S. H., & Zhang, Y. D. (2023). CTMLP: Can MLPs replace CNNs or transformers for COVID-19 diagnosis?. Computers in Biology and Medicine, 159, 106847.

Li, W., Paffenroth, R. C., & Berthiaume, D. (2021). Neural network ensembles: Theory, training, and the importance of explicit diversity. arXiv preprint arXiv:2109.14117.

Salehi, A. W., Khan, S., Gupta, G., Alabduallah, B. I., Almjally, A., Alsolai, H., ... & Mellit, A. (2023). A study of CNN and transfer learning in medical imaging: Advantages, challenges, future scope. Sustainability, 15(7), 5930.

Brownlee, J. (2018). Stacking ensemble for deep learning neural networks in python.

Nikolaou, V., Massaro, S., Fakhimi, M., Stergioulas, L., & Garn, W. (2021). COVID-19 diagnosis from chest x-rays: developing a simple, fast, and accurate neural network. Health information science and systems, 9, 1-11.

Hira, S., Bai, A., & Hira, S. (2021). An automatic approach based on CNN architecture to detect Covid-19 disease from chest X-ray images. Applied Intelligence, 51, 2864-2889.

AbdElhamid, A. A., AbdElhalim, E., Mohamed, M. A., & Khalifa, F. (2022). Multi-classification of chest X-rays for COVID-19 diagnosis using deep learning algorithms. Applied Sciences, 12(4), 2080.

Qian, X., Fu, H., Shi, W., Chen, T., Fu, Y., Shan, F., & Xue, X. (2020). M $^ 3$ Lung-Sys: A deep learning system for multi-class lung pneumonia screening from CT imaging. IEEE journal of biomedical and health informatics, 24(12), 3539-3550.

Nath, M. K., Kanhe, A., & Mishra, M. (2020, October). A novel deep learning approach for classification of COVID-19 images. In 2020 IEEE 5th international conference on computing communication and automation (ICCCA) (pp. 752-757). IEEE.

Islam, M. N., Alam, M. G. R., Apon, T. S., Uddin, M. Z., Allheeib, N., Menshawi, A., & Hassan, M. M. (2023, January). Interpretable differential diagnosis of non-covid viral pneumonia, lung opacity and covid-19 using tuned transfer learning and explainable ai. In Healthcare (Vol. 11, No. 3, p. 410). MDPI.




DOI: https://doi.org/10.31449/inf.v48i14.6145

Creative Commons License
This work is licensed under a Creative Commons Attribution 3.0 License.