Enhanced Medical Image Segmentation using Transfer Learning with Res101_UNet: Experimental Insights and Comparative Performance Analysis
Article Sidebar
Main Article Content
Abstract
Throughout the past few decades, artificial intelligence and machine learning have seen a lot of active research in areas such as computer vision, natural language processing, and speech processing. As a result, deep learning models became state-of-the-art for computer vision tasks such as object detection, classification, segmentation, and other allied tasks. Of course, the fruits of this research are extended to the design of robust and reliable digital health systems as well as other applications in the healthcare sector. Many clinical applications require the automatic segmentation of medical images. Recent deep learning-based approaches have demonstrated state-of-the-art performance in medical image segmentation tasks. In addition to their ability to automatically extract features and generalize over large amounts of data, transfer learning based deep learning models have proven to be handy for data scared areas like medical domains. In this research, we investigate and demonstrate the efficacy of a DCNN-based transfer learning model -Res101_Unet, which has been trained and/or fine-tuned to execute tumor tissue segmentation tasks in MRI, CT, PET, and X-RAY pictures of medical organ scans with little data. For our experimental study, we employed two image datasets: 'Liver Tumor' and 'Gland Colon Cancer', both obtained from the Kaggle portal. This experimental setup includes an Open-Source segmentation model API. Our findings indicate that domain similarity-based transfer learning can be used to data-scarce sectors. We achieved 98.47% accuracy and a IoU score of 0.9891 on Liver Tumor data and 0.6956 accuracy and a IoU score of 0.7043 on gland colon dataset.
Downloads
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
How to Cite
References
Zhang, Jing & Li, Wanqing & Ogunbona, Philip. (2017). https://www.researchgate.net/publication/316921517_Transfer_Learning_for_Cross-Dataset_Recognition_A_Survey.
Ronneberger O., Fischer P., Brox T. (2015) U-Net: Convolutional Networks for Biomedical Image Segmentation. In: Navab N., Hornegger J., Wells W., Frangi A. (eds) Medical Image Computing and Computer-Assisted Intervention – MICCAI 2015. MICCAI 2015. Lecture Notes in Computer Science, vol 9351. Springer, Cham. https://doi.org/10.1007/978-3-319-24574-4_28. https://doi.org/10.1007/978-3-319-24574-4_28
Badrinarayanan, Vijay et al. “SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation.” IEEE Transactions on Pattern Analysis and Machine Intelligence 39 (2017): 2481-2495. https://doi.org/10.1109/TPAMI.2016.2644615
Chen, Liang & Bentley, Paul & Mori, Kensaku & Misawa, Kazunari & Fujiwara, Michitaka & Rueckert, Daniel. (2018). DRINet for Medical Image Segmentation. IEEE Transactions on Medical Imaging. PP. 1-1. 10.1109/TMI.2018.2835303. https://doi.org/10.1109/TMI.2018.2835303
Krupinski, Elizabeth. (2016). Medical Imaging. 10.1007/978-3-319-14346-0_186. https://www.researchgate.net/publication/310238383_Medical_Imaging. https://doi.org/10.1117/1.JMI.3.1.011001
J. Deng, W. Dong, R. Socher, L. -J. Li, Kai Li and Li Fei-Fei, "ImageNet: A large-scale hierarchical image database," 2009 IEEE Conference on Computer Vision and Pattern Recognition, 2009, pp. 248-255, doi: 10.1109/CVPR.2009.5206848. https://doi.org/10.1109/CVPR.2009.5206848
Raghu, M., Zhang, C., Kleinberg, J.M., & Bengio, S. (2019). Transfusion: Understanding Transfer Learning for Medical Imaging. NeurIPS.
Kaggle Competitions. (n.d.). https://www.kaggle.com/competitions
3DIRCADB. (2022, February 19). Kaggle. https://www.kaggle.com/datasets/nguyenhoainam27/3dircadb
GlaS@MICCAI’2015: Gland Segmentation. (2022, June 6). Kaggle. https://www.kaggle.com/datasets/sani84/glasmiccai2015-gland-segmentation
K. He, X. Zhang, S. Ren and J. Sun, "Deep Residual Learning for Image Recognition," 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA, 2016, pp. 770-778, doi: 10.1109/CVPR.2016.90. https://doi.org/10.1109/CVPR.2016.90
Huang, H., Chen, H., Xu, H. et al. Cross-Tissue/Organ Transfer Learning for the Segmentation of Ultrasound Images Using Deep Residual U-Net. J. Med. Biol. Eng. 41, 137–145 (2021). https://doi.org/10.1007/s40846-020-00585-w
Huang, Z., Wang, H., Deng, Z., Ye, J., Su, Y., Sun, H., ... & Qiao, Y. (2023). Stu-net: Scalable and transferable medical image segmentation models empowered by large-scale supervised pre-training. arXiv preprint arXiv:2304.06716.
Hosseinzadeh Taher MR, Haghighi F, Feng R, Gotway MB, Liang J. A Systematic Benchmarking Analysis of Transfer Learning for Medical Image Analysis. Domain Adapt Represent Transf Afford Healthc AI Resour Divers Glob Health (2021). 2021 Sep-Oct;12968:3-13. doi: 10.1007/978-3-030-87722-4_1. Epub 2021 Sep 21. PMID: 35713581; PMCID: PMC9197759. https://doi.org/10.1007/978-3-030-87722-4_1
Nampalle, Kishore Babu & Uppala, Vivek & Raman, Balasubramanian. (2023). Transfer learning-based framework for image segmentation using medical images and Tversky similarity. 10.21203/rs.3.rs-2587704/v1. https://doi.org/10.21203/rs.3.rs-2587704/v1
Karimi D, Warfield SK, Gholipour A. Transfer learning in medical image segmentation: New insights from analysis of the dynamics of model parameters and learned representations. Artif Intell Med. 2021 Jun;116:102078. doi: 10.1016/j.artmed.2021.102078. Epub 2021 Apr 23. PMID: 34020754; PMCID: PMC8164174. https://doi.org/10.1016/j.artmed.2021.102078
Ghavami, A. (2023). Image segmentation using UNet architecture in Pytorch for biomedical image processing. Retrieved from arXiv preprint arXiv:2305.14841v1.
Poudel, K., Dhakal, M., Bhandari, P., Adhikari, R., Thapaliya, S., & Khanal, B. (2023). Exploring Transfer Learning in Medical Image Segmentation using Vision-Language Models. ArXiv, abs/2308.07706.
Papers with Code - Transfer Learning U-Net Deep Learning for Lung Ultrasound Segmentation. (2021, October 5). https://paperswithcode.com/paper/transfer-learning-u-net-deep-learning-for
Das, S., S, S., M, A., & Jayaram, S. (2021). Deep Learning Convolutional Neural Network for Defect Identification and Classification in Woven Fabric. In Indian Journal of Artificial Intelligence and Neural Networking (Vol. 1, Issue 2, pp. 9–13). https://doi.org/10.54105/ijainn.b1011.041221
Kanani, P., & Padole, Dr. M. (2019). Deep Learning to Detect Skin Cancer using Google Colab. In International Journal of Engineering and Advanced Technology (Vol. 8, Issue 6, pp. 2176–2183). https://doi.org/10.35940/ijeat.f8587.088619
Wanjau, S. K., Wambugu, G. M., & Oirere, A. M. (2022). Network Intrusion Detection Systems: A Systematic Literature Review of Hybrid Deep Learning Approaches. In International Journal of Emerging Science and Engineering (Vol. 10, Issue 7, pp. 1–16). https://doi.org/10.35940/ijese.f2530.0610722
Behera, D. K., Das, M., & Swetanisha, S. (2019). A Research on Collaborative Filtering Based Movie Recommendations: From Neighborhood to Deep Learning Based System. In International Journal of Recent Technology and Engineering (IJRTE) (Vol. 8, Issue 4, pp. 10809–10814). https://doi.org/10.35940/ijrte.d4362.118419
Nikam, S. S., & Dalvi, Prof. R. (2020). Fake News Detection on Social Media using Machine Learning Techniques. In International Journal of Innovative Technology and Exploring Engineering (Vol. 9, Issue 7, pp. 940–943). https://doi.org/10.35940/ijitee.g5428.059720.