OPTIMIZING ULTRASOUND IMAGE CLASSIFICATION THROUGH TRANSFER LEARNING: FINE-TUNING STRATEGIES AND CLASSIFIER IMPACT ON PRE-TRAINED INNER-LAYERS

Mohamed Bal-Ghaoui

med.balghaoui@gmail.com
Mohammed V University in Rabat, National High School of Arts and Crafts, Electrical Engineering Department, E2SN Research Laboratory (Morocco)
https://orcid.org/0000-0002-2143-6458

My Hachem El Yousfi Alaoui


Mohammed V University in Rabat, National High School of Arts and Crafts, Electrical Engineering Department, E2SN Research Laboratory (Morocco)
https://orcid.org/0000-0003-4285-0540

Abdelilah Jilbab


Mohammed V University in Rabat, National High School of Arts and Crafts, Electrical Engineering Department, E2SN Research Laboratory (Morocco)
https://orcid.org/0000-0002-1577-9040

Abdennaser Bourouhou


Mohammed V University in Rabat, National High School of Arts and Crafts, Electrical Engineering Department, E2SN Research Laboratory (Morocco)
https://orcid.org/0000-0002-6150-5374

Abstract

Transfer Learning (TL) is a popular deep learning technique used in medical image analysis, especially when data is limited. It leverages pre-trained knowledge from State-Of-The-Art (SOTA) models and applies it to specific applications through Fine-Tuning (FT). However, fine-tuning large models can be time-consuming, and determining which layers to use can be challenging. This study explores different fine-tuning strategies for five SOTA models (VGG16, VGG19, ResNet50, ResNet101, and InceptionV3) pre-trained on ImageNet. It also investigates the impact of the classifier by using a linear SVM for classification. The experiments are performed on four open-access ultrasound datasets related to breast cancer, thyroid nodules cancer, and salivary glands cancer. Results are evaluated using a five-fold stratified cross-validation technique, and metrics like accuracy, precision, and recall are computed. The findings show that fine-tuning 15% of the last layers in ResNet50 and InceptionV3 achieves good results. Using SVM for classification further improves overall performance by 6% for the two best-performing models. This research provides insights into fine-tuning strategies and the importance of the classifier in transfer learning for ultrasound image classification.


Keywords:

CNN, transfer learning, fine-tuning, SVM, ultrasound images, cancer classification

Agarap A. F.: An architecture combining convolutional neural network (cnn) and support vector machine (svm) for image classification. arXiv preprint: 1712.03541, 2017.
  Google Scholar

Al-Dhabyani W. et al.: Dataset of breast ultrasound images. Data Brief. 28, 2019, 104863.
DOI: https://doi.org/10.1016/j.dib.2019.104863   Google Scholar

Bal-Ghaoui M. et al.: U-net transfer learning backbones for lesions segmentation in breast ultrasound images. International Journal
  Google Scholar

of Electrical and Computer Engineering (IJECE) 13, 2023, 5747, [http://doi.org/10.11591/ijece.v13i5.pp5747-5754].
DOI: https://doi.org/10.11591/ijece.v13i5.pp5747-5754   Google Scholar

Cortes C., Vapnik V.: Support-vector networks. Machine learning 20, 1995, 273–297.
DOI: https://doi.org/10.1007/BF00994018   Google Scholar

Kim H. E. et al.: Transfer learning for medical image classification: A literature review. BMC medical imaging 22(1), 2022, 69.
DOI: https://doi.org/10.1186/s12880-022-00793-7   Google Scholar

Kora P. et al.: Transfer learning techniques for medical image analysis: A review. Biocybernetics and Biomedical Engineering 42(1), 2022, 79–107.
DOI: https://doi.org/10.1016/j.bbe.2021.11.004   Google Scholar

LeCun Y. et al.: Handwritten digit recognition with a back-propagation network. Advances in neural information processing systems 2, 1989.
  Google Scholar

Mukhlif A. A. et al.: An extensive review of state-of-the-art transfer learning techniques used in medical imaging: Open issues and challenges. Journal of Intelligent Systems 31(1), 2022, 1085–1111.
DOI: https://doi.org/10.1515/jisys-2022-0198   Google Scholar

Nanni L., Ghidoni S., Brahnam S.: Deep features for training support vector machines. Journal of Imaging 7(9), 2021, 177.
DOI: https://doi.org/10.3390/jimaging7090177   Google Scholar

Pedraza L. et al.: An open access thyroid ultrasound image database. 10th International symposium on medical information processing and analysis 9287, 2015, 188–193.
DOI: https://doi.org/10.1117/12.2073532   Google Scholar

Rodrigues P. S.: Breast ultrasound image. Mendeley Data 1(10), 2017, 17632.
  Google Scholar

Ronneberger O., Fischer P., Brox T.: U-net: Convolutional networks for biomedical image segmentation. 18 International Conference Medical Image Computing and Computer-Assisted Intervention – MICCAI, Munich, 2015, 234–241.
DOI: https://doi.org/10.1007/978-3-319-24574-4_28   Google Scholar

Salivary Glands Ultrasound Cases. Website [https://www.ultrasoundcases.info/cases/head-and-neck/salivary-glands/] (accessed: April 15, 2023).
  Google Scholar

Samee N. A. et al.: Deep learning cascaded feature selection framework for breast cancer classification: Hybrid cnn with univariate-based approach. Mathematics 10(19), 2022, 3631.
DOI: https://doi.org/10.3390/math10193631   Google Scholar

Shung K. K.: Diagnostic ultrasound: Past, present, and future. Journal of Medical and Biological Engineering 31(6), 2011, 371–374.
DOI: https://doi.org/10.5405/jmbe.871   Google Scholar

Srivastava R., Kumar P.: A cnn-svm hybrid model for the classification of thyroid nodules in medical ultrasound images. International Journal of Grid and Utility Computing 13(6), 2022, 624–639.
DOI: https://doi.org/10.1504/IJGUC.2022.128316   Google Scholar

Tang Y.: Deep learning using linear support vector machines. arXiv, preprint: 1306.0239, 2013.
  Google Scholar

Wang Y. et al.: A hybrid classification method of medical image based on deep learning. Research Square, preprint, 2021.
DOI: https://doi.org/10.21203/rs.3.rs-836474/v1   Google Scholar

Wang Y. et al.: The diagnostic value of ultrasound-based deep learning in differentiating parotid gland tumors. Journal of Oncology, 2022.
DOI: https://doi.org/10.1155/2022/8192999   Google Scholar

Xia X. et al.: Deep learning for differentiating benign from malignant parotid lesions on mri images. Frontiers in Oncology 11, 2021, 632104.
DOI: https://doi.org/10.3389/fonc.2021.632104   Google Scholar

Yu X. et al.: Transfer learning for medical images analyses: A survey. Neurocomputing 489, 2022, 230–254.
DOI: https://doi.org/10.1016/j.neucom.2021.08.159   Google Scholar

Download


Published
2023-12-20

Cited by

Bal-Ghaoui, M., El Yousfi Alaoui, M. H., Jilbab, A., & Bourouhou, A. (2023). OPTIMIZING ULTRASOUND IMAGE CLASSIFICATION THROUGH TRANSFER LEARNING: FINE-TUNING STRATEGIES AND CLASSIFIER IMPACT ON PRE-TRAINED INNER-LAYERS. Informatyka, Automatyka, Pomiary W Gospodarce I Ochronie Środowiska, 13(4), 27–33. https://doi.org/10.35784/iapgos.4464

Authors

Mohamed Bal-Ghaoui 
med.balghaoui@gmail.com
Mohammed V University in Rabat, National High School of Arts and Crafts, Electrical Engineering Department, E2SN Research Laboratory Morocco
https://orcid.org/0000-0002-2143-6458

Authors

My Hachem El Yousfi Alaoui 

Mohammed V University in Rabat, National High School of Arts and Crafts, Electrical Engineering Department, E2SN Research Laboratory Morocco
https://orcid.org/0000-0003-4285-0540

Authors

Abdelilah Jilbab 

Mohammed V University in Rabat, National High School of Arts and Crafts, Electrical Engineering Department, E2SN Research Laboratory Morocco
https://orcid.org/0000-0002-1577-9040

Authors

Abdennaser Bourouhou 

Mohammed V University in Rabat, National High School of Arts and Crafts, Electrical Engineering Department, E2SN Research Laboratory Morocco
https://orcid.org/0000-0002-6150-5374

Statistics

Abstract views: 205
PDF downloads: 142