Skip to main navigation menu Skip to main content Skip to site footer

Skin Lesion Classification Based on Deep Convolutional Neural Networks Architectures

Abstract

Skin cancer is among the primary cancer types that manifest due to various dermatological disorders, which may be further classified into several types based on morphological features, color, structure, and texture. The mortality rate of patients who have skin cancer is contingent on preliminary and rapid detection and diagnosis of malignant skin cancer cells. Limitations in current dermoscopic images, including shadow, artifact, and noise, affect image quality, which may hamper detection effort. Attempts to overcome these challenges have been made by analyzing the images using deep learning neural networks to perform skin cancer detection. In this paper, the authors review the state-of-the-art in authoritative deep learning concepts pertinent to skin cancer detection and classification.

Keywords

skin lesion classification, skin cancer, melanoma detection, convolutional neural networks, deep learning

PDF

References

  1. M. A. Albahar, "Skin lesion classification using convolutional neural network with novel regularizer," IEEE Access, vol. 7, pp. 38306-38313, 2019.
  2. H. Xu, C. Lu, R. Berendt, N. Jha, and M. Mandal, "Automated analysis and classification of melanocytic tumor on skin whole slide images," Computerized medical imaging and graphics, vol. 66, pp. 124-134, 2018.
  3. A. Namozov and Y. Im Cho, "Convolutional neural network algorithm with parameterized activation function for melanoma classification," in 2018 International Conference on Information and Communication Technology Convergence (ICTC), 2018: IEEE, pp. 417-419.
  4. S. H. Kassani and P. H. Kassani, "A comparative study of deep learning architectures on melanoma detection," Tissue and Cell, vol. 58, pp. 76-83, 2019.
  5. I. A. OZKAN and M. KOKLU, "Skin Lesion Classification using Machine Learning Algorithms," International Journal of Intelligent Systems and Applications in Engineering, vol. 5, no. 4, pp. 285-289, 2017.
  6. J.-A. Almaraz-Damian, V. Ponomaryov, S. Sadovnychiy, and H. Castillejos-Fernandez, "Melanoma and nevus skin lesion classification using handcraft and deep learning feature fusion via mutual information measures," Entropy, vol. 22, no. 4, p. 484, 2020.
  7. K. M. Hosny, M. A. Kassem, and M. M. Foaud, "Classification of skin lesions using transfer learning and augmentation with Alex-net," PloS one, vol. 14, no. 5, p. e0217293, 2019.
  8. H. A. Hassan, M. B. Jan, Z. Ahmad, F. Tahira, and M. A. Khan, "Skin Lesion Classification Using Deep Learning Techniques."
  9. M. N. Bajwa et al., "Computer-Aided Diagnosis of Skin Diseases Using Deep Neural Networks," Applied Sciences, vol. 10, no. 7, p. 2488, 2020.
  10. A. Adegun and S. Viriri, "Deep learning techniques for skin lesion analysis and melanoma cancer detection: a survey of state-of-the-art," Artificial Intelligence Review, pp. 1-31, 2020.
  11. G. Litjens et al., "A survey on deep learning in medical image analysis," Medical image analysis, vol. 42, pp. 60-88, 2017.
  12. E. Okur and M. Turkan, "A survey on automated melanoma detection," Engineering Applications of Artificial Intelligence, vol. 73, pp. 50-67, 2018.
  13. K. Munir, H. Elahi, A. Ayub, F. Frezza, and A. Rizzi, "Cancer diagnosis using deep learning: a bibliographic review," Cancers, vol. 11, no. 9, p. 1235, 2019.
  14. S. Pathan, K. G. Prabhu, and P. Siddalingaswamy, "Techniques and algorithms for computer aided diagnosis of pigmented skin lesions—A review," Biomedical Signal Processing and Control, vol. 39, pp. 237-262, 2018.
  15. S. Subha, D. J. W. Wise, S. Srinivasan, M. Preetham, and B. Soundarlingam, "Detection and Differentiation of Skin Cancer from Rashes," in 2020 International Conference on Electronics and Sustainable Communication Systems (ICESC), 2020: IEEE, pp. 389-393.
  16. T. Satheesha, D. Satyanarayana, M. G. Prasad, and K. D. Dhruve, "Melanoma is skin deep: a 3D reconstruction technique for computerized dermoscopic skin lesion classification," IEEE journal of translational engineering in health and medicine, vol. 5, pp. 1-17, 2017.
  17. H. Nadipineni, "Method to Classify Skin Lesions using Dermoscopic images," arXiv preprint arXiv:2008.09418, 2020.
  18. R. B. Oliveira, A. S. Pereira, and J. M. R. Tavares, "Computational diagnosis of skin lesions from dermoscopic images using combined features," Neural Computing and Applications, vol. 31, no. 10, pp. 6091-6111, 2019.
  19. W. M. Abduallah and S. R. M. Zeebaree, "New Data hiding method based on DNA and Vigenere Autokey," Academic Journal of Nawroz University, vol. 6, no. 3, pp. 83-88, 2017.
  20. M. Goyal, A. Oakley, P. Bansal, D. Dancey, and M. H. Yap, "Skin lesion segmentation in dermoscopic images with ensemble deep learning methods," IEEE Access, vol. 8, pp. 4171-4181, 2019.
  21. P. Tschandl, C. Rosendahl, and H. Kittler, "The HAM10000 dataset, a large collection of multi-source dermatoscopic images of common pigmented skin lesions," Scientific data, vol. 5, p. 180161, 2018.
  22. M. E. Celebi, N. Codella, and A. Halpern, "Dermoscopy image analysis: overview and future directions," IEEE journal of biomedical and health informatics, vol. 23, no. 2, pp. 474-478, 2019.
  23. M. S. A. Mahbod, "Towards Improvement of Automated Segmentation and Classification of Tissues and Nuclei in Microscopic Images Using Deep Learning Approaches."
  24. N. A. Zebari, D. A. Zebari, D. Q. Zeebaree, and J. N. Saeed, "Significant features for steganography techniques using deoxyribonucleic acid: A review," Indonesian Journal of Electrical Engineering and Computer Science, vol. 21, no. 1, pp. 338-347, 2021.
  25. "DERMOFIT IMAGE LIBRARY." https://licensing.edinburgh-innovations.ed.ac.uk/i/software/dermofit-image-library.html?item=dermofit-image-library (accessed 4/1/2021.
  26. G. Argenziano, H. P. Soyer, V. De Giorgi, D. Piccolo, P. Carli, and M. Delfino, "Interactive atlas of dermoscopy (Book and CD-ROM)," 2000.
  27. T. Mendonça, P. M. Ferreira, J. S. Marques, A. R. Marcal, and J. Rozeira, "PH 2-A dermoscopic image database for research and benchmarking," in 2013 35th annual international conference of the IEEE engineering in medicine and biology society (EMBC), 2013: IEEE, pp. 5437-5440.
  28. J. Kawahara, S. Daneshvar, G. Argenziano, and G. Hamarneh, "Seven-point checklist and skin lesion classification using multitask multimodal neural nets," IEEE journal of biomedical and health informatics, vol. 23, no. 2, pp. 538-546, 2018.
  29. T. Akram et al., "A multilevel features selection framework for skin lesion classification," Human-centric Computing and Information Sciences, vol. 10, pp. 1-26, 2020.
  30. D. Gutman et al., "Skin lesion analysis toward melanoma detection: A challenge at the international symposium on biomedical imaging (ISBI) 2016, hosted by the international skin imaging collaboration (ISIC)," arXiv preprint arXiv:1605.01397, 2016.
  31. N. C. Codella et al., "Skin lesion analysis toward melanoma detection: A challenge at the 2017 international symposium on biomedical imaging (isbi), hosted by the international skin imaging collaboration (isic)," in 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018), 2018: IEEE, pp. 168-172.
  32. S. Singhal and M. Jena, "A study on WEKA tool for data preprocessing, classification and clustering," International Journal of Innovative technology and exploring engineering (IJItee), vol. 2, no. 6, pp. 250-253, 2013.
  33. H. Dino et al., "Facial Expression Recognition based on Hybrid Feature Extraction Techniques with Different Classifiers," TEST Engineering & Management, vol. 83, pp. 22319-22329, 2020.
  34. M. R. Mahmood, M. B. Abdulrazzaq, S. Zeebaree, A. K. Ibrahim, R. R. Zebari, and H. I. Dino, "Classification techniques’ performance evaluation for facial expression recognition," Indonesian Journal of Electrical Engineering and Computer Science, vol. 21, no. 2, pp. 176-1184, 2021.
  35. M. H. Jafari et al., "Skin lesion segmentation in clinical images using deep learning," in 2016 23rd International conference on pattern recognition (ICPR), 2016: IEEE, pp. 337-342.
  36. B. S. Osanaiye et al., "Network Data Analyser and Support Vector Machine for Network Intrusion Detection of Attack Type."
  37. O. F. Mohammad, M. S. M. Rahim, S. R. M. Zeebaree, and F. Y. Ahmed, "A survey and analysis of the image encryption methods," International Journal of Applied Engineering Research, vol. 12, no. 23, pp. 13265-13280, 2017.
  38. A. M. A. Brifcani and J. N. Al-Bamerny, "Image compression analysis using multistage vector quantization based on discrete wavelet transform," in 2010 International Conference on Methods and Models in Computer Science (ICM2CS-2010), 2010: IEEE, pp. 46-53.
  39. D. A. Zebari, H. Haron, S. R. Zeebaree, and D. Q. Zeebaree, "Enhance the Mammogram Images for Both Segmentation and Feature Extraction Using Wavelet Transform," in 2019 International Conference on Advanced Science and Engineering (ICOASE), 2019: IEEE, pp. 100-105.
  40. D. Q. Zeebaree, H. Haron, A. M. Abdulazeez, and S. R. Zeebaree, "Combination of K-means clustering with Genetic Algorithm: A review," International Journal of Applied Engineering Research, vol. 12, no. 24, pp. 14238-14245, 2017.
  41. H. I. Dino and M. B. Abdulrazzaq, "Facial expression classification based on SVM, KNN and MLP classifiers," in 2019 International Conference on Advanced Science and Engineering (ICOASE), 2019: IEEE, pp. 70-75.
  42. M. B. Abdulrazaq, M. R. Mahmood, S. R. Zeebaree, M. H. Abdulwahab, R. R. Zebari, and A. B. Sallow, "An Analytical Appraisal for Supervised Classifiers’ Performance on Facial Expression Recognition Based on Relief-F Feature Selection," in Journal of Physics: Conference Series, 2021, vol. 1804, no. 1: IOP Publishing, p. 012055.
  43. Y. Filali, S. Abdelouahed, and A. Aarab, "An Improved Segmentation Approach for Skin Lesion Classification," Statistics, Optimization & Information Computing, vol. 7, no. 2, pp. 456-467, 2019.
  44. M. A. Khan, M. Y. Javed, M. Sharif, T. Saba, and A. Rehman, "Multi-model deep neural network based features extraction and optimal selection approach for skin lesion classification," in 2019 international conference on computer and information sciences (ICCIS), 2019: IEEE, pp. 1-7.
  45. R. Zebari, A. Abdulazeez, D. Zeebaree, D. Zebari, and J. Saeed, "A Comprehensive Review of Dimensionality Reduction Techniques for Feature Selection and Feature Extraction," Journal of Applied Science and Technology Trends, vol. 1, no. 2, pp. 56-70, 2020.
  46. X. DuHarpur, F. Watt, N. Luscombe, and M. Lynch, "What is AI? Applications of artificial intelligence to dermatology," British Journal of Dermatology, 2020.
  47. J. N. Saeed, A Survey Of Ultrasonography Breast Cancer Image Segmentation Techniques. Infinite Study, 2020.
  48. Y. Fujisawa, S. Inoue, and Y. Nakamura, "The possibility of deep learning-based, computer-aided skin tumor classifiers," Frontiers in Medicine, vol. 6, p. 191, 2019.
  49. K. B. Obaid, S. Zeebaree, and O. M. Ahmed, "Deep Learning Models Based on Image Classification: A Review," International Journal of Science and Business, vol. 4, no. 11, pp. 75-81, 2020.
  50. S. Albawi, Y. A. Abbas, and Y. Almadany, "Robust skin diseases detection and classification using deep neural networks," 2018.
  51. S. Albawi, T. A. Mohammed, and S. Al-Zawi, "Understanding of a convolutional neural network," in 2017 International Conference on Engineering and Technology (ICET), 2017: Ieee, pp. 1-6.
  52. S. R. Zeebaree, O. Ahmed, and K. Obid, "CSAERNet: An Efficient Deep Learning Architecture for Image Classification," in 2020 3rd International Conference on Engineering Technology and its Applications (IICETA), 2020: IEEE, pp. 122-127.
  53. R. Garg, S. Maheshwari, and A. Shukla, "Decision Support System for Detection and Classification of Skin Cancer using CNN," arXiv preprint arXiv:1912.03798, 2019.
  54. T. Alkarakatly, S. Eidhah, M. Al-Sarawani, A. Al-Sobhi, and M. Bilal, "Skin Lesions Identification Using Deep Convolutional Neural Network," in 2019 International Conference on Advances in the Emerging Computing Technologies (AECT), 2020: IEEE, pp. 1-5.
  55. A. Mohamed, W. A. Mohamed, and A. H. Zekry, "Deep learning can improve early skin cancer detection," International Journal of Electronics and Telecommunications, vol. 65, 2019.
  56. M. A. Kadampur and S. Al Riyaee, "Skin cancer detection: applying a deep learning based model driven architecture in the cloud for classifying dermal cell images," Informatics in Medicine Unlocked, vol. 18, p. 100282, 2020.
  57. B. Vinay, P. J. Shah, V. Shekar, and H. Vanamala, "Detection of Melanoma using Deep Learning Techniques," in 2020 International Conference on Computation, Automation and Knowledge Management (ICCAKM), 2020: IEEE, pp. 391-394.
  58. F. Xiao and Q. Wu, "Visual saliency based global–local feature representation for skin cancer classification," IET Image Processing, vol. 14, no. 10, pp. 2140-2148, 2020.
  59. J. Daghrir, L. Tlig, M. Bouchouicha, and M. Sayadi, "Melanoma skin cancer detection using deep learning and classical machine learning techniques: A hybrid approach," in 2020 5th International Conference on Advanced Technologies for Signal and Image Processing (ATSIP), 2020: IEEE, pp. 1-5.
  60. S. Lu, Z. Lu, and Y.-D. Zhang, "Pathological brain detection based on AlexNet and transfer learning," Journal of computational science, vol. 30, pp. 41-47, 2019.
  61. Y. Zhai, H. Cao, W. Deng, J. Gan, V. Piuri, and J. Zeng, "BeautyNet: Joint multiscale CNN and transfer learning method for unconstrained facial beauty prediction," Computational intelligence and neuroscience, vol. 2019, 2019.
  62. M. A. Kassem, K. M. Hosny, and M. M. Fouad, "Skin lesions classification into eight classes for ISIC 2019 using deep convolutional neural network and transfer learning," IEEE Access, vol. 8, pp. 114822-114832, 2020.
  63. A. Mahbod, G. Schaefer, I. Ellinger, R. Ecker, A. Pitiot, and C. Wang, "Fusing fine-tuned deep features for skin lesion classification," Computerized Medical Imaging and Graphics, vol. 71, pp. 19-29, 2019.
  64. T.-C. Pham, C.-M. Luong, M. Visani, and V.-D. Hoang, "Deep CNN and data augmentation for skin lesion classification," in Asian Conference on Intelligent Information and Database Systems, 2018: Springer, pp. 573-582.
  65. R. Ashraf et al., "Region-of-Interest Based Transfer Learning Assisted Framework for Skin Cancer Detection," IEEE Access, vol. 8, pp. 147858-147871, 2020.
  66. U.-O. Dorj, K.-K. Lee, J.-Y. Choi, and M. Lee, "The skin cancer classification using deep convolutional neural network," Multimedia Tools and Applications, vol. 77, no. 8, pp. 9909-9924, 2018.
  67. M. M. I. Rahi, F. T. Khan, M. T. Mahtab, A. A. Ullah, M. G. R. Alam, and M. A. Alam, "Detection Of Skin Cancer Using Deep Neural Networks," in 2019 IEEE Asia-Pacific Conference on Computer Science and Data Engineering (CSDE), 2019: IEEE, pp. 1-7.
  68. K. M. Hosny, M. A. Kassem, and M. M. Foaud, "Skin cancer classification using deep learning and transfer learning," in 2018 9th Cairo International Biomedical Engineering Conference (CIBEC), 2018: IEEE, pp. 90-93.
  69. D. Gavrilov, L. Lazarenko, and E. Zakirov, "AI Recognition in Skin Pathologies Detection," in 2019 International Conference on Artificial Intelligence: Applications and Innovations (IC-AIAI): IEEE, pp. 54-542.
  70. B. Harangi, A. Baran, and A. Hajdu, "Assisted deep learning framework for multi-class skin lesion classification considering a binary classification support," Biomedical Signal Processing and Control, vol. 62, p. 102041, 2020.
  71. A. Demir, F. Yilmaz, and O. Kose, "Early detection of skin cancer using deep learning architectures: resnet-101 and inception-v3," in 2019 Medical Technologies Congress (TIPTEKNO), 2019: IEEE, pp. 1-4.
  72. A. C. Salian, S. Vaze, P. Singh, G. N. Shaikh, S. Chapaneri, and D. Jayaswal, "Skin Lesion Classification using Deep Learning Architectures," in 2020 3rd International Conference on Communication System, Computing and IT Applications (CSCITA), 2020: IEEE, pp. 168-173.
  73. L. Wei, K. Ding, and H. Hu, "Automatic Skin Cancer Detection in Dermoscopy Images based on Ensemble Lightweight Deep Learning Network," IEEE Access, 2020.
  74. X. Li, J. Wu, E. Z. Chen, and H. Jiang, "From Deep Learning Towards Finding Skin Lesion Biomarkers," in 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), 2019: IEEE, pp. 2797-2800.
  75. A. G. Pacheco, A.-R. Ali, and T. Trappenberg, "Skin cancer detection based on deep learning and entropy to detect outlier samples," arXiv preprint arXiv:1909.04525, 2019.
  76. B. Harangi, A. Baran, and A. Hajdu, "Classification of skin lesions using an ensemble of deep neural networks," in 2018 40th annual international conference of the IEEE engineering in medicine and biology society (EMBC), 2018: IEEE, pp. 2575-2578.
  77. I. Goodfellow et al., "Generative adversarial nets," in Advances in neural information processing systems, 2014, pp. 2672-2680.
  78. L. Lan et al., "Generative Adversarial Networks and Its Applications in Biomedical Informatics," Frontiers in Public Health, vol. 8, p. 164, 2020.
  79. I. S. Ali, M. F. Mohamed, and Y. B. Mahdy, "Data augmentation for skin lesion using self-attention based progressive generative adversarial network," arXiv preprint arXiv:1910.11960, 2019.
  80. H. Rashid, M. A. Tanveer, and H. A. Khan, "Skin Lesion Classification Using GAN based Data Augmentation," in 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), 2019: IEEE, pp. 916-919.
  81. P. Sedigh, R. Sadeghian, and M. T. Masouleh, "Generating Synthetic Medical Images by Using GAN to Improve CNN Performance in Skin Cancer Classification," in 2019 7th International Conference on Robotics and Mechatronics (ICRoM), 2019: IEEE, pp. 497-502.
  82. Z. Qin, Z. Liu, P. Zhu, and Y. Xue, "A GAN-based image synthesis method for skin lesion classification," Computer Methods and Programs in Biomedicine, p. 105568, 2020.
  83. M. B. Abdulrazzaq and J. N. Saeed, "A Comparison of Three Classification Algorithms for Handwritten Digit Recognition," in 2019 International Conference on Advanced Science and Engineering (ICOASE), 2019: IEEE, pp. 58-63.
  84. Z. Xu, F. R. Sheykhahmad, N. Ghadimi, and N. Razmjooy, "Computer-aided diagnosis of skin cancer based on soft computing techniques," Open Medicine, vol. 15, no. 1, pp. 860-871, 2020.
  85. R. Sharma and M. Lal, "Skin cancer lesion classification using lbp based hybrid classifier," International Journal of Advanced Research in Computer Science, vol. 8, no. 7, 2017.
  86. ` A. A. Salih and M. B. Abdulrazaq, "Combining best features selection using three classifiers in intrusion detection system," in 2019 International Conference on Advanced Science and Engineering (ICOASE), 2019: IEEE, pp. 94-99.

Metrics

Metrics Loading ...

Most read articles by the same author(s)