View Article

Abstract

Among the most widespread health issues all over the world, skin diseases need to be diagnosed properly and on time. Nevertheless, dermatological expertise is not readily available in rural and underserved areas. The paper is about an AI-based skin disease prediction system that uses deep learning techniques. The system proposed is based on Convolutional Neural Network (CNN), the ConvNeXt-tiny architecture, to recognize the skin disease in the image. The model is trained on labeled datasets and implemented using a Streamlit-based web interface. Also, it is integrated with the Gemini API to give treatment recommendations and proactive solutions. This has been experimentally proven to have an accuracy of about 85-90%, which proves effectiveness of the system in real-time diagnosis.

Keywords

Transformers, Artificial Intelligence (AI), skin, effectiveness

Introduction

The field of healthcare has been transformed by Artificial Intelligence (AI) that allows the automatic and correct diagnosis of diseases. The visual examination is essential in identifying skin diseases like acne, eczema, psoriasis as well as infections. The latest developments in deep learning, most notably Convolutional Neural Networks (CNNs), have greatly enhanced the capabilities of medical image classification systems. In this paper, an AI-based system is introduced that uses deep learning to identify skin diseases based on images. The system is developed with Python, PyTorch, and Streamlit, which enables users to upload images and get immediate predictions with confidence scores and medical advice.

PROBLEM STATEMENT

Diagnosis of skin diseases used to be based on clinical examination by skilled dermatologists. This expertise is, however, not easily accessible in rural and remote areas resulting in delays in diagnosis and treatment. Skin conditions can also be manually examined and this is time consuming and can be exposed to human error leading to misdiagnosis or poor consistency. Moreover, the current diagnostic systems are usually not automated, lack real-time processing and cannot be used by ordinary people. These restrictions present a huge disparity in delivering prompt and cost-effective healthcare services. Thus, the necessity to create an intelligent and automated system capable of analyzing skin images, precisely detecting skin diseases, and offering credible medical support is high. This type of system can facilitate the early identification, lessen reliance on specialists, and enhance access to healthcare in general.

LITERATURE REVIEW

Many studies have been conducted on the topic of skin disease detection with the help of machine learning and deep learning models. The ensemble learning techniques are a set of models that are used together to enhance accuracy and minimize overfitting but they present high computational complexity and cannot be implemented easily in real-time systems. Transformers based architectures ( Vision Transformers (ViT) ) exhibit high accuracy (up to 96%), although they need large datasets and are computationally expensive. ResNet, MobileNet, and EfficientNet are CNN-based methods that are popular because of their accuracy/efficiency balance. Transfer learning methods have also enhanced performance by utilizing.

Hybrid solutions to combine conventional machine learning with deep learning have also been considered to improve feature extraction. Even with these developments, issues like imbalance of data, overfitting, high computing demands and lack of real world implementation remain. This brings to the fore the necessity of an accurate and practical system to be utilized in real-time.

PROPOSED METHODOLOGY

A. Data Collection

A large set of annotated images of skin diseases was also garnered via publicly available websites and edited to contain various disease types, including acne, psoriasis, eczema, ringworm, urticaria, cellulitis, and impetigo. The dataset was aimed at capturing the differences in skin tone, lighting, and image quality to enhance the model robustness. Adequate labeling was also done to enhance reliability of datasets and enhance classification accuracy...

B. Data Preprocessing

A vital step towards the effectiveness of the deep learning model is data preprocessing. To make the images consistent across the dataset, all images were downsampled to a standard size. When training, pixel values were subjected to normalization in order to enhance convergence. To artificially raise the amount of data and minimize overfitting, data augmentation methods, i.e. rotation, flipping, zoom, etc., were used to enlarge the data. Moreover, images that contained too much noise, blur or bad quality were eliminated so as to improve the consistency and reliability of the datasets.

C. Model Development

The system is based on the ConvNeXt-tiny framework, which is implemented on PyTorch.

D. Model Training

To examine the effectiveness of the models, the dataset was split into two groups: training and testing in the 80:20 proportion. Adam optimizer was the preferred model type because it has the ability to adjust to changes. Measures of prediction error were the categorical cross-entropy loss function. The training was done in various epochs where the performance was monitored at each epoch to maintain the desired convergence and prevent overfitting. Learning rate and batch size are among the hyperparameters that were optimized to ensure the best performance.

E. Model Evaluation

Widely accepted measures, including accuracy, precision, and recall, were used to assess the performance of the model. Measures of accuracy are used to determine the overall accuracy of the predictions, whereas precision and recall give more insight into the performance of the classifications. A confusion matrix was also created, to examine misclassifications between various categories of disease. These assessment methods can be used to comprehend the reliability of the models and zone of development.

F. Deployment

This is implemented on the Streamlit system, and can receive real-time predictions, when users upload pictures.

SYSTEM ARCHITECTURE

The system consists of:

1. Image Input Module

2. Preprocessing Module

3. CNN Model (ConvNeXt-tiny)

4. Prediction Output Module

5. Gemini API to integrate treatment suggestions.

RESULTS AND DISCUSSION

A. Performance

The test data show that the model has an accuracy of around 85- 90%.

B. Output Features

The system displays the user with detail output, the name of the predicted disease and a confidence score that shows the assurance of the prediction. Moreover, it integrates with the Gemini API to provide treatment recommendations and prophylaxis. This renders the system more informative and practical to apply in real life.

C. Visualization

The visualization is performed with Grad-CAM to highlight the affected areas, enhancing model interpretability.

D. Analysis

The model performs effectively across multiple disease classes. However, performance is influenced by image quality and dataset diversity.

CONCLUSION

In this paper, an AI-based system of skin disease predication using deep learning techniques to diagnose skin disease accurately and in real time is presented. The system is capable of classifying several skin diseases with a high level of accuracy and also offers an accessible platform where users can get instant medical information. The proposed solution, based on AI and a web-based interface, alleviates the reliance on manual diagnosis and enhances the accessibility of healthcare. The system could be improved in the future by adding bigger and varied datasets that would enhance the process of generalization. It is possible to experiment with more sophisticated models, including hybrid CNN-transformer, to achieve accuracy improvements. Also, implementation of the system as a mobile app and combining the system with IoT-based healthcare devices can further enhance its application. The multilingual assistance and the feature of doctor consultation at any time or place may also be added to the system to make it more realistic in the real-life applications.

REFERENCES

  1. A. Kumar, V. Yadav, S. Kale, P. Satpute, and M. N. Vharkate, “Classification of Various Skin Diseases by Using Deep Learning,” International Research Journal of Advanced Engineering Hub, vol. 3, no. 7, pp. 3265–3269, 2025.
  2. N. Tarisafitri and A. Aljabar, “Classification of Skin Diseases Using Digital Image Processing with MobileNetV2 Architecture,” Nusantara Journal of Artificial Intelligence and Information Systems, vol. 1, no. 1, pp. 35–44, 2025.
  3. H. S. Khalifa and S. F. Abdullah, “Skin Disease Classification using CNN Deep Learning Technique,” Current Science International, vol. 14, no. 2, pp. 121–128, 2025.
  4. V. Kumar and J. Rani, “Human Skin Disease Detection and Classification Using Ensemble Learning,” Journal of Recent Innovations in Computer Science and Technology, vol. 2, no. 2, 2025.
  5. A. M. Patel, P. Parmar, N. Thakkar, and H. M. Barot, “Skin Disease Classification Using Machine Learning Algorithms: A Review,” 2023.
  6. M. Y. Shams et al., “Skin Disease Classification: A Comparison of ResNet50, MobileNet, and EfficientNet-B0,” 2025.
  7. F. Ahmmed et al., “Skin Disease Detection and Classification of Actinic Keratosis and Psoriasis Utilizing Deep Transfer Learning,” 2025.
  8. Y. Yang et al., “Skin Disease Classification using Transfer Learning Model and Fusion Strategy,” Intelligence-Based Medicine, vol. 12, 2025.
  9. M. N. Noor, F. Haneef, I. Ashraf, and M. Masud, “Enhanced Skin Disease Classification via Dataset Refinement and Attention-Based Vision Approach,” Bioengineering, vol. 12, no. 275, 2025.
  10. K. Behara, E. Bhero, and J. T. Agee, “An Improved Skin Lesion Classification Using a Hybrid Approach with Attention-Guided Capsule Networks,” Diagnostics, vol. 14, no. 6, p. 636, 2024.
  11. S. Zhi, Z. Li, X. Yang, K. Sun, and J. Wang, “A Multiclassification Model for Skin Diseases Using Dermatoscopy Images with Inception-v2,”  Applied Sciences, vol. 14, no. 22, p. 10197, 2024.
  12. S. R. Shankar et al., “Skin Disease Classification Using Multi-Model Optimization and Augmentation,” IARJSET, vol. 12, no. 6, 2025.
  13. S. A. Hanuma, A. Dey, and M. A. Kabir, “An Attention-Guided Deep Learning Approach for Classifying 39 Skin Lesion Types,” 2025.
  14. S. G. Malik et al., “High-Precision Skin Disease Diagnosis through Deep Learning on Dermoscopic Images,” Bioengineering, vol. 11, no. 9, p. 867, 2024.
  15. M. Zahid, M. Rziza, and R. Alaoui, “Skin Lesion Classification Using Hybrid Feature Extraction Based on Classical and Deep Learning Methods,” BioMedInformatics, vol. 5, no. 3, p. 41, 2025.
  16. A. Aboulmira, H. Hrimech, and M. Lachgar, “Skin Diseases Classification with Machine Learning and Deep Learning Techniques: A Systematic Review,” International Journal of Advanced Computer Science and Applications, vol. 15, no. 10, 2024.
  17. Z. R. Abdulqader and A. R. Abrahim, “Deep Learning-Based Skin Disease Detection and Classification: A Systematic Literature Review,” Dasinya Journal for Engineering and Informatics, vol. 2, no. 1, 2026.
  18. M. Badr, A. Elkasaby, M. Alrahmawy, and S. El-Metwally, “A Multi-model Deep Learning Architecture for Diagnosing Multi-class Skin Diseases,” Journal of Imaging Informatics in Medicine, vol. 38, pp. 1776–1795, 2025.
  19. J. Mohan, A. Sivasubramanian, S. V, and V. Ravi, “Enhancing Skin Disease Classification Leveraging Transformer-based Deep Learning Architectures and Explainable AI,” 2024.
  20. B. Durgabhavani et al., “Classification of Skin Disease using CNN,” in Proc. Int. Conf. Evolutionary Algorithms and Soft Computing Techniques (EASCT), 2023.

Reference

  1. A. Kumar, V. Yadav, S. Kale, P. Satpute, and M. N. Vharkate, “Classification of Various Skin Diseases by Using Deep Learning,” International Research Journal of Advanced Engineering Hub, vol. 3, no. 7, pp. 3265–3269, 2025.
  2. N. Tarisafitri and A. Aljabar, “Classification of Skin Diseases Using Digital Image Processing with MobileNetV2 Architecture,” Nusantara Journal of Artificial Intelligence and Information Systems, vol. 1, no. 1, pp. 35–44, 2025.
  3. H. S. Khalifa and S. F. Abdullah, “Skin Disease Classification using CNN Deep Learning Technique,” Current Science International, vol. 14, no. 2, pp. 121–128, 2025.
  4. V. Kumar and J. Rani, “Human Skin Disease Detection and Classification Using Ensemble Learning,” Journal of Recent Innovations in Computer Science and Technology, vol. 2, no. 2, 2025.
  5. A. M. Patel, P. Parmar, N. Thakkar, and H. M. Barot, “Skin Disease Classification Using Machine Learning Algorithms: A Review,” 2023.
  6. M. Y. Shams et al., “Skin Disease Classification: A Comparison of ResNet50, MobileNet, and EfficientNet-B0,” 2025.
  7. F. Ahmmed et al., “Skin Disease Detection and Classification of Actinic Keratosis and Psoriasis Utilizing Deep Transfer Learning,” 2025.
  8. Y. Yang et al., “Skin Disease Classification using Transfer Learning Model and Fusion Strategy,” Intelligence-Based Medicine, vol. 12, 2025.
  9. M. N. Noor, F. Haneef, I. Ashraf, and M. Masud, “Enhanced Skin Disease Classification via Dataset Refinement and Attention-Based Vision Approach,” Bioengineering, vol. 12, no. 275, 2025.
  10. K. Behara, E. Bhero, and J. T. Agee, “An Improved Skin Lesion Classification Using a Hybrid Approach with Attention-Guided Capsule Networks,” Diagnostics, vol. 14, no. 6, p. 636, 2024.
  11. S. Zhi, Z. Li, X. Yang, K. Sun, and J. Wang, “A Multiclassification Model for Skin Diseases Using Dermatoscopy Images with Inception-v2,”  Applied Sciences, vol. 14, no. 22, p. 10197, 2024.
  12. S. R. Shankar et al., “Skin Disease Classification Using Multi-Model Optimization and Augmentation,” IARJSET, vol. 12, no. 6, 2025.
  13. S. A. Hanuma, A. Dey, and M. A. Kabir, “An Attention-Guided Deep Learning Approach for Classifying 39 Skin Lesion Types,” 2025.
  14. S. G. Malik et al., “High-Precision Skin Disease Diagnosis through Deep Learning on Dermoscopic Images,” Bioengineering, vol. 11, no. 9, p. 867, 2024.
  15. M. Zahid, M. Rziza, and R. Alaoui, “Skin Lesion Classification Using Hybrid Feature Extraction Based on Classical and Deep Learning Methods,” BioMedInformatics, vol. 5, no. 3, p. 41, 2025.
  16. A. Aboulmira, H. Hrimech, and M. Lachgar, “Skin Diseases Classification with Machine Learning and Deep Learning Techniques: A Systematic Review,” International Journal of Advanced Computer Science and Applications, vol. 15, no. 10, 2024.
  17. Z. R. Abdulqader and A. R. Abrahim, “Deep Learning-Based Skin Disease Detection and Classification: A Systematic Literature Review,” Dasinya Journal for Engineering and Informatics, vol. 2, no. 1, 2026.
  18. M. Badr, A. Elkasaby, M. Alrahmawy, and S. El-Metwally, “A Multi-model Deep Learning Architecture for Diagnosing Multi-class Skin Diseases,” Journal of Imaging Informatics in Medicine, vol. 38, pp. 1776–1795, 2025.
  19. J. Mohan, A. Sivasubramanian, S. V, and V. Ravi, “Enhancing Skin Disease Classification Leveraging Transformer-based Deep Learning Architectures and Explainable AI,” 2024.
  20. B. Durgabhavani et al., “Classification of Skin Disease using CNN,” in Proc. Int. Conf. Evolutionary Algorithms and Soft Computing Techniques (EASCT), 2023.

Photo
Balkrishna Karbhare
Corresponding author

Department of Computer Science and Engineering, RV Institute of Technology and Management, Bengaluru, 560076, Karnataka, India

Photo
Adarsh
Co-author

Department of Computer Science and Engineering, RV Institute of Technology and Management, Bengaluru, 560076, Karnataka, India

Photo
Basappa V. Valmiki
Co-author

Department of Computer Science and Engineering, RV Institute of Technology and Management, Bengaluru, 560076, Karnataka, India

Photo
Arban Reyaz Khan
Co-author

Department of Computer Science and Engineering, RV Institute of Technology and Management, Bengaluru, 560076, Karnataka, India

Photo
Hema M. S.
Co-author

Department of Computer Science and Engineering, RV Institute of Technology and Management, Bengaluru, 560076, Karnataka, India

Balkrishna Karbhare*, Basappa V. Valmiki, Adarsh, Arban Reyaz Khan, Hema M. S., AI-Based Skin Disease Prediction System Using Deep Learning, Int. J. Sci. R. Tech., 2026, 3 (5), 117-120. https://doi.org/10.5281/zenodo.20019763

More related articles
Illuminating the Future of Medicine: Surface Plasm...
Arnab Roy, Sashikant, Meghna Singh , Aniruddha Basak , Mohammad A...
Recent Advances in Nanoparticles-Based Drug Delive...
Pokale Shraddha, Bhise Gorakhnath , Salve Aniket , Ghuge Tanuja ...
Explainable Chronic Kidney Disease Prediction Usin...
Govardan Sai Palla, Dr. I. Kullayamma, ...
Nano Based Drug Delivery Systems: Recent Developments and Future Prospects...
Tejaswini Shinde, Kanchan Deshmukh, Vaibhavi Gavali, Shradha Deokar, ...
A Review on Thuja Plant Species...
Sakshi Shejwal , Vrushali Baisane , Pritam Sawant, Sanika Chavan, Priya Salunke, ...
Related Articles
Development and Evaluation of Sprayable Nanoemulsion For Skin Cancer Using 5- Fl...
Anjali Sahu, Aparna Tiwari, Ayushi Khadatkar, Sneha Singh, Rajesh Kumar Nema, Gyanesh Kumar Sahu, ...
Advancements in Immunomodulatory Therapies for Autoimmune Disease...
Shrushti Shahane , Utkarsha Sawant, Pratiksha Ghodake , Swapnil Kale, Sneha Kanase, ...
Illuminating the Future of Medicine: Surface Plasmon Resonance-Based Nanotechnol...
Arnab Roy, Sashikant, Meghna Singh , Aniruddha Basak , Mohammad Ayaan , Adarsh Kumar , ...
More related articles
Illuminating the Future of Medicine: Surface Plasmon Resonance-Based Nanotechnol...
Arnab Roy, Sashikant, Meghna Singh , Aniruddha Basak , Mohammad Ayaan , Adarsh Kumar , ...
Recent Advances in Nanoparticles-Based Drug Delivery Systems...
Pokale Shraddha, Bhise Gorakhnath , Salve Aniket , Ghuge Tanuja , Kolhe Vishakha , ...
Illuminating the Future of Medicine: Surface Plasmon Resonance-Based Nanotechnol...
Arnab Roy, Sashikant, Meghna Singh , Aniruddha Basak , Mohammad Ayaan , Adarsh Kumar , ...
Recent Advances in Nanoparticles-Based Drug Delivery Systems...
Pokale Shraddha, Bhise Gorakhnath , Salve Aniket , Ghuge Tanuja , Kolhe Vishakha , ...