Sketch2Real is a innovative image translation application which I developed for my final year project of BS Computer Science degree. All the project documentation and implementation of coding was made by a single developer, demonstrating comprehensive skills in machine learning, mobile application development, and backend integration.
Sketch2Real leverages state-of-the-art deep learning techniques, specifically Generative Adversarial Networks (GANs) and the Image-To-Image Translation Alogorithm, to translate hand-drawn human face sketches into realistic images. The application targets both mobile and web platforms, offering users an intuitive and interactive interface for creating lifelike portraits from rough sketches.
-
Advanced Deep Learning Model: The heart of Sketch2Real is a deep learning model trained on a custom dataset which I made by myself comprising approximately 5000 samples of human face sketches and their corresponding real images and all human faces images are AI Generted (No person exists in real life). The model has been trained for over 10,000 epochs, ensuring exceptional accuracy and realism in image translation. More epochs more accurate results in this model arcitecture.
-
Cross-Platform Compatibility: Built using the Flutter framework, Sketch2Real seamlessly caters to both mobile and web users, providing a consistent user experience across different devices and platforms.
-
Backend Infrastructure: The project incorporates a robust RESTful API developed with Flask, enabling seamless communication between the application frontend and the deep learning model. This backend infrastructure ensures efficient handling of user requests and data transmission during the image translation process.
-
User-Friendly Interface: Sketch2Real boasts an intuitive and visually appealing user interface, allowing users to effortlessly draw sketches, upload images, and interact with the application's various features. The interface supports real-time sketch editing, enabling users to refine their creations on the fly.
-
Authentication and Security: Firebase authentication is integrated into Sketch2Real, ensuring secure user login and data privacy. User authentication mechanisms provide a seamless and secure experience for accessing the application's features and functionalities.
-
State Management and Performance Optimization: The application leverages the GetX library for efficient state management, optimizing performance and resource utilization. This approach ensures smooth and responsive user interactions, even when handling complex image processing tasks.
I try to draw my face sketch and give it to model and results was very accurate and mind blowing!
- I took the model architecture concept from this paper named as "Image-To-Image Translation With Conditional Generative Adversarial Neural Networks" from https://arxiv.org/abs/1611.07004 because they have provided a commom framework you just have to change the dataset.
- I trained my model on Google Colab around for 3 months just on training phase due to limited GPU computing units even on the premium subscription.
- The frontend was also very time taking task due to drawing concepts.
- If you need the full trained model and dataset which is used in my project you can contact me :)
- Gmail: mughalfahad544@gmail.com