AttentionedDeepPaint

Automatic Anime Sketch Colorization Using Generative Adversarial Network (GAN)

Dependency

Refer requirements

Install

1. Pytorch (>= 0.4.1) (No problem in torch 1.0.1)
2. Torchvision (>= 0.2.1) based on your python version, os, cuda version etc...

Usage

Download dataset

1. go to link and download
2. unzip

Train

$ ./train.sh

Reference

1. Sketch Image Generation

• https://github.com/lllyasviel/sketchKeras

2. Color Histogram Extraction

• https://github.com/obskyr/colorgram.py

3. Attentioned UNet

• https://arxiv.org/pdf/1804.03999.pdf
• https://github.com/ozan-oktay/Attention-Gated-Networks

Colorize Result Examples

To see experiment trials, click

General Result Example (Same Sketch, Different Styles)

Attention Map Result Examples

Train Settings & Log

Hyperparameter	Value
learning_rate	0.0002
beta1 (optimizer)	0.5
batch_size	4
lambda	100
epochs	30
learning_rate schedule	None
Discriminator	PatchGAN
Weight Initialization	(0, 0.02) Normal Distribution