Skip to content

Latest commit

 

History

History
56 lines (41 loc) · 4.93 KB

style_engineering_ebook.md

File metadata and controls

56 lines (41 loc) · 4.93 KB

Style Engineering

The StyleGAN was first used to generate images from a given domain. This was followed by its usage for projecting real faces into a given space.

F_4_glasses F_4_glasses_projected
Original Image Projected Image

The projected images can then be used for a myriad of different use cases.

Style Mixing

One can combine the features of two images were combinable using the StyleGAN.

M_2_with_hair baby_2 M_2_with_hair,baby_2,1_8
Image 1 Image 2 Style Mixed image with Z_low = 1 and Z_high = 8

Image Editing

Another cool quirk of these projected images was that individual characteristics of the subject in the image were now tweakable.

baby_1 baby_1_age=2,gender=4
Original Image Age = +2, Gender = +4

Domain Adaptation

In 2020, NVIDIA released another model called StyleGAN-NADA that was capable of transfering different images to different domains. Additionally, these results worked on top of all the features already existing in StyleGANs.

F_1_smiling F_1_smiling_anime
Original Image Anime
F_1_smiling_age=6 F_1_smiling_anime_age=6
Age = +6 Anime, Age = +6

Image Restoration

In 2021, Tencent Applied Research Center developed a model called GFP-GAN, which was capable of improving image quality and resolution, specifically of images of faces.

adele_crop adele_crop_fixed
Original Image Restored Image

Image Prompting

The underlying model of image generators took a quick shift from GANs to transformers with the increasing popularity of transformer-based language models in recent years. One such algorithm that has shown impressive results is Stable Diffusion. Not only was it capable of generating images based on text prompts, but it was also capable of altering existing images using these prompts.

M_3_glasses M_3_glasses_Superhero, blue glowing eyes, mask, super suit_steps=50,guidance=7 5 Superhero, blue glowing eyes, mask, super suit_steps=50,guidance=7 5
Original Image Original image + Prompt: Superhero, blue glowing eyes, mask, super suit. Sampler=K-LMS; Steps=50; Guidance Scale=7.5 No source image + Prompt: Superhero, blue glowing eyes, mask, super suit. Sampler=K-LMS; Steps=50; Guidance Scale=7.5

Image 2 Image

Seasons

Seattle_Original Seattle_winter Seattle_summer Seattle_spring
Original Image Seattle in Winter Seattle in summer Seattle in spring