Color Control Multires Script
The 3 luminance transfer steps are show in the image above.
The first row shows linear color transfer from the content image, onto the style image. The second and third row show both the content and style images being converted to their gray scale luminance form. These gray scale forms of your content and style images are then run through Neural-Style. Then the 5th row shows the output from Neural-Style before and after color is applied.
The script used to make the images in the example, can be found here: https://gist.github.com/ProGamerGov/d82ada2290e052fe1a3c7cb9e0fbe0f0