Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

could we apply fast-style-transfer to image deformation? #248

Open
erhuodaosi opened this issue Jul 12, 2020 · 2 comments
Open

could we apply fast-style-transfer to image deformation? #248

erhuodaosi opened this issue Jul 12, 2020 · 2 comments

Comments

@erhuodaosi
Copy link

I'm sorry to bother you,but I have a question on could we apply fast-style-transfer to image deformation.

In style-transfer,we usually provide a content image and a style image to generate results.And now,could we give a content picture,and let it transform into a warpping image?If the answer is yes,what is the style image?How could we get the style image?

Here are two pictures:one is the original picture,and the other is the transformed image.
before
after

I would very appreciate if you could help me,thank you!

@rabdulatipoff
Copy link

rabdulatipoff commented Jul 14, 2020

If I'm not mistaken, this solution does not make differences between 'foreground' and 'background' while extracting features from the training sample (style image), it should substitute the features it's able to 'find' in the target image with those from the map of cross-correlated pieces of style image (training sample) -- it's unlikely that there's an option for non-linear transformations of picture data already implemented in this repo. Even if it was, at least two issues would have to be solved -- how do you separate deformation mask boundary from the 'style' features (color keying and similar techniques?) and what's your strategy for filling in the empty space outside of the deformation mask area after you perform the deformation?

There's not much I've found online regarding non-linear 2D transformations, though you might be interested by this:

https://people.engr.tamu.edu/schaefer/research/mls.pdf
https://github.com/cxcxcxcx/imgwarp-opencv

@erhuodaosi
Copy link
Author

@rabdulatipoff
Hi,

Thank you for your advice!Thanks a lot!
I believe it would help me a lot!

Thank you for your patient again.

Best wishes,
FengLang

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants