Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Background rotation in visualizing pose angles #32

Open
MonikaGahalawat11 opened this issue Apr 19, 2021 · 6 comments
Open

Background rotation in visualizing pose angles #32

MonikaGahalawat11 opened this issue Apr 19, 2021 · 6 comments

Comments

@MonikaGahalawat11
Copy link

I am trying to visualize videos from Openface using pose angles.
The issue I'm having is that the background also rotates along the character's face. How can I stop the background rotation and visualize only character head motion?
I'd be thankful for any help in this regard.

@deepsurbhi8
Copy link

Hi, I was also trying to do the same as mentioned in @MonikaGahalawat11 comment. Same problem is with me as well. I only want to rotate the pose angles of characters not the world coordinates of the scene. Kindly helo.

@NumesSanguis
Copy link
Owner

Hey, thank you for trying out FACSvatar.
I haven't come across this problem myself (check on YouTube for "FACSvatar"), so I need some more details.

  • What version of Blender are you using?
  • What version of FACSvatar are you using?
  • What version of MB-Lab are you using?
  • Are you using Blender or Unity3D? (and what version of FACSvatar-Blender add-on in case of Blender?)
  • What steps did you take?
  • Did you modify anything?

Can you also make a screen capture of what is happening (e.g. using OBS studio)?

@deepsurbhi8
Copy link

Hi,

In your video as well at time 10-13 minutes when character is animating then background is also animating it is not static.
I am using Unity3D which I downloaded from the mentioned link.

I followed the mentioned steps as:

  1. By setting docker in the FACSvatar/modules
  2. I am doing 2 things for my project: one is animating only AUs and 2nd rotating only pose values with the help of Pose Rx, Ry and Rz generated from openface.
  3. I am replacing my own csv file by copying it to the docker and making its image.
  4. Then I am running main.py for my own file
  5. I followed all the steps mentioned on the github page. Nothing from myside.

I have not modified anything. The main problem is, I need to see head motion only for 2 sec data and if I see side view it is ok as background is static and when i am using frontal view it is a complete mess as background is not static. I am also attaching the screen capture for both side and front view.

What I want is, in the frontal view only character should animate while background should be static. I hope I am clear now with the problem statement.

If you could help me out, I shall be very thankful to you.

K2.mp4
K2_Front.mp4

@NumesSanguis
Copy link
Owner

I understand your problem now. This happens because the 1st-person camera is attached to the head of the character.

In my own research experiment, the user was the avatar, so if the user moved his/her head, the avatar should move.

In your case you should detach the camera from the avatar's head and just put it somewhere fixed in the scene (like the 3rd-person view / side view camera).
I'm not an expert with Unity3D and camera positioning is just something related to Unity3D in general and not this project in particular, so I won't be able to help you with this aspect (Google will do a better job).

Hope it works out for you!

@deepsurbhi8
Copy link

Actually I am using FACSvatar Unity provided by this project only and not by Unity3D editor. I am also not a person from animation background. There is no settings option given in FACSvatar_Unity3D. Is there any other way to do that? Like by changing any code of rotation.

@NumesSanguis
Copy link
Owner

To change the camera behavior, you need to open the project in Unity3D editor. This cannot be done with Python code. FACSvatar_Unity3D is just a compiled version that is intended as a demo to try it out. To make any modifications, you either need to do it yourself or find someone who can do it for you.

Before I started this project, I never used Unity3D as well. The change you describe is a fairly simple change, so with a bit of learning Unity3D you will be able to do this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants