Allow Face Definition for SInging Characters to Set a Servo Position for Each Phoneme

[kentstroker]

Is your feature request related to a problem? Please describe.
This is not related to a problem and is to address a challenge I have with using servo-based animatronic characters in a show.

Describe the solution you'd like
I would like to be able to use the existing Face Definition tool to set a servo position for each phoneme. As a stretch goal, adding random movement for a 3DOF neck and eye movement would be great.

Describe alternatives you've considered
I have been using VSA to do all the servo positional work, and then import that to xLights. Sometimes this works, more often than not it does not. There are other software tools out there for managing the choreography of a multiple-servo animatronic (the skulls I have been developing use a total of 8 servos for eyes, mouth, and 3DOF neck).

Additional context
Add any other context or screenshots about the feature request here.

[AzGilrock]

Yeah I’ve already created a way to do that. You need a Servo model and use the Servo effect. In the effect you point to the lyric track. I’ve created predetermined percentages for each phoneme. You really can’t make a single jaw movement look,that great no matter what settings you use. If you did custom programming it would look,better.

https://youtu.be/xB9pI9nM7MI?si=I2jOhfPKQFH69NV2

By the way I created the VSA I port as well. It worked fine for all the files I was given. You welcome to provide me a VSA file that has issues but I’d do that in its own issue.

[kjq1127]

I have been using the Servo and Servo model method and it is excellent! I have my skull rocking to Thunderstruck! Is there any way to edit the percentage for each phoneme? I have the servo center point where the jaw is completely closed. Most of the phonemes result in the jaw moving downward, however a few, such as "O" and "U" result in the servo arm traveling upward which causes the jaw to bind. I have altered this by replacing the phonemes causing the issue with "AI". If there is a better way to handle this I would appreciate pointers. Have you applied your Grinch demo to a physical skull? Would love to see that.

[AzGilrock]

xLights doesn't have a concept of a "center point" for servos. Servo commands go from 0 to 100%. What 0% and 100% translate to is fully in your control because you are supposed to be setting the limit values for the servo model such that "binding" can't happen. When you command 0% that would usually be the lower limit and represent a closed Jaw. Then set the upper limit for a fully open Jaw and that will be where it goes for a 100% command. All the phoneme's will then fall in between those 2 limits.

[kjq1127]

@AzGilrock - Thank you. That made everything click! The limits in the model layout are DMX values so they go from 0 (0%) to 255 (100%). Closed Jaw at 0%, and I need to determine Max limit based on my skull, it will be somewhere less than 255 (100%). This makes a whole lot more sense now.

[AzGilrock]

@kjq1127 Just keep in mind that 0% and 100% are not necessarily 0 and 255. If you set min limit to 50 and max limit to 200 then a 0% servo command sends out a DMX value of 50 and a 50% servo command would be (max-min)*percent + min or (200-50)*0.5 + 50 = 125.

[kjq1127]

@AzGilrock - Once again, thank you very much. This has been extremely helpful. Once I get my skeletons up and running I will post a video. We are planning on using them for both Halloween and Christmas. Thank you again for your help!