Lip Sync setup

General Moho topics.

Moderators: Víctor Paredes, Belgarath, slowtiger

Post Reply
User avatar
Gibble
Posts: 48
Joined: Mon Aug 20, 2018 7:01 pm

Lip Sync setup

Post by Gibble »

Hey Gang!

I have a mouth chart question for you all:

I was reading a response by @VíctorParedes in a different threadviewtopic.php?t=33768- and it had some great info on how to set up the Mouth shapes that can be Auto Lip Synced [Rhubarb] but I am still a bit unclear on a few things.
He said to use the Preston Blair phonemes.
I'd like to set my switch layer so I can use the Auto Lip Sync [Rhubarb].
My questions are:

1. Use Preston Blair mouth shapes = ✔ Q: Is it only these specific mouth shapes: AI / O / E / U / L, WQ / MBP / FV/ Closed Did I get them all?
2. What naming convention do I use for the Mouthshapes so Auto Lip Sync will recognize the correct layer? Is it Numbers? 1,2,3... or is it something else? If numbers- what is the order Ex. 1 = closed?
3. What if I have different emotions of the mouth shapes Ex. Neutral, Happy, Sad, etc. Would each emotion set have its own Switch Layer? Ex. Neutral Mouths Switch Layer, Happy Mouths, etc


I've Googled how to best set up a Mouthchart for Moho but didn't have much success. If there is a good tutorial or video on this, please share it :)

Additional Question: What are your thoughts on Auto Lip Sync / Rhubarb in Moho?
I want to try the Auto Lip Sync feature [Rhubarb] to save time. Even if Auto Lip Sync used just as a first pass at laying down the mouth shapes, it could be a great help. I just need a bit more clarity on the exact way to set this up.

Image
User avatar
slowtiger
Posts: 6081
Joined: Thu Feb 16, 2006 6:53 pm
Location: Berlin, Germany
Contact:

Re: Lip Sync setup

Post by slowtiger »

I just wrote about that topic here: viewtopic.php?p=216937#p216937

2: Automatic lip sync only relies on the position of the layers inside the switch layer. Closed mouth on bottom, most open mouth on top.

3: Good thinking. Put the different emotions switch layers into a master mouth switch layer.

A year ago I used that stuff a lot, but forgot many details. I think it's possible to set up a main smart bone to control all switch layers at once, but need to test again.

What also works instead of assigning a sound file to each switch layer: assign that sound to a smart bone via bone wiggle script. Does the same.
AS 9.5 MacPro Quadcore 3GHz 16GB OS 10.6.8 Quicktime 7.6.6
AS 11 MacPro 12core 3GHz 32GB OS 10.11 Quicktime 10.7.3
Moho 13.5 iMac Quadcore 2,9GHz 16GB OS 10.15

Moho 14.1 Mac Mini Plus OS 13.5
User avatar
Gibble
Posts: 48
Joined: Mon Aug 20, 2018 7:01 pm

Re: Lip Sync setup

Post by Gibble »

Thanks so much for the quick response, @SlowTiger. It is greatly appreciated!

So the only variable Rhubarb uses is layer order?
Layer orderAnd it should be layered from the least closed [bottom layer] to the most open [top layer].

Layer Naming: And the layer name doesn't matter at all? Numbers, names, etc- it is not factored in??

So would it look like this??
Image
User avatar
slowtiger
Posts: 6081
Joined: Thu Feb 16, 2006 6:53 pm
Location: Berlin, Germany
Contact:

Re: Lip Sync setup

Post by slowtiger »

No, as far as I understand Rhubarb uses the Preston Blair system, which means you need to name your layers exactly like that, with upper/lowercase. Layer order isn't used here.

The other automatic lipsync is the one where you assign an imported sound file to the switch layer which will react according to sound volume.
AS 9.5 MacPro Quadcore 3GHz 16GB OS 10.6.8 Quicktime 7.6.6
AS 11 MacPro 12core 3GHz 32GB OS 10.11 Quicktime 10.7.3
Moho 13.5 iMac Quadcore 2,9GHz 16GB OS 10.15

Moho 14.1 Mac Mini Plus OS 13.5
User avatar
Greenlaw
Posts: 9269
Joined: Mon Jun 19, 2006 5:45 pm
Location: Los Angeles
Contact:

Re: Lip Sync setup

Post by Greenlaw »

Some additional info: Moho's Switch Layer sets keyframes based on the child layer name (not order or id,) so I'm assuming the automated lipsync system does look for a specific naming structure.

I've done a fair amount of lipsync animation in Moho but never used the auto-lipsync system. In my experience, manual lipsync takes only a couple of minutes to do and looks better. It's well worth doing this way.

That said, I really should check out the new Rhubard system in 14.1. :)
Last edited by Greenlaw on Thu Mar 07, 2024 2:08 am, edited 1 time in total.
User avatar
Gibble
Posts: 48
Joined: Mon Aug 20, 2018 7:01 pm

Re: Lip Sync setup

Post by Gibble »

Thanks again for your help SlowTiger and DR! Much appreciated :)

DR: I found another post where you posted some great information on how you approach lip-syncing and I think I'll just follow that!
Like you, I've always hand-keyed lip sync animation but I'm always interested in finding ways to speed up the workflow. You have some other great tips on that thread that certainly help with that too!
Your set up seems already pretty close (if not exact) to what the Rhubarb plugin expects anyhow.

Your breakdown was also very helpful:
blank
smile
Th
FV
MPB
WQ
L (D, Th)
CDGKNRSYZ
U
E
O
A, I
neutral


Switch:
I am still a bit hazy on how you set up your switch layer but I am interested in figuring it out as it seems a big timesaver.
User avatar
Greenlaw
Posts: 9269
Joined: Mon Jun 19, 2006 5:45 pm
Location: Los Angeles
Contact:

Re: Lip Sync setup

Post by Greenlaw »

You probably already saw this info, but here's what I found on the Rhubarb developer's page...

Moho and OpenToonz

...and this...

Mouth Shapes

I have yet to test this, but I'm assuming Moho's Rhubarb support will recognize switch layers using the letter name for each mouth shape in the chart found at the second link. For example, the 'oo' sound should trigger a layer named F in the switch. If I have time, I'll play with this tonight and report what I find.
User avatar
sang820
Posts: 661
Joined: Fri Sep 10, 2004 6:55 am
Location: china Beijing
Contact:

Re: Lip Sync setup

Post by sang820 »

:shock: After years of practice, I believe that these 7 mouth shapes (A, E, I, O, U, F, off) can almost solve all problems.
Daxel
Posts: 996
Joined: Wed Mar 27, 2019 8:34 pm

Re: Lip Sync setup

Post by Daxel »

I tend to use less mouth shapes the more experience I get. Each person and each style has their unique taste of course, but I personally find too expressive lipsyncs to be worse looking than simple but well animated ones. On top of that, it's just more work and I think the little credibility you can win it's thrown away when dubbing for a different language.
User avatar
slowtiger
Posts: 6081
Joined: Thu Feb 16, 2006 6:53 pm
Location: Berlin, Germany
Contact:

Re: Lip Sync setup

Post by slowtiger »

Agreed. In real life lots of sentences require no lip movement at all. The anime way with just closed - half open - scream works for a lot of scenes.

And bear in mind how old those Preston Blair drawings are: nearly 100 yrs now! We surely have changed taste and style a lot in the meantime. Animation in the 1930's was still influenced a lot by Vaudeville overacting. Compare with a current stand up comedian: they don't do this anymore.
AS 9.5 MacPro Quadcore 3GHz 16GB OS 10.6.8 Quicktime 7.6.6
AS 11 MacPro 12core 3GHz 32GB OS 10.11 Quicktime 10.7.3
Moho 13.5 iMac Quadcore 2,9GHz 16GB OS 10.15

Moho 14.1 Mac Mini Plus OS 13.5
User avatar
Greenlaw
Posts: 9269
Joined: Mon Jun 19, 2006 5:45 pm
Location: Los Angeles
Contact:

Re: Lip Sync setup

Post by Greenlaw »

My advice is to use your own face and mouth as a reference. When I'm animating lip-sync, I'm physically forming the words with my mouth and paying attention to the shapes I'm making for the words as a whole, and not for every syllable.

When you do this, you may be surprised to find how many syllables are never actually formed by the mouth (especially when a character is speaking quickly.) The Preston Blair set is a good standard guide for lip-sync animation, and that's all it is. The best reference is to look at the real thing.

I used to keep a small makeup mirror at my desk. I haven't needed that for many years, but if you haven't done much lip-sync (or facial animation, for that matter,) I highly recommend getting a small rectangular mirror with a stand to sit on your desk.
Post Reply