Hi Matthieu, yes, I track it in mocha, create a stabilized precomp and do the Lip-Sync inside the precomp. Take a look at the "Tutorial about the talking car" (see link in the video description). It shows exactly this process.
Yes, working with individual phonemes yields a different style. We aimed to find a good balance between making it easy to use and look good. Thats why we decided for automatic mouth animation and not asking the user to provide manual mouth shapes for each phoneme.
Thank you Mathias - great idea for a plugin! and executed well! After downloading the plugin i was running a 30 second test video in an hour! haha! Previous lip-syncs this length took me about 6 hrs of frustratiing, and painful image swapping and hundreds of keyframes. Yay!
It's still pretty amazing though. If I ever do anything more 3D style, I would definitely try it! I've tried using papagayo, pasting the generated keyframes into After Effects, but I think it's just faster and more accurate for me to just keyframe by hand. I've mapped my +/- keys to change the mouth shape keyframes based on their time remapped frame. It works fairly well, and faster than completely by hand, but something fully automated that worked with time remapped layers would be amazing! :-)
If have two characters and only one voice file, whats the best way to have them talk? I know they both will talk at the same time, can i delete certain parts of the lip sync sentence on one character and then repeat the process on the other character,
If you have a problem with Auto Lip-Sync, please open a support ticket at aescripts and give a detailed problem description. The more detailed you describe the problem, the quicker we will be able to help.
DUDE! I COULD KISS YOU! Not only is this plugin AMAZING! But I've had After Effects for years without realizing you just hold down CONTROL and drag the timeline to hear the sounds! I'VE BEEN DOING RENDER PREVIEWS THIS ENTIRE TIME OMG! * hugs you tightly and doesn't let go * My only issue is, why is mine transparent inside the mouth and not black like yours? (I mean I can add a layer of black behind it but it didn't seem you did that) Also, the white won't go away, there is not cleaning this, it's very cartoony in style there are literally only black and white colors and it's adding a whiteness inside the mouth that won't go away no matter HOW much I try to smudge. It's really straight so...not sure how to fix this.
Glad you like it :-) The inside of the mouth is always transparent. Maybe in the tut I had the background color of the comp set to black. So yes, the best way to color the inside is to put a colored solid behind it.
Why does the mouth shape change just from adding a marker please? I understand the setup you have for fine tuning, but i cannot understand why when you add the first marker, it changes anything?
Hi Eddy, on the aescripts website go to Support -> Knowlegde Base -> Installation -> How to install and run scripts There is a video explaining how to install scripts like Auto Lip-Sync. Best, Mathias
Before I installed the CC split, and I'm having the same problem. Maybe I should uninstall to see if the green lines disappear. What do you think? Congratulations on your plugin.
Please my computer is too slow in ram preview and Effect liquify my computer cpu AMD-FX8150-8Core-- ram 12G-1600---Gskill VIG -AMD- Radeon-HD6570 WD--SATA/64MB/Cache Please needy answer for me and thank you
Hi, what exactly does not work for you? Please create a support ticket at aescripts and I am sure we will be able to solve your problem quickly. Best, Mathias
Big brother Please you made tutorial for animal lip syn in fresh any easy way with mocha or without mocha. In updated video like tree,car,animal. May you made animal lips syn video.
good afternoon I have problem with Auto Lip-Sync I seek support files scrip ey entered Auto Lip-Sync but do not see it in After Effects CS3 I wonder where I find
Can you easily swap in a new audio track for the same character, or do you need to go through all the re-morphing the mouth stuff every time you get a new audio track even if the head has not changed? I don't see a way to have it reanalyze my audio? thanks!
Bro can u plz say that ,from this software i can animate only videos or i can do this with some of the 3d model .which later can be used in 3d softwares ...
Great video I’m using the trial right now, but I want to purchase the plugin once the trial is over. Just wanted to know how you created the tongue and teeth for your character. As my character is left with a black hole for a mouth.
In the first step, with the "Straighten Mouth Liquify" effect, you need to get rid of the smile and make sure the mouth is a straight line. When forming the final mouth shapes later, you can reintroduce the smile. For the teeth, you need to create new teeth on a layer below the actual mouth.
Hi there. When I get to step 4. It places the opening of the mouth below where I want it to go. How do I move the opening so it sits on top of the lips/mouth in my video? Thanks.
If the corners of the mouth are not where you want them, make sure to set those properly on step 1. If the mouth is opening too much, in step 4 (or also later) you can change the effect controls "upper lip height" and "lower lip height" as needed. Note that in general, Auto LipSync assumes that you start with a closed mouth. If you start with an image of a mouth that is already open, please try to warp it into a closed mouth (for example in Photoshop) before applying Auto Lip-Sync.
Hi, i'm using the trial version of lip sync. First time i used it worked great. Second tryout: I run thru the wizard process which works fine. but when i finish the wizard and want to do some touch ups, After effects starts peaking my processor to 100 - 110%... i'm using small video files and low resolutions. i'm running a i7 with 16gigs of ram Is this a known problem? thanks Vincent
Hi Vincent, usually, this only happens when you use high resolution images. The speed simply depends on how many pixels Auto Lip-Sync has to process. When you have a huge image, apply Auto Lip-Sync to it and then scale it down, the process will be very slow. If you scale down your image in Photoshop to the size you need in the final clip and apply Auto Lip-Sync to this low-res variant, it will me much faster. Alternatively you can scale it down in AE in a precomp that has a low resolution (and NOT "collapse transformation" enabled) and apply Auto Lip-Sync to the precomp. To speed it up even further, you can build the project such that the layer only contains the mouth region that actually deforms. All the rest of the face can be placed on a layer below. If all of this does not help, you can also send the project to info@mamoworld.com such that we can check what is slow in your example. Cheers, Mathias
Hii, i was following your tutorial and i was really excited. When i was done with the 6 steps i wanted to see how it looked so far but it didnt load. I turned of the O expression and set the quality to a quarter and it did load now, only veeery slow. I tried rendering it but has been rendering for 2 hours now. Do you have any idea if this is fixable or speed op the progress??
Hi Elizabeth, see section "What to do if Auto Lip-Sync renders slow" here aescripts.com/knowledgebase/index/view/faq/auto-lip-sync-frequently-asked-questions/
Auto Lip-Sync always reacts to the sound that is currently audible when it is applied. So you can first mute all audio in Ae except character 1 and then run Auto Lip-Sync for character 1. Then mute all audio except character 2 and run Auto Lip-Sync on character 2. Usually it is not a good idea to have more than one Auto Lip-Sync on the same layer. So if your characters are on the same source video clip, you can use two copies of the layer and mask them such that one contains the region with the face of character 1 and one the region with character 2.
Hey man do you have any idea to recreate this simply using the puppet tool? I just wanna try it out without the plugin. I know there's the CS Split option, but it only splits straight mouths. Plus it doesn't make the mouth come together for "ooo" shapes.
My script seems to be skipping a step, after I straighten the mouth and hit continue I am presented with an open mouth which makes it very difficult to re shape a closed mouth per the instructions.
Hi Seth, does this always happen or only for one particular audio file? Does the "Shape Mouth Liquify" effect contain two keyframes? it the mouth open for one and closed for the other one as it should be? Please open a support ticket at aescripts.com/contact and include as many details as possible. ideally also the After Effects project. The more details I know, the better and quicker I am able to help.
This is a fantastic tool; I've been using it for years and I'm really happy with it! I do have some questions about how it works with the latest version of AE, though; has anyone else run into "after effects error: unable to compute distortion"? I'm also having a tough time exporting to Adobe Encoder with lip sync on, but no issues when I remove it... Any ideas? (also, is there a better place than UA-cam to ask these questions? ;)
Hi Sandy, thank you for your feedback. We are not aware of such an issue, yet. Could you please open a support ticket at aescripts.com/contact/ Please include as much detail as possible. Does it happen sporadically or always? Only for one specific project or clip? Could you attach a project where the issue occurs? The more details I know, the quicker and better I am able to help. In general, this sounds like an issue with one of the warp effects that Auto Lip-Sync is using for its rig. So most likely the issue is on Adobe's end. But also in that case I can contact the Adobe team and point them to the issue.
@@mamoworldcom Think I got it figured out, and I think it was my fault! Seems to be working perfectly again; I think I accidentally used the wrong mesh warp tool in one of the steps. Thanks so much for your speedy reply, and again, love the tool!
How can I animate more than one mouth at the same time? Because I always get this error message: Unable to call"property" because of 1 parameter. The string is too long, it can only be 39 bytes after conversion. Thanks
+Femke De Bruyne which version of AE are you using and when exactly does the error happen? In general, to create more than one mouth, I would recommend to do it on separate layers (one layer for each mouth). If you have just 1 footage layer, you can use for each mouth one adjustment layer on top of the actual footage instead of applying Auto Lip-Sync directly to the footage layer. Just make sure that when you run the AutoLip-Sync wizard the first time, that only the first voice is audible and when you run it the second time on the second adjustment layer, only the second voice is audible.
hi, i just want to ask why im getting an error after step 2. i get a error says After effects error: Can not add a property with name "CC Split 2" to this PropertyGroup. im just a newbie in adobe after effects, i hope you can help me. i want to make my baby girl sings gangnam style, pls help me. sorry for my bad english..
I'm having issues when placing teeth and a tongue behind the mouth as it is showing around the mouth when it goes back to a closed position. How do I rectify this?
Emma Hildreth the easiest solution is to apply Auto Lip-Sync to a layer that is large enough such that it covers the entire teeth and tongue layers. So, for example, a layer of the entire head instead of a layer containing only the mouth region. Alternatively, you can create a solid layer on top of the teeth layer, draw a mask on it such that it roughly contains (roughly) the region of the open mouth where the teeth should be visible and then set this layer as alpha matte for the theeth layer. By that, no matter how the teeth move, they are always clipped to the masked region of the solid.
Hi papa jack, maybe you run out of memory. If you use a picture, make sure that it is not too large. Best use a picture that has the size that the final video should have (e.g. 1920×1080 pixel). Cheers, Mathias Cheers, Mathias
Where is a place to find people like you all, that can take video and add lip sync animation to the character like this? (Low budget short video.) I supply the video and the audio for the character and you apply the lip-sync animation. thanks.
+thexmanjdd This company is providing a service to create low budget videos of talking things using our Auto Lip-Sync. I recommend to contact them:www.flyingpigbranding.com/autospeak.html
still getting the error :( when i press the continue in step 2, in the upper side theres like a converting audiio keyframes. when it gets to 97% i getting the error. i think my dream for my baby singing gangman style is over :( i dont know what to do because i dont know much about adobe after effects :(
I hope someone will update this tutorial in 2022 to simplify, because today with the resources of after effects 2021 I believe that mocha is not necessary, does anyone know how to indicate a more updated tutorial?
In After Effects 2022 mocha is not s standalone app anymore, but a plugin. Hence, the workflow to create a stabilized precomp is a little bit different. This tutorial explains how to create stabilized precomps with the mocha plugin version that is included now in Ae: mamoworld.com/tutorials/stabilized-precomps-mochaimport-v6-and-mocha-ae-plugin
If my subject head is slightly moving from side to side, how do I make the auto lipsync mouth automatically track it? My brain is not processing how a stabalized precomp will help
See this tutorial: ua-cam.com/video/PVcsoULpDYI/v-deo.html A "stabilized precomp" rig gives you a composition inside which the tracked object is not moving anymore (the entire composition is moving with the track). Therefore, inside the precomp, the head is not moving anymore and you can apply Auto Lip-Sync inside of it without the need to worry about any movements. The cool thing is that all changes you do in the stabilized precomp will automatically also be visible in the main composition. See this tutorial for an overview how stabilized precomps work: ua-cam.com/video/gMBJ1R3t4dw/v-deo.html
Hello Mathias, ive just wrote to your web mail, cause i have a error message when i try to create teeth and tongue. i hope you answer, cause my boss is making my life impossible! thanks, Nacho.
Just seen your video - downloaded and got a great result an hour later - one question - the open mouth inside is Transparent and not BLACK, so it looses the sense of the mouth hole. Is that a preset i can change? help appreciated! Many thanks!
Auto Lip-Sync always just "cuts a hole" in layer, so whatever other layer is below will become visible. You can put a black solid layer below the layer, to which you applied Auto Lip-Sync, for example. You can create a solid in the Ae menu Layer->New->Solid...
Hello! Is it possible to replace the voice with the already created LIP? By the way, I am Japanese, but if the name of the layer that moves the mouth contains a Japanese language, I got an expression error when generating nulls for the tongue and jaw. Typing the name of the layer that moves the mouth back to English fixed the error. If you encounter such problems in languages other than English, you may be able to resolve them.
Thank you for the hint! I think non-latin characters cause trouble in expressions, unfortunately. Here is a tutorial showing how to replace the voice: ua-cam.com/video/A9vsWCjcwDg/v-deo.html
Make sure to use the most recent version of Auto Lip-Sync. If it still does not work, please open a support ticket at aescripts.com/contact/ This issue is caused by non-english versions of Ae and should be fixed in the most recent version of Auto Lip-Sync.
I would deactivate all effects one by one. If the green lines disappear when you disable some effect, you know that this effect causes the green lines.
Wonderful tool, has a lot of potential! I just purchased it and am enjoying it. One question: Is there a way to eliminate or avoid the mouth jitter that I sometimes get? It looks like his lips are trembling. is there a way to make it so that only the more dominant aspects of the audio signal are recognized, or a way to even things out so that there's not so much mouth jitter? I didn't notice it on the first character I did, so maybe there's something about the audio file characteristics. Any suggestions would be greatly suggested. Thanks!
if you see such a jitter it means your audio is noisy. So the best approach is to make sure your audio does not contain any background noise before running Auto Lip-Sync. As a quick fix, you could try to apply a smooth expression to the voce volume keyframes. TO do this, alt-click on the keyframe stop watch of the voice volume property to activate the expression of this property and then enter as expression smooth(width = 0.2, 10) To smooth more, increase the 0.2 to higher values. Cheers, Mathias
In the Voice Volume attribute 18.08 you can see a graph. Select the points in the graph you want to have no movement of the mouth, and make them zero, delete them, or make them a straight line to the right amount you wish the mouth to be open or closed.
Hey, can you use this plugin to auto lip sync a mouth you create for a 2d cartoon? I made 2 separate psd files, one with the caracter and 1 with 7 differenth mouth shapes, for the main letter types. Would this work? Thanks!
Hi, you can use it for cartoons, but it does not work by switching between different draws mouth shapes. If you want to use it for cartoons, you only need one mouth shape (closed mouth) and all the animation is generated by warping this one shape.
Is there a way to shut off the lip sync after it is done because my file is moving really slow now. I tried to mute, shut off FX, and lock it. My file is still moving slower when Im making adj to other parts of the video. Thanks.
If you deactivate all effects on the layer, it should render fast again. Alternatively, you can setup your project such that Auto Lip-Sync is done in a precomp. Then you can simply render a proxy for the precomp once you are happy with the mouth animation.
If you have a lot of perspective change, it is difficult. But if the object is just moving like the Bhudda, you can apply Auto Lip-Sync in a stabilized precomp as shown here: cgi.tutsplus.com/tutorials/a-look-at-how-to-use-auto-lip-sync--ae-20961
Which version of Auto Lip-Sync are you using? Please make sure to use the most recent version (1.10.000) and if you still have the issue, open a support ticket here and add a screenshot of the error message: aescripts.com/contact/
This is neat, but probably wouldn't work for me. If it would analyze the phonemes from the audio and just return an integer value for each sound, that would be better. My mouth shapes are already drawn, and are drawn differently for each phoneme. They only need to be turned on and off for each keyframe, not warped. I can see this being useful for 3d-type cartoons, but mine uses a more 2d style.
See here for some tips to increase render speed of Auto Lip-Sync aescripts.com/knowledgebase/index/view/faq/auto-lip-sync-frequently-asked-questions/#slowrender
You know, the Talking Head plugin work better for me, its soo cool!, because my animation are in 2D. AutoLyps-sync is more for 3D stuff or pre-made video o pictures , if i say so. thx for everything
Talking Heads is great if you have drawn individual mouth shapes yourself and want to toggle between them. Auto Lip-Sync warps the mouth which does not require you to provide individual mouth shapes and gives a very different visual result. Which tool is best for you depends on your workflow and mostly the style you are looking for.
Auto Lip-Sync is a plugin for After Effects. For general Ae questions like this one, I recommend to ask in this forum: forums.adobe.com/community/aftereffects
scorpion Here you find all tutorials about Auto Lip-Sync. mamoworld.com/tutorials?filter=tid-64 The one about the talking car shows a method how to do it with moving objects. The talking chipmunk shows an alternative approach how to animate the movement manually if it is hard to track.
No, the render speed is the same. For optimizing the render speed of Auto Lip-Sync see aescripts.com/knowledgebase/index/view/faq/auto-lip-sync-frequently-asked-questions/
Yes, the Auto Lip-Sync rig always reacts to all sound that is audible while you are running the wizard. So if you have the sound of the different characters on separate layers, you can simply mute the voices of all other characters before running Auto Lip-Sync for a particular character.
tried this product years ago, and it was buggy as hell. Came back to try it again, it still crashes all the time after doing the liquify (step 2) part. Can't say I can recommend this, as much as I want it to work.
The best way to solve such issues it to open a support ticket at aescripts.com/contact My best guess is that you apply Auto Lip-Sync to photos with a high resolution and that your machine is not able to process the effects on such huge layers. If your plan is to render a 1920x1080 video, for example, make sure to use a photo of that size. Using a much bigger photo and scaling it down makes the calculation of the warps MUCH slower (since every pixel of the huge picture needs to be processed). Also, it would be very helpful to hear which error messages you get. The more details I know, the quicker and better I can help.
I'm having major problems with this. I finally got to step 4/6 but the mouth suddenly appeared open in the wrong place on the face, it was up on the nose and there is no way I can figure out how to move it down to the correct area? How can I make the mouth move to the correct area and stay tracked there? thanks!
Auto Lip-Sync itself expects that the mouth is not moving. If you have a moving mouth, you best use the solution shown here using Auto Lip-Sync inside a stabilized precomp created with MochaImport+ cgi.tutsplus.com/tutorials/a-look-at-how-to-use-auto-lip-sync--ae-20961
Alternatively, MaskTracker+ can also create such stabilized precomps for you as you can see in chapters 5 and 6 of this tutorial: mamoworld.com/tutorials/masktracker-depth-tutorial
Hi Chris, I just replied to your support ticket on aescripts. You have to install Auto Lip-Sync in Ae using the menu command "File->Scripts->Install Script UI Panel".
11 years ago but still rocks in 2023 !!
Hi Matthieu, yes, I track it in mocha, create a stabilized precomp and do the Lip-Sync inside the precomp. Take a look at the "Tutorial about the talking car" (see link in the video description). It shows exactly this process.
Yes, working with individual phonemes yields a different style. We aimed to find a good balance between making it easy to use and look good. Thats why we decided for automatic mouth animation and not asking the user to provide manual mouth shapes for each phoneme.
This is a top-knotch script. The entire package is well designed, and your support for the product is of the highest quality. Excellent work, sir.
Thank you for the feedback, Geoffrey. :-)
Thank you Mathias - great idea for a plugin! and executed well!
After downloading the plugin i was running a 30 second test video in an hour! haha!
Previous lip-syncs this length took me about 6 hrs of frustratiing, and painful image swapping and hundreds of keyframes. Yay!
Thank you for your comment! :-)
If you like to play with the 14 days trial, think about doing something for the Auto Lip-Sync contest on Aetuts+.
Thank you for the feedback, followspot44. Auto Lip-Sync does not occur in the AE effects. You find it in the Window menu of After Effects.
amazing tuts very nice work i really enjoy and easy way to use
Thank you soo much!! This program is phenomenal!!!
Super helpful- thanks!
can't watch this without liking and subscribing to this !
You're a life saver! By the way, loved your pronunciation :D XD
Ze german accent is strong in zis one.
Looks fantastic!
Awesome Tecnics!
It's still pretty amazing though. If I ever do anything more 3D style, I would definitely try it! I've tried using papagayo, pasting the generated keyframes into After Effects, but I think it's just faster and more accurate for me to just keyframe by hand. I've mapped my +/- keys to change the mouth shape keyframes based on their time remapped frame. It works fairly well, and faster than completely by hand, but something fully automated that worked with time remapped layers would be amazing! :-)
If have two characters and only one voice file, whats the best way to have them talk? I know they both will talk at the same time, can i delete certain parts of the lip sync sentence on one character and then repeat the process on the other character,
thanks! I like your products by the way... :)
Sounds good. Thanks for letting me know :)
Will you give heart after 8 years 🤗
Very helpful bro...
Hi Ladyofthe Nba,
does your composition have a length of only a single frame?
Great! I am always curious to see such experiments. Can you post it as a video reply to this video?
this is really nice and fashionable
If you have a problem with Auto Lip-Sync, please open a support ticket at aescripts and give a detailed problem description. The more detailed you describe the problem, the quicker we will be able to help.
thank you very much!
DUDE! I COULD KISS YOU! Not only is this plugin AMAZING! But I've had After Effects for years without realizing you just hold down CONTROL and drag the timeline to hear the sounds! I'VE BEEN DOING RENDER PREVIEWS THIS ENTIRE TIME OMG! * hugs you tightly and doesn't let go * My only issue is, why is mine transparent inside the mouth and not black like yours? (I mean I can add a layer of black behind it but it didn't seem you did that) Also, the white won't go away, there is not cleaning this, it's very cartoony in style there are literally only black and white colors and it's adding a whiteness inside the mouth that won't go away no matter HOW much I try to smudge. It's really straight so...not sure how to fix this.
Glad you like it :-) The inside of the mouth is always transparent. Maybe in the tut I had the background color of the comp set to black. So yes, the best way to color the inside is to put a colored solid behind it.
Why does the mouth shape change just from adding a marker please? I understand the setup you have for fine tuning, but i cannot understand why when you add the first marker, it changes anything?
Brilliant, brilliant, brilliant.
how do you proceed when you have a travelling shot (just like in all your examples). Do you stabilize the shot first?
you are welcome!
HI Moreira Victor, did you use a trial version of some plugin?
Hi Eddy,
on the aescripts website go to
Support -> Knowlegde Base -> Installation -> How to install and run scripts
There is a video explaining how to install scripts like Auto Lip-Sync.
Best,
Mathias
THANK YOU MY FRIEND!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
Before I installed the CC split, and I'm having the same problem.
Maybe I should uninstall to see if the green lines disappear. What do you think?
Congratulations on your plugin.
You just need After Effects and our little tool Auto Lip-Sync. For a link to Auto Lip-Sync see the video description.
Please my computer is too slow in ram preview and Effect liquify
my computer cpu AMD-FX8150-8Core--
ram 12G-1600---Gskill
VIG -AMD- Radeon-HD6570
WD--SATA/64MB/Cache
Please needy answer for me and thank you
Hi, what exactly does not work for you? Please create a support ticket at aescripts and I am sure we will be able to solve your problem quickly.
Best,
Mathias
It is amazing.
Thanks! :)
Big brother
Please you made tutorial for animal lip syn in fresh any easy way with mocha or without mocha.
In updated video like tree,car,animal.
May you made animal lips syn video.
I have two green lines in my project ?
Do you please explain me why.
good afternoon I have problem with Auto Lip-Sync I seek support files scrip ey entered Auto Lip-Sync but do not see it in After Effects CS3 I wonder where I find
Thank you! :-)
Hi Naturelife2000,
the trial period is 14 days.
Cheers,
Mathias
thank you! :-)
Can you easily swap in a new audio track for the same character, or do you need to go through all the re-morphing the mouth stuff every time you get a new audio track even if the head has not changed? I don't see a way to have it reanalyze my audio? thanks!
yes, you can:
mamoworld.com/tutorials/auto-lip-sync-how-replace-audio-after-creating-mouth-rig
Bro can u plz say that ,from this software i can animate only videos or i can do this with some of the 3d model .which later can be used in 3d softwares ...
Hi, Auto Lip-Sync is only for videos, since it only works inside Adobe After Effects.
sänks for se tutoriäl :)
were can i download the plugin?
Great video I’m using the trial right now, but I want to purchase the plugin once the trial is over. Just wanted to know how you created the tongue and teeth for your character. As my character is left with a black hole for a mouth.
mouth and teeth are created starting at 19:19 in the video.
Also, this video shows a different approach to creating teeth at 28:38 ua-cam.com/video/PVcsoULpDYI/v-deo.html
Thank you
Hi, if my footage is already smiling with open mouth and teeth, how can I animate it thru the plug in?
In the first step, with the "Straighten Mouth Liquify" effect, you need to get rid of the smile and make sure the mouth is a straight line. When forming the final mouth shapes later, you can reintroduce the smile. For the teeth, you need to create new teeth on a layer below the actual mouth.
THANK YOUU
Hi there. When I get to step 4. It places the opening of the mouth below where I want it to go. How do I move the opening so it sits on top of the lips/mouth in my video? Thanks.
If the corners of the mouth are not where you want them, make sure to set those properly on step 1. If the mouth is opening too much, in step 4 (or also later) you can change the effect controls "upper lip height" and "lower lip height" as needed. Note that in general, Auto LipSync assumes that you start with a closed mouth. If you start with an image of a mouth that is already open, please try to warp it into a closed mouth (for example in Photoshop) before applying Auto Lip-Sync.
Hi, i'm using the trial version of lip sync. First time i used it worked great.
Second tryout: I run thru the wizard process which works fine. but when i finish the wizard and want to do some touch ups, After effects starts peaking my processor to 100 - 110%... i'm using small video files and low resolutions. i'm running a i7 with 16gigs of ram
Is this a known problem?
thanks
Vincent
Hi Vincent,
usually, this only happens when you use high resolution images. The speed simply depends on how many pixels Auto Lip-Sync has to process.
When you have a huge image, apply Auto Lip-Sync to it and then scale it down, the process will be very slow. If you scale down your image in Photoshop to the size you need in the final clip and apply Auto Lip-Sync to this low-res variant, it will me much faster. Alternatively you can scale it down in AE in a precomp that has a low resolution (and NOT "collapse transformation" enabled) and apply Auto Lip-Sync to the precomp.
To speed it up even further, you can build the project such that the layer only contains the mouth region that actually deforms. All the rest of the face can be placed on a layer below.
If all of this does not help, you can also send the project to info@mamoworld.com such that we can check what is slow in your example.
Cheers,
Mathias
Hii, i was following your tutorial and i was really excited. When i was done with the 6 steps i wanted to see how it looked so far but it didnt load. I turned of the O expression and set the quality to a quarter and it did load now, only veeery slow. I tried rendering it but has been rendering for 2 hours now. Do you have any idea if this is fixable or speed op the progress??
Hi Elizabeth, see section "What to do if Auto Lip-Sync renders slow" here aescripts.com/knowledgebase/index/view/faq/auto-lip-sync-frequently-asked-questions/
I am using the lip sync but I need to use it on two or more characters? what would be the best way to have lip sync for more than one person? Thanks
Auto Lip-Sync always reacts to the sound that is currently audible when it is applied. So you can first mute all audio in Ae except character 1 and then run Auto Lip-Sync for character 1. Then mute all audio except character 2 and run Auto Lip-Sync on character 2. Usually it is not a good idea to have more than one Auto Lip-Sync on the same layer. So if your characters are on the same source video clip, you can use two copies of the layer and mask them such that one contains the region with the face of character 1 and one the region with character 2.
i need tools of Video(tree)
Hey man do you have any idea to recreate this simply using the puppet tool? I just wanna try it out without the plugin. I know there's the CS Split option, but it only splits straight mouths. Plus it doesn't make the mouth come together for "ooo" shapes.
The puppet tool is not the right tool for this purpose. Auto Lip-Sync uses the split and liquify effects of Ae internally.
I can't buy things D:
My script seems to be skipping a step, after I straighten the mouth and hit continue I am presented with an open mouth which makes it very difficult to re shape a closed mouth per the instructions.
Hi Seth, does this always happen or only for one particular audio file? Does the "Shape Mouth Liquify" effect contain two keyframes? it the mouth open for one and closed for the other one as it should be? Please open a support ticket at aescripts.com/contact and include as many details as possible. ideally also the After Effects project. The more details I know, the better and quicker I am able to help.
Awesome XD
after effect value -0 out of range
help
Sure, I just replied. If you send me the project file, we will be able to fix this quickly.
This is a fantastic tool; I've been using it for years and I'm really happy with it! I do have some questions about how it works with the latest version of AE, though; has anyone else run into "after effects error: unable to compute distortion"? I'm also having a tough time exporting to Adobe Encoder with lip sync on, but no issues when I remove it... Any ideas? (also, is there a better place than UA-cam to ask these questions? ;)
Hi Sandy, thank you for your feedback. We are not aware of such an issue, yet. Could you please open a support ticket at
aescripts.com/contact/ Please include as much detail as possible. Does it happen sporadically or always? Only for one specific project or clip? Could you attach a project where the issue occurs? The more details I know, the quicker and better I am able to help.
In general, this sounds like an issue with one of the warp effects that Auto Lip-Sync is using for its rig. So most likely the issue is on Adobe's end. But also in that case I can contact the Adobe team and point them to the issue.
@@mamoworldcom Think I got it figured out, and I think it was my fault! Seems to be working perfectly again; I think I accidentally used the wrong mesh warp tool in one of the steps. Thanks so much for your speedy reply, and again, love the tool!
@@SDebreuil That's great news! Thank you for the feedback :-)
How can I animate more than one mouth at the same time? Because I always get this error message: Unable to call"property" because of 1 parameter. The string is too long, it can only be 39 bytes after conversion. Thanks
+Femke De Bruyne which version of AE are you using and when exactly does the error happen? In general, to create more than one mouth, I would recommend to do it on separate layers (one layer for each mouth). If you have just 1 footage layer, you can use for each mouth one adjustment layer on top of the actual footage instead of applying Auto Lip-Sync directly to the footage layer. Just make sure that when you run the AutoLip-Sync wizard the first time, that only the first voice is audible and when you run it the second time on the second adjustment layer, only the second voice is audible.
hi, i just want to ask why im getting an error after step 2. i get a error says After effects error: Can not add a property with name "CC Split 2" to this PropertyGroup. im just a newbie in adobe after effects, i hope you can help me. i want to make my baby girl sings gangnam style, pls help me. sorry for my bad english..
I would like to say that I have just experienced great customer service from Manoworld.
always happy to help :-)
Матиаз спасибо за скрипт и уроки .......!!!!!!!!!!
I'm having issues when placing teeth and a tongue behind the mouth as it is showing around the mouth when it goes back to a closed position. How do I rectify this?
Emma Hildreth the easiest solution is to apply Auto Lip-Sync to a layer that is large enough such that it covers the entire teeth and tongue layers. So, for example, a layer of the entire head instead of a layer containing only the mouth region. Alternatively, you can create a solid layer on top of the teeth layer, draw a mask on it such that it roughly contains (roughly) the region of the open mouth where the teeth should be visible and then set this layer as alpha matte for the theeth layer. By that, no matter how the teeth move, they are always clipped to the masked region of the solid.
Tongue, not thungh. Pronounce it as Tung. Additionally, Subtle. pronounced Suttle. Not Subtile.
I am using MaltyCam from maltaannon
Hi papa jack,
maybe you run out of memory. If you use a picture, make sure that it is not too large. Best use a picture that has the size that the final video should have (e.g. 1920×1080 pixel).
Cheers,
Mathias
Cheers,
Mathias
How do I when rendering heavy on RAM 8 GB Windows
See the section "what to do if Auto Lip-Sync renders slow" here aescripts.com/knowledgebase/index/view/faq/auto-lip-sync-frequently-asked-questions/
Hi, how long is the trial version valid for?
Where is a place to find people like you all, that can take video and add lip sync animation to the character like this? (Low budget short video.) I supply the video and the audio for the character and you apply the lip-sync animation. thanks.
+thexmanjdd This company is providing a service to create low budget videos of talking things using our Auto Lip-Sync. I recommend to contact them:www.flyingpigbranding.com/autospeak.html
Please tell me the is an update to this or some NEW software to make this easier in 2020?
Auto Lip-Sync is still alive and compatible with CC 2020. I am also not aware of any simpler Lip-Sync solution for After Effects.
still getting the error :( when i press the continue in step 2, in the upper side theres like a converting audiio keyframes. when it gets to 97% i getting the error. i think my dream for my baby singing gangman style is over :( i dont know what to do because i dont know much about adobe after effects :(
I hope someone will update this tutorial in 2022 to simplify, because today with the resources of after effects 2021 I believe that mocha is not necessary, does anyone know how to indicate a more updated tutorial?
In After Effects 2022 mocha is not s standalone app anymore, but a plugin. Hence, the workflow to create a stabilized precomp is a little bit different. This tutorial explains how to create stabilized precomps with the mocha plugin version that is included now in Ae: mamoworld.com/tutorials/stabilized-precomps-mochaimport-v6-and-mocha-ae-plugin
If my subject head is slightly moving from side to side, how do I make the auto lipsync mouth automatically track it? My brain is not processing how a stabalized precomp will help
See this tutorial: ua-cam.com/video/PVcsoULpDYI/v-deo.html
A "stabilized precomp" rig gives you a composition inside which the tracked object is not moving anymore (the entire composition is moving with the track). Therefore, inside the precomp, the head is not moving anymore and you can apply Auto Lip-Sync inside of it without the need to worry about any movements. The cool thing is that all changes you do in the stabilized precomp will automatically also be visible in the main composition. See this tutorial for an overview how stabilized precomps work: ua-cam.com/video/gMBJ1R3t4dw/v-deo.html
Hello Mathias, ive just wrote to your web mail, cause i have a error message when i try to create teeth and tongue. i hope you answer, cause my boss is making my life impossible! thanks, Nacho.
Just seen your video - downloaded and got a great result an hour later - one question - the open mouth inside is Transparent and not BLACK, so it looses the sense of the mouth hole. Is that a preset i can change? help appreciated! Many thanks!
Auto Lip-Sync always just "cuts a hole" in layer, so whatever other layer is below will become visible. You can put a black solid layer below the layer, to which you applied Auto Lip-Sync, for example. You can create a solid in the Ae menu Layer->New->Solid...
Hello! Is it possible to replace the voice with the already created LIP?
By the way, I am Japanese, but if the name of the layer that moves the mouth contains a Japanese language, I got an expression error when generating nulls for the tongue and jaw. Typing the name of the layer that moves the mouth back to English fixed the error. If you encounter such problems in languages other than English, you may be able to resolve them.
Thank you for the hint! I think non-latin characters cause trouble in expressions, unfortunately. Here is a tutorial showing how to replace the voice: ua-cam.com/video/A9vsWCjcwDg/v-deo.html
i can't go to step3, "could not run ae menu command to convert audio to keframes."
How do you solve this error?
Make sure to use the most recent version of Auto Lip-Sync. If it still does not work, please open a support ticket at
aescripts.com/contact/
This issue is caused by non-english versions of Ae and should be fixed in the most recent version of Auto Lip-Sync.
I would deactivate all effects one by one. If the green lines disappear when you disable some effect, you know that this effect causes the green lines.
Wonderful tool, has a lot of potential! I just purchased it and am enjoying it. One question: Is there a way to eliminate or avoid the mouth jitter that I sometimes get? It looks like his lips are trembling. is there a way to make it so that only the more dominant aspects of the audio signal are recognized, or a way to even things out so that there's not so much mouth jitter?
I didn't notice it on the first character I did, so maybe there's something about the audio file characteristics. Any suggestions would be greatly suggested. Thanks!
if you see such a jitter it means your audio is noisy. So the best approach is to make sure your audio does not contain any background noise before running Auto Lip-Sync.
As a quick fix, you could try to apply a smooth expression to the voce volume keyframes.
TO do this, alt-click on the keyframe stop watch of the voice volume property to activate the expression of this property and then enter as expression
smooth(width = 0.2, 10)
To smooth more, increase the 0.2 to higher values.
Cheers,
Mathias
The smoothing advice was exactly what I was looking for. Thank you for the quick and helpful response!
I just flatten the Voice volume for that area. It's especially needed when the audio has no speaking, but there is other sound in the clip.
When you say "flatten the Voice volume", do you mean you compress it, limit it, normalize it? Or what exactly do you mean by "flatten"? Thanks!
In the Voice Volume attribute 18.08 you can see a graph. Select the points in the graph you want to have no movement of the mouth, and make them zero, delete them, or make them a straight line to the right amount you wish the mouth to be open or closed.
Hey, can you use this plugin to auto lip sync a mouth you create for a 2d cartoon?
I made 2 separate psd files, one with the caracter and 1 with 7 differenth mouth shapes, for the main letter types. Would this work? Thanks!
Hi, you can use it for cartoons, but it does not work by switching between different draws mouth shapes. If you want to use it for cartoons, you only need one mouth shape (closed mouth) and all the animation is generated by warping this one shape.
mamoworld.com
Ok thank you!
Is there a way to shut off the lip sync after it is done because my file is moving really slow now. I tried to mute, shut off FX, and lock it. My file is still moving slower when Im making adj to other parts of the video. Thanks.
If you deactivate all effects on the layer, it should render fast again. Alternatively, you can setup your project such that Auto Lip-Sync is done in a precomp. Then you can simply render a proxy for the precomp once you are happy with the mouth animation.
Okay thanks again. Im almost done with the Lip Sync animation. Maybe another week. Then You can check it out.
Hey there. With the talking bhudda, how can it be done with the camera moving but keeping the proprotions/perspective correct?
If you have a lot of perspective change, it is difficult. But if the object is just moving like the Bhudda, you can apply Auto Lip-Sync in a stabilized precomp as shown here: cgi.tutsplus.com/tutorials/a-look-at-how-to-use-auto-lip-sync--ae-20961
cool thanks man, will be getting this in due course. nice work
i am getting a reference error 3343 line when i try to use this
Which version of Auto Lip-Sync are you using? Please make sure to use the most recent version (1.10.000) and if you still have the issue, open a support ticket here and add a screenshot of the error message: aescripts.com/contact/
This is neat, but probably wouldn't work for me. If it would analyze the phonemes from the audio and just return an integer value for each sound, that would be better. My mouth shapes are already drawn, and are drawn differently for each phoneme. They only need to be turned on and off for each keyframe, not warped. I can see this being useful for 3d-type cartoons, but mine uses a more 2d style.
The preview rendering is painfully slow, how can I fix this?
See here for some tips to increase render speed of Auto Lip-Sync
aescripts.com/knowledgebase/index/view/faq/auto-lip-sync-frequently-asked-questions/#slowrender
You know, the Talking Head plugin work better for me, its soo cool!, because my animation are in 2D. AutoLyps-sync is more for 3D stuff or pre-made video o pictures , if i say so. thx for everything
Talking Heads is great if you have drawn individual mouth shapes yourself and want to toggle between them. Auto Lip-Sync warps the mouth which does not require you to provide individual mouth shapes and gives a very different visual result. Which tool is best for you depends on your workflow and mostly the style you are looking for.
mamoworld.com Yes, Exactly, that was my case, i already had drawed my mouths.
What would be a good laptop to buy that would run this software easily
Auto Lip-Sync is a plugin for After Effects. For general Ae questions like this one, I recommend to ask in this forum: forums.adobe.com/community/aftereffects
how do you do it with moving scenes?
scorpion Here you find all tutorials about Auto Lip-Sync.
mamoworld.com/tutorials?filter=tid-64
The one about the talking car shows a method how to do it with moving objects. The talking chipmunk shows an alternative approach how to animate the movement manually if it is hard to track.
is the trial version of this plugin render slower than the full version?
No, the render speed is the same. For optimizing the render speed of Auto Lip-Sync see aescripts.com/knowledgebase/index/view/faq/auto-lip-sync-frequently-asked-questions/
can i sync numerous mouths at once...if so..how..please
Yes, the Auto Lip-Sync rig always reacts to all sound that is audible while you are running the wizard. So if you have the sound of the different characters on separate layers, you can simply mute the voices of all other characters before running Auto Lip-Sync for a particular character.
excuse me, required plugins?
YES AND TO HARD FOR ADOBE TO FIX THAT.
LAZINESS is a disinclination to activity or exertion despite having the ability to ""do so"".
I can’t figure out how to make the teeth and tongue with the mask.
To get started with using masks, I recommend this tutorial: ua-cam.com/video/o0wzjcyvOiA/v-deo.html
tried this product years ago, and it was buggy as hell. Came back to try it again, it still crashes all the time after doing the liquify (step 2) part. Can't say I can recommend this, as much as I want it to work.
The best way to solve such issues it to open a support ticket at aescripts.com/contact
My best guess is that you apply Auto Lip-Sync to photos with a high resolution and that your machine is not able to process the effects on such huge layers. If your plan is to render a 1920x1080 video, for example, make sure to use a photo of that size. Using a much bigger photo and scaling it down makes the calculation of the warps MUCH slower (since every pixel of the huge picture needs to be processed).
Also, it would be very helpful to hear which error messages you get. The more details I know, the quicker and better I can help.
I'm having major problems with this. I finally got to step 4/6 but the mouth suddenly appeared open in the wrong place on the face, it was up on the nose and there is no way I can figure out how to move it down to the correct area? How can I make the mouth move to the correct area and stay tracked there? thanks!
does this plug in only work on non-moving objects or can it track the movement of the mouth?
Auto Lip-Sync itself expects that the mouth is not moving. If you have a moving mouth, you best use the solution shown here using Auto Lip-Sync inside a stabilized precomp created with MochaImport+ cgi.tutsplus.com/tutorials/a-look-at-how-to-use-auto-lip-sync--ae-20961
Alternatively, MaskTracker+ can also create such stabilized precomps for you as you can see in chapters 5 and 6 of this tutorial: mamoworld.com/tutorials/masktracker-depth-tutorial
thank you I will watch both tutorials
I have purchase this and it won't work with my Adobe after effects
Hi Chris, I just replied to your support ticket on aescripts. You have to install Auto Lip-Sync in Ae using the menu command "File->Scripts->Install Script UI Panel".
a low budget AE plugin that works perfectly and is actually intuitive? Whats the world coming to?
:-)
$40 low budger? Wish i had your budget plan...