Це відео не доступне.
Перепрошуємо.
Setup and use auto lip sync in OpenToonz & Tahoma2D !
Вставка
- Опубліковано 13 сер 2024
- Let me show you how to setup and use the auto-lip sync feature in OpenToonz and Tahoma 2D.
Contents:
00:00 Auto-lip sync with OpenToonz
00:44 Step 1. Download & setup Rhubarb program
02:08 Step 2. Create/import mouth shapes
04:23 Step 3: Apply lip sync
06:36 Applying manual fixes
Simple Instructions:
Setup Rhubarb:
Go to github.com/Dan...
Download the latest release.
Extract all into somewhere safe on your drive, make note of the path where the rhubarb executable is.
In OpenToonz, go to File, Preferences... and select Auto Lip-Sync category.
Put the full path from step 2 into the Rhubarb Path box.
Close the Preferences window.
Apply lip sync
Import audio (drag/drop into OpenToonz)
Create 10 mouth shapes in a single level & expose on timeline
(if importing images, name them as an image sequence)
Right click on the timeline and choose Lip Sync, Apply auto lip sync to column
In popup dialog, choose your drawings (draw them in order for them to already be selected)
Click Apply
Useful links:
Manually adjusting your lip sync: • Manual lip sync in ope...
#OpenToonz #Animation #animationLipSync #lipSync
--------------------------------------------------------------
Support me and gain extra benefits by becoming a Patron: / darrent
Want to learn more about OpenToonz? Check out my Udemy course, with this discount link: bit.ly/OpenToon...
If you liked what you see and want to help out, you treat me a coffee or a Darren Tea ;-)
www.buymeacoff...
Check out useful OpenToonz-companion software & projects that you can download or purchase:
gumroad.com/Da...
The kit I use and recommendations of useful books:
kit.co/DarrenT
--------------------------------------------------------------
Discord; for help setting up and using OpenToonz, chat with animators & developers and enter animation challenges. And my other socials:
Discord: / discord
Twitter: / darrentanims
Insta: / darrentanims
Facebook: DarrenTA...
Twitch: / darrentanims
#OpenToonz #Tahoma2D #Animation #autolipsync
*Thanks for watching.* Details & links are in the description
Manually adjusting your lip sync: ua-cam.com/video/1mRM9o_uE_0/v-deo.html
I been waiting for this one since you mentioned this as one of the new features in Opentoonz. Thanks for your hard work because that's going to help me with my book ads & an idea I had for digital birthday greetings for kids in my family from comic book characters. Once again thank you good sir hope you have a great weekend.
Great video! Very well put together, thanks for the hard work!
Thank you.
I'm glad you enjoyed it 😀
I really like you for showing this manually!! (as shown in the link) The idea of having an algoritme doing something this fun seems to be a tremendous setback to me. It's what students had the most out of, when staying at our studio.
Absolutely. There's times where using the automatic tools speeds up the process and times where you can manually make a character talk, that feels more special.
But even after using the automatic tools, the manual step really adds that special magic to bringing a character to life,
@@DarrenTAnims did follow this tutorial, but it won't work.
@@Rover259Wild You'll have to give me some clues as to what didn't work.
What did you do?
What result did you get?
@@DarrenTAnims I put the mouth shapes in the right order, and the paste the lines, after I press apply, an error came up.
@@Rover259Wild and what did the error say?
I love the drawing style you used here
Thank you my friend 😊
Holy shit, thank you for this tutorial. I have no real knowledge of the technical side of software, so I was lost with the command line method explained by the creator of Rhubarb. And the OpenToonz documentation on their own site wasn't quite thorough. I FINALLY got this work with your help. Thank you so much.
Glad it helped 😀
Thanks. It took me two weeks to get that dialogue out of my system. Now I can start all over again.
It's still in my head!
If it's in my head, it can be in yours 😁
There's one more week of it, so watch out... or that might be 2.
This is actually very helpful! Cheers!
Thanks 😀
This is great!
Thank's for the upload.
Thanks buddy 😊
Great Lesson , thankyou Darren
Cheers 😀
love ur work keep it up
Thanks Electron 😊
Thank you for this video. It was incredibly helpful. I have a problem though. Is there a way to start the lip syncing at a certain from or does it have to start at the first frame? I need it to begin at a certain frame but it just starts off at the first. Obviously this is a problem if I want a character to wait a bit.
Hmmm. I'm trying to remember. I seem to recall that there is a tickbox to choose to extend the rest shape to the end. I don't know if that will not add it at the start as well.
If not, then you'll just have to delete them.
Alternatively, if you make your scenes shorter, to just contain 1 shot, as I always recommend, then you won't need to worry about showing the mouth shapes for the whole scene.
Rhubard processing error:
Error processing file C:\...
Error performing speech recogieron via PocketSphinx tools.
Could not determine path of bin directory.
canonical
That's the error that shows when I try to ato lipsync. Somebady help me?
I'm not sure what this issue could be with this, sorry.
Hopefully, someone else will read your comment and share something to help.
@@DarrenTAnims don't worry. I already solved it :D
I just had to put the rhubarb folder into the opentoonz stuff folder
When I set up the lip sync, the pop pop that is shown at five minutes and 11 seconds takes up my entire screen and I can't scroll down in order to press apply or any of the bottom mow buttons.
You should try to change your screen resolution down or change the screen scaling down to 100% to see more.
@@DarrenTAnims it worked, thank you so much!
Hi please I need help. My opentoonz is telling me "Rhubarb processing error" and I don't know what to do, I'm just so frustrated rn. I've been searching for an answer everywhere but no luck
There's not a lot to go on there.
All I can suggest is to try another file. Or maybe try saving it at a different bit rate, 8, 16 or 32.
The open toonz has to be linked to the open file and not the file it’s self, give that a try
i needed this
I hope it helped
I need help. When the mouths menu selection opens up it only displays one mouth in all squares and the arrows do absolutely nothing even tho all of them are loaded and visible in the scene. What's wrong? I feel this is not intuitive at all. Why wouldn't it just let me add a file for each mouth. I'm truly lost here.
The mouths all need to be part of the same level to show on that dialog. Otherwise, how does OpenToonz know what to show. I'm guessing you've drawn them outside of OpenToonz and loaded 10 different drawings in. If you name them as an image sequence you can use them. Or create a new level and use the selection tool to copy/paste them into 10 frames of that level.
@@DarrenTAnims you were a 100% correct. Thank you so much! I was trying to figure it out by myself and got stuck for a couple of hours. Was exporting from Autodesk. I still think it wouldn't kill for the program to be able to just give you "right click, Create image sequence in this column, select images" and just let you browse them. Regardless, got it running pretty decent. Thanks for the help!
@@Not.The_Gallery You can do that from the browser room; renaming an image sequence in a different way. But it would be REALLY useful to be able to do this from the timeline, yes.
This is just one area where OpenToonz is quite particular in what it expects. But once you understand it, it becomes second nature.
Happy lip syncing! 😀
Do I need the latest version of opentoonz for Rhubarb to work? Is version 1.4 okay to use?
I don't believe there is auto lip sync in v 1.4.
Besides, that's a very old version. Around 3 years out of date, with many bugs in it that have been fixed in newer versions. I think it's probablytime to bite the bullet and update to the latest version.
I just downloaded the latest version of opentoonz, and it worked great! Thank you!
Hi Darren i have a question (or a video idea) about lip sync for robots/this with abnormal mouth movements
is there a way (or how does one do this) to auto lip sync by volume/sine wave? the 10 frame system here won't work for me.
i plan to start making videos and i plan to animate my face cam using my (slowly expanding) library of animated movements.
now my avatar doesn't have a mouth. it has 12 lights that have 36 frames (off, dim and full) and what i want to do is set up the mouth sequence to go up a stage for every 3% of the volume.
I don't have a particular program i plan to use yet. im trying to see what one has the capability i want then ill learn how to use it
Google, UA-cam and Reddit have yet to help me and im just learning to use a animation program to stich my frames together so i don't know what exactly im searching for
It sounds like you need to program this yourself. There's nothing like this out there. But it sounds pretty straight forward for someone that knows what they're doing. The scene file is a text file, so you could write to it to show the appropriate "mouth shape" on the appropriate frame, depending on the volume.
But if you don't want to do this, then you could just add 10 drawings with the lights at different brightnesses, to give the impression of them matching the voice.
Great video But in tahoma there's no auto lip sync panel on preferences
You don't need to setup Rhubarb in Tahoma. It comes with it setup (the same as it comes with ffmpeg).
But if you wanted to use an updated version of Rhubarb, you set it up in the 3rd Party Apps section.
Hi Darren, thanks for this video. I'm having a real problem importing an image sequence of mouth shapes and I wonder if you could help me. I have 10 mouth shapes I'm trying to import and I have named them correctly as you describe in your other video. When I import them they load into separate columns and the actual image is not visible. When I import them individually I can see the image but I cannot get the image into the mouth level, it puts it into a separate level. I have no idea what I'm doing wrong..I'm hoping you might?! I'm new to Opentoonz so this is all still quite confusing. Thanks again
Can you tell me what names you've used? If they're not importing as an image sequence then it's always the name of the files that's the problem.
Hi Darren thanks for replying to me. I checked my file names and lo and behold I’d messed one of the numbers up! Thanks so much for all your videos, as a newbie they’re really helping me to learn the program
Hi can you make a video on lip sync for moving characters, I am facing a problem, do you have a way to fix it?
I don't know what you're problem is, so no, I can't fix it.
But regarding lip sync for moving characters, you either connect the mouth column to the head column on the stage schematic, so that when you move the head, the mouth moves. Or you place each mouth on the face, 1 at a time.
@@DarrenTAnims I fix it now. it's ok
Thanks
You're welcome 😀
hi darren please help me when I want to do a lip sync suddenly this message appears, I searched various sources and didn't find an answer, before I used the same audio file and it ran and the second time I did it and suddenly this error appeared;
Error processing file C:Users\USER\AppData\Local\OpenToonz\cache
hubarb\temp.wav
Error performing speech recognition via PoketSphinx tools.
Could not determine path of bin directory.
I can only assume that you changed something for the same file to not work on different days.
Have you moved or deleted the Rhubard files?
Maybe you've changed the settings in Preferences? Check those.
Failing that, try deleting the files in the cached folder.
@@DarrenTAnims I didn't change anything, but now I'm using the older version and for now it works, thanks Darren
thanks
😀
*Rhubarb Processing Error:*
*Frame rate must be between 24 and 100.*
How to solve this problem if i want to make 12 fps animation ??
You'll have to set your fps to 24 and show all of your drawings on 2s. I didn't realise this was a restriction. I only ever use 24fps.
I have a question. If you set up the mouths on another file and then want to apply the mouths to a different project, how can I do that? Basically I dont know how to make a lip sync file.
You can load a drawing level from any other project and use it in a scene. Just right click on your timeline and choose Load Level, then browse to the drawing level in the other project.
@@DarrenTAnims ok, thanks! this helped a ton
Makasih banyak 🙏🏻
Terima kasih kembali. Senang Anda menikmati videonya
---
Q. Thanks a lot
A. You're welcome. Glad you're enjoying the videos
how do you get all the mouths on the same level? importing them creates a separate level for each one
I think I got it. I just had to watch your other video on importing sequences
Glad you've found it.
The naming of the files is the important key for importing images as a single level.
Great video. I do have 2 questions. One is an issue and one is something I just can't figure out. When I import all of the mouth files as a sequence, How do I have all of the mouth levels on the first frame? also, when I right click on the first frame, there is no Auto Lip Sync option to select from. I have already put unzipped folder where you did. I made sure the .exe is in the folder. I made sure that the file location is exactly as you have it and I closed out OT and loaded back in.
Edit: I figured out the lip sync issue. I was right clicking the key rather than on the frame itself.
So is this all working for you now?
@@DarrenTAnims sort of. it works and i figured everything out but now it is saying that it is having an error when i try to load in the sequence. I am using papagayo right now. it works fine but it takes a lot more time to lip sync. it took me around 5 hours to do 3 minutes of video.
You say you're getting an error when you load in the sequence... Do you mean when you import the image sequence?
Do we have to draw all the lips sync everytime we have a new project or can we save it as dwfault for all our projects???
Hello everyone, I have a problem, when I have to do the thing at minute 4:44 it won't let me, I get a warning that says "rhubarb not found, please set the location in preferences." I'm new to everything, I would appreciate the help.
Have you set up Rhubarb in OpenToonz?
I already fixed it, I had it configured wrong, thank you very much anyway, your videos help me a lot@@DarrenTAnims
So I followed all the directions, but it’s still not working I’m also using a mac. Now I did see something about the terminal is invalid with the command line argument, Could this be a error on there end or mines? Plus I’m not using tahoma 2d so that also could be a possibility on why it’s not working. thank you for the dope video and I’m looking forward to seeing more !!!
I'd need more detail about what's not working and what stage you'd got up to. Ideally, with screenshots. The best way to continue this kind of conversation is on my Discord server, where you can share screenshots and videos showing the problem.
The problem could be something very simple or very specific to your computer. I can't tell atm.
@@DarrenTAnims okay cool! I'm looking into it right now
Hola! Amigo has un video de como hacer un giro de un personaje con controladores como se hace en Moho! Gracias!
Hola. Me temo que no puedes hacer eso en OpenToonz. Está dirigido a la animación tradicional dibujada a mano.
@@DarrenTAnims Y en la animación por vectores, se puede hacer eso?
thank you so much
I'm pleased it helped 😊
It says “rhubarb is not found” for me even i pasted the file path. What should i do ?
Don't forget to restart OpenToonz after setting the path.
If it's still showing that message, then you must have set the path wrong. Check the executable is in the folder that you're pointing to.
I'm lost at step 2, I've drawn all my character limbs and mouth shapes. But I have no idea how to set them up. When I drag the assets into opentoonz it creates about 50 or so columns. How do I set it up the way you have it setup? Do you have a tutorial on this? I very lost with opentoonz, it seems so complex to me.
In step 2 (at 3:00) I mention that you have to import your images to the same column, you have to name your images correctly, as an image sequence, and show a link to a video that explains about image sequences.
Basically, you have to name your images in the format: image_0001.png, image_0002.png, etc
Ideally, you'll draw your mouth shapes inside OpenToonz, and then you wouldn't have this issue.
OpenToonz might seem complex right now, but take it one step at a time and you'll get it.
Keep at it. I've got faith in you 🙂
@@DarrenTAnims Thank you for your reply. I drew all my layers and saved them as png files. How do I import the layers into a single column? Where do I click to do this? I will try again this evening after work. Thank you for your tutorials :)
You are best
😊
@@DarrenTAnims i need help with something
Does it have to be 10 different mouth shapes?
They don't have to be different, but you need 10 images, yes.
@@DarrenTAnims Thank you so much bro
how do you flip the selected design to the other side horizontally?
If it's a single image, then select it with the selection tool and in the H box on the options toolbar, it'll show 100%. Change this to -100%. In Tahoma2D, you'll see a button to do this.
@@DarrenTAnims thanks. It worked out
teacher tahoma looks familiar to opentoonz
Tahoma is 95% identical to OpenToonz, with a simpler interface and a few different features. I use both programs interchangeably.
@@DarrenTAnims thanks darren
Is Rhubarb free for commercial use ?
Yes it is! 😀
@@DarrenTAnims Thanks Darren. That's great news . Keep making these helpful contents .
unfortunately it doesn't works on 12 frame
If you mean setting your scene to 12fp, it should work just fine. But don't change the fps once you import it or you'll have to import it again.
@@DarrenTAnims I did but I get an error says "Rhubarb only works on fps from 24 -100"
guess I will use 24s from now on
Ah yes. It requires 24fps. I always use 24fps, so I forgot about that.
I regret leaving opentoonz, but I'll be back
Arnold? Is that you?
😄 OpenToonz is ready for you when you're ready.
@@DarrenTAnims I have a question from opentoonz. How to use a character without modifying the original from another scene? how to copy a layer from the same scene and be able to make changes to it without having influence from the previous layer?
@@ciberpunk2325 You just need to copy it first. You can either copy it using your normal file copying methods, use the browser room, or while on the timeline, you can highlight the cells and use the Clone Cells command from the menu.
hi darren it seems i have prob .i cant type in the note level when i double click
It can be a little tricky at times. It seems that the note level doesn't always work. Try restarting and see if that helps
@@DarrenTAnims i did restart several times .when i double click on it i can only rename the level .i would like to make a conversation .anything els can help?
I seem to recall that I couldn't double click on a frame that had a gap to its left. I had to double click on a frame following one with text in, then move it afterwards. I can't remember if this was every time or just sometimes, but it's worth trying.
@@DarrenTAnims i can double click and rename but i cant make text on note level to use the tex effect it only rename the level and not insert the text .i was trying to do the same as you did on the storyboard video
Are you using a note level or the text effect?
How did you create it?
Dear tutor, Can you tell me the method of animating vector art (lines and shapes) in animation like using keyframes(in tahoma)? And other one is can I use same level in time line and animate it frame by frame ( in tahoma)? Thank you
The term, "Keyframes" means so many different things. It can be used to mean the key frames when using the pose to pose method. Or when using interpolation when using the animation or plastic tools or when using the vector auto-inbetweening. So it's hard to answer that. If you can clarify what you're trying to do, I'm sure I can help.
Re, animating frame by frame. Again, I'm not sure what you're asking. Animating frame by frame in a level is the basics of what Tahoma does. If you can tell me what you're trying to achieve, then I can help.
@@DarrenTAnims yes Darren its difficult to explain my problem simply I want to animate(move points in my art) my vector art in frames I used keyframe option to do it(located in bottom of the workspace)but with that wasn't move in the frames(changed my whole art)....simply I want to animate points in my vector art (is it possible in tahoma).....Thank you
@@DarrenTAnims I think it calls auto betweening😂 can I do it from keyframe tool?
Ahh, you want to animate the vector control points. You can't do that in OpenToonz or Tahoma as easily as I'm other programs, but you can animate them using the auto inbetween factor. I've made a couple of videos about this that might help.
@@DarrenTAnims yes tutor I saw that videos today then I understood the thing.....Thank you for the helps you're a great tutor and my god of animations😇 Thank you again..I'm from LK..
hi, when I click apply only 5% analyzing video and not working the auto lipsync please guide where I'm doing a mistake. thanks I'll wait your reply
If it starts analysing the audio, you're not doing anything wrong. If it's having trouble reading the audio, maybe you should try different audio - maybe change the bit rate? If you're not using the latest version (1.7) then try downloading that. It has support for more audio formats (although I don't know if that changes the Rhubarb lip sync evaluation)
@@DarrenTAnims thanks darren for reply. What is bit rate. I'm using 1.7already. I'm trying in song should be it audio recording track?
@@Car-toonz Ideally it should be just talking, not any music.
The bit rate is an audio setting. You can change bit rate using audio editors, like Audacity (free).
@@DarrenTAnims thanks darren I try audiocity & inform you please tell me what should be audio rate
@@Car-toonz I don't remember. Try 8bit, 16bit & 32bit. One of those should work.
Bye Adobe
😁