Thank you Tao for keeping us informed about the latest developments with Kling AI and other tools like Minimax. I have learned a great deal from your tutorials and appreciate the clarity with which you demonstrate how to use these tools. Your hard work is greatly appreciated. Please continue creating content, as capturing our audience’s attention with beautiful and high-quality content is what truly matters, and you deserve all the recognition for it.
THIS - IS - INCREDIBLE!! Thank you so much for letting us know and the clear instructions...the two programs I'm using now do not allow for prompting...and the bodies remain stiff about 85% of the time, so this is exciting!! I will try it out this weekend. Thank you so very much Tao!!
Thank you! Yeah, Kling is doing some really cool stuff right now. You can make pretty good quality short videos by combing Kling, Runway and all the other new platforms coming out
Thank you Tao for your work and those tutos. Could you make a video where you would explain which AI video app is, according your opinion, the best one ? It seems Kling is you first choice isn’t ?
With the 2 person video: to get the woman to speak perhaps you could edit the source video, blur out the mans face (with tracking) and then use that to force the AI to detect and use the womans face (which should be dominant) - then use the output to combo-edit the clip with the same of the man speaking. Just an idea - I havent tried it :)
Thank you Tao, it was a wonderful video. You answered all the questions I had in my mind, I have only one question. What should we do if we want to show someone's feelings? For example, someone is angry and shouting or she is sad and crying?
Glad this helped with your questions 👍. To show facial expressions, I would generate those inside the "base video" before applying the lip sync. Once you have that, the lip sync can be added on top
Very neat, but still prefer LipDub AI as it allows you to choose the actor or actors that you want to lip sync in the scene, and provides Hollywood quality lip-sync
Different approach... you can use kling AI to make your training footage to use in LipDub. You need a 1min footage to train LipDub. It doesn't make the first lipsync if you were using an image without mouth movement. One does not substitute the other.
@@taoprompts I just did my interview with LipDub's Andrew. I got access to Beta. I will now make a really crazy video soon! I want it to be crazy good so itll prolly take me a week to produce.
Thanks for all your great videos. I tried it immediately. It converted naturally even if the microphone was somewhat covered by my mouth. Too bad I can't extend it. I guess the only way to do it now is to generate it again at the last frame and connect it?
Yeah I think that would be the best way to do it. Kling 1.5 doesn't support extending videos yet, although version 1.0 does let you extend 5 extra seconds
I think Kling is better for a single character. But if you have multiple characters in the same shot, runway does give you more control over which character you want to lip sync with.
Hello, I just saw pika update 1.5 on video, it looks crazy. We can put quite realistic effects. Object explosion, inflation effect etc... Ps: I made shorts with kling ai, it's my last short, don't hesitate to give me strength, thank you 🙏🙏🙏
with all these video generators and kling being around, do we even need sora? i mean when they first showed it it was something never seen before but instead of just releasing it they chose to keep working on it so it better be something groundbreaking
Do you know a way to stop the aperture from changing when the light changes I find that if there are light changes, it's like the camera is stopping up and stopping down. I've tried negative prompts but no luck.
Thanks. Kling is looking like a good option, but there is no payment option with PayPal or Apple, etc. No way, no how, am I submitting my credit card info to an overseas company in China. I hope they change that.
@@taoprompts Thanks. I just watched a good compassion between Runway, Kling, PixVerse and Luma. Kling kept coming out on top with Runway kissing it. However, unlike Kling, Runway DOES have the unlimited monthly which means, getting more prompts than Kling. I had some decent results with Runway's trial and will consider it. ✌
Can you use any video you want or even an image or does it have to be a clip generated with their tech? Also what is the maximum length of syncing? Thanks.
@@taoprompts Thanks, I have found some other similar information from "NVIDIA's Generative AI NIM Agent Blueprints for Developers" on UA-cam. You should also check it, it's interesting
hello, can you tell me which paid version of kling AI is perfect to buy as a beginner.....but let me clear you that i am planning to create 10 minute videos like short films with dialogue deliveries in hindi.
For a video that long, I would purchase the $80/month plan if you use professional generation model which I do. If you use standard generation mode, a cheaper plan will work
Hey Tao. How are you today my friend. I've bought a premium subscription for for kling but I found out that it's videos are like slow motion unlike minimax videos which appears natural motion like normal movies. I want to make realistic normal videos not slow motion. Is there a fix for this?
Hey, did you try using Kling version 1.5? I find that the motion is faster than in version 1.0. Sometimes I will speed the videos up a bit in post processing maybe 1.2 - 1.5x speed.
Heres the problem with 100% of all these lip sync attempting AI platforms. Voiceover work as we are all used to from hollywood productions is not just lip sync, its ambiance/environment tone and the characters voice, energy, delivery and cadence must match as well. This is why it always sounds OFF. Theres also a misalignment of Mic proximity that throws everything off. These AI voices all sound Podcasty or Audiobookish. They do not sound like a boom mic thats a few feet away from the actual actor whos onset. Voice overdubbing is an Art that cannot be easily replicated by AI, it will take some time for us to get there. but in due time maybe
Yes the Ai voices do sound a bit out of place, but the tech is pretty amazing. I think it will be easier to correct the sound than to animate the lips and facial movements
@@taoprompts that is true. As far as adding background, environment, noise, room Echo, etc, but even after that, the cadence and other little nuances will never match that easily. We have to remember that as humans, we are absolute experts at seeing facial expressions and lip sync all day every day of our lives. So even the slightest deviation and it seems uncanny valley. I do have to admit, however, seeing what AI has been able to accomplish over these past couple of years, I think we will definitely get there soon where facial expressions, cadence, room tone, ambience and everything else needed to make lip sync believable from an AI character will be in our fingertips before we know it.
Thank you Tao for keeping us informed about the latest developments with Kling AI and other tools like Minimax. I have learned a great deal from your tutorials and appreciate the clarity with which you demonstrate how to use these tools. Your hard work is greatly appreciated. Please continue creating content, as capturing our audience’s attention with beautiful and high-quality content is what truly matters, and you deserve all the recognition for it.
Wow... I had NO IDEA Kling was even working on Lip Sync... And We can use a 16:9 Aspect Ratio! Bro Kling is a beast! Finally!!!
I didn't know either, this was a big surprise! They've really been on top of it lately
OH God! My man, you just made my weekend! Thank you. I didn't even know they were working on this!
THIS - IS - INCREDIBLE!! Thank you so much for letting us know and the clear instructions...the two programs I'm using now do not allow for prompting...and the bodies remain stiff about 85% of the time, so this is exciting!! I will try it out this weekend. Thank you so very much Tao!!
Another great video Tao! Kling look like they are upping their game. It feels like AI filmmaking 📽could take off commercially within the next year 🚀🤘
Thank you! Yeah, Kling is doing some really cool stuff right now. You can make pretty good quality short videos by combing Kling, Runway and all the other new platforms coming out
How cool, Kling is getting better and better!!
They keep adding so many new updates, it's hard to keep up 🔥
@@taoprompts haha, yes, but you are doing an awesome job :)
I was Actually Waiting for you to do this video, Awesoem Video my Dude
This was a great surprise, I had no idea they planned on releasing something like this 👍
Thank you so much for your experiments and your generosity. Greetings from Italy
Oh yes, I've been wanting to do this for a long time. Thanks for this and all the other videos.
Same here, I'm going to play around with this a lot 👍
👏🏻This news made my day. Thankyou!✨️💃🙏
Same here, this was an awesome surprise 🎉
Amazing video like always ! nice and thanks for this :)
Awesome can't wait to try it out.
Awesomeness! 🎉
Thank you for this video , Tao
Saving to watch later! Too many updates lately 😂
This week was crazy, it's hard to keep up 😩
@@taoprompts trueee 🤣🤣🤣
thanks:)
Good job bro
Thanks man 👍
Aaaaashh man I wish they can make multi lipsyncing just like runway
yeah that would be really nice, a lot of scenes have multiple characters in them
very useful tutorial!
Thank you 🙏
That's cool
Thank you Tao for your work and those tutos. Could you make a video where you would explain which AI video app is, according your opinion, the best one ? It seems Kling is you first choice isn’t ?
Thank you fabuloso
With the 2 person video: to get the woman to speak perhaps you could edit the source video, blur out the mans face (with tracking) and then use that to force the AI to detect and use the womans face (which should be dominant) - then use the output to combo-edit the clip with the same of the man speaking. Just an idea - I havent tried it :)
I was trying to think of different ways to make the woman talk, that would be super useful. Thanks for the suggestion 👍
marvelous ! is it works with a song by the way? :)
Thank you Tao, it was a wonderful video. You answered all the questions I had in my mind, I have only one question. What should we do if we want to show someone's feelings? For example, someone is angry and shouting or she is sad and crying?
Glad this helped with your questions 👍. To show facial expressions, I would generate those inside the "base video" before applying the lip sync. Once you have that, the lip sync can be added on top
I like the anime kid outting himself for sloppy lip sync. Thanks for the prompts, Tao! Heading over to Kling! (How do you pronounce it?)
❤❤❤❤🎉😊 awesome
Dude, can you cover the new Pika 1.5?
Very neat, but still prefer LipDub AI as it allows you to choose the actor or actors that you want to lip sync in the scene, and provides Hollywood quality lip-sync
Well lipdub is in beta and not many people have access... Everyone has access to this.
Different approach... you can use kling AI to make your training footage to use in LipDub. You need a 1min footage to train LipDub. It doesn't make the first lipsync if you were using an image without mouth movement.
One does not substitute the other.
@@eltonfelix8599 Unsure what you mean, do you have a video or link I can watch?
I haven't tried that out yet, thanks for suggesting. It seems like there's so many lip sync platforms popping up now
@@taoprompts I just did my interview with LipDub's Andrew. I got access to Beta. I will now make a really crazy video soon! I want it to be crazy good so itll prolly take me a week to produce.
Minimax has come up with image to video. Plz cover that as well
Its coming out anyday. Its not out yet.
I plan on it 🙏
Hi Tao, thanks for all the info, very much appreciated. Do you know if there's an Unlimited type package available on Klingai?
Thanks for all your great videos. I tried it immediately. It converted naturally even if the microphone was somewhat covered by my mouth.
Too bad I can't extend it.
I guess the only way to do it now is to generate it again at the last frame and connect it?
Yeah I think that would be the best way to do it. Kling 1.5 doesn't support extending videos yet, although version 1.0 does let you extend 5 extra seconds
@@taoprompts Thank you. I tried it as soon as possible. I made it public here as well.
Cancelling Runway subscription completely now lol. Chinese companies are going to take the whole industry. Bytedance is coming in now to!
The previews for the Bytedance model look really incredible 👍
Which is more natural, the runway gen3 lip sync?
I think Kling is better for a single character. But if you have multiple characters in the same shot, runway does give you more control over which character you want to lip sync with.
Once again K ling ahead on realism
They've been on a roll lately!
Love your channel, I want to make animals (Cats) talk. can you make a video on that please? or guide me in the right direction?
I don't think this will work with animals, I haven't seen any software that can do that
@@taoprompts Okay Thanks. Would Be Great If you come across one.
Hello, I just saw pika update 1.5 on video, it looks crazy. We can put quite realistic effects. Object explosion, inflation effect etc... Ps: I made shorts with kling ai, it's my last short, don't hesitate to give me strength, thank you 🙏🙏🙏
You're animations are always so creative 👍, the ambient noises and music make them relaxing in a way
@@taoprompts Thank you very much Tao and thank you again for your valuable advice.
Tnx for the video. Can you please let us know why Klingai takes 1day to 3days to render the video, paid and free both 🙏
I don't know why, maybe because too many users
with all these video generators and kling being around, do we even need sora? i mean when they first showed it it was something never seen before but instead of just releasing it they chose to keep working on it so it better be something groundbreaking
Idk what's going on with Sora, it seems like openai is more focused on the language models. Their hype has definitely died down though
Stuck on “ generating video “ for a day already on 2 attempts
What prompt do you use for Pixar 3d Animation in kling? I don't get good results with this style in Kling
I use image-to-video, so I generate pixar style images first then animate them, which seems to work better
nice.. but do we need to make a video first, can't I just upload my own video?
This won't work with your own videos unfortunately
How well does this work with singing audio? Like, if I have an acapella singing track, can it reliably make a person in a scene lip-sync to that song?
I've tried with pop songs, it works 👍, although slightly less realistic than just speaking
Do you know a way to stop the aperture from changing when the light changes I find that if there are light changes, it's like the camera is stopping up and stopping down. I've tried negative prompts but no luck.
I haven't seen anyway great to deal with that, usually I'll try to prompt for smaller motions which I find will limit the lighting changes also
Thanks. Kling is looking like a good option, but there is no payment option with PayPal or Apple, etc. No way, no how, am I submitting my credit card info to an overseas company in China. I hope they change that.
Runway is a decent alternative, I find in many cases it produces more usable videos than Kling
@@taoprompts Thanks. I just watched a good compassion between Runway, Kling, PixVerse and Luma. Kling kept coming out on top with Runway kissing it. However, unlike Kling, Runway DOES have the unlimited monthly which means, getting more prompts than Kling. I had some decent results with Runway's trial and will consider it. ✌
Can you use any video you want or even an image or does it have to be a clip generated with their tech? Also what is the maximum length of syncing? Thanks.
It needs to be generated by them, 10s is the max right now
One qustion Do you know any Ai that introduced on Meta AI Avator named Persona... can you please do more video about it
I haven't heard much about that, if meta releases an Ai video model I will probably cover it
@@taoprompts Thanks, I have found some other similar information from "NVIDIA's Generative AI NIM Agent Blueprints for Developers" on UA-cam. You should also check it, it's interesting
Hello Tao! Have you tried to Lipsync more than 10 seconds video? in my case they don't. I can't click the "Match Mouth Type" button.
Hey, I've only tried for 5 and 10 second videos. Sometimes it takes a few tries to make it work, I think the interface might still be buggy.
@@taoprompts thanks. Cause I think it's useless to limit to 10 seconds since we can upload up to 60 seconds audio. Haha
Can you make 10 minutes video? If yes, share me links please so I can learn.
hello, can you tell me which paid version of kling AI is perfect to buy as a beginner.....but let me clear you that i am planning to create 10 minute videos like short films with dialogue deliveries in hindi.
For a video that long, I would purchase the $80/month plan if you use professional generation model which I do. If you use standard generation mode, a cheaper plan will work
I wish they would work on making their aesthetics better and their control better before they start adding all of these features.
They definitely need to add camera controls to image-to-video generation as well
2nd, someone beat me 😅
It's always great to hear from you 💯
How i can add item to picture? I want to create a photo of a woman holding my purse. How do I do that? Can you help?
The best way is to train a Lora model with images of your purse, and then generate an image of someone holding that purse. Or photoshop
Can't I upload my own video generated else where?
You can't use this on videos from other platforms as far as I know
Hey Tao. How are you today my friend. I've bought a premium subscription for for kling but I found out that it's videos are like slow motion unlike minimax videos which appears natural motion like normal movies. I want to make realistic normal videos not slow motion. Is there a fix for this?
Hey, did you try using Kling version 1.5? I find that the motion is faster than in version 1.0. Sometimes I will speed the videos up a bit in post processing maybe 1.2 - 1.5x speed.
Heres the problem with 100% of all these lip sync attempting AI platforms. Voiceover work as we are all used to from hollywood productions is not just lip sync, its ambiance/environment tone and the characters voice, energy, delivery and cadence must match as well. This is why it always sounds OFF. Theres also a misalignment of Mic proximity that throws everything off. These AI voices all sound Podcasty or Audiobookish. They do not sound like a boom mic thats a few feet away from the actual actor whos onset.
Voice overdubbing is an Art that cannot be easily replicated by AI, it will take some time for us to get there. but in due time maybe
Yes the Ai voices do sound a bit out of place, but the tech is pretty amazing. I think it will be easier to correct the sound than to animate the lips and facial movements
@@taoprompts that is true. As far as adding background, environment, noise, room Echo, etc, but even after that, the cadence and other little nuances will never match that easily. We have to remember that as humans, we are absolute experts at seeing facial expressions and lip sync all day every day of our lives. So even the slightest deviation and it seems uncanny valley. I do have to admit, however, seeing what AI has been able to accomplish over these past couple of years, I think we will definitely get there soon where facial expressions, cadence, room tone, ambience and everything else needed to make lip sync believable from an AI character will be in our fingertips before we know it.
@@BabylonBaller Agreed, it's going to be an exciting couple of years
LipDub AI can create a new dub based on the original input voice, which sounds much more natural.
ua-cam.com/video/o2b7V0pa_fQ/v-deo.html
I prefer hedra ai is the best
I just found out that it is actually pronounced Kay-Ling.
I had no idea!
It's not that good tho
Do honestly not look good, easy to see its AI
Very expensive and bad result 🤮🤮