Superb Video to AI Animation Tool - DomoAI
Вставка
- Опубліковано 10 чер 2024
- Find out more about the NEW AI Animation App Directory, and register as an AI creative for free at aianimation.com.
The first part of this video is a quick overview of the new video-to-video AI animation generation feature from DomoAI. I then move into a much more in-depth tutorial, where I improve the lip-syncing of the character animation and combine it with an AI 3D-generated background, AI HDR lighting, and some classic digital motion graphic techniques.
------------------- -------------------- ---------------------
Times
0:00 - Awesome Intro
0:32 - DomoAI
4:53 - Upscaling
5:31 - DomoAI (cont)
6:08 - NEW AI Animation App Directory
7:01 - AI Green Screen
7:51 - DomoAI
8:28 - 3D Background - Zoe + AE
9:49 - Lip Syncing
11:03 - After Effects
12:52 - HDR Map
14:16 - After Effects (continued)
19:30 - Final Result
------------------- -------------------- ---------------------
Tools Used in this Tutorial:
- DomoAI
domoai.app/
- Topaz Labs Video AI: (affiliate link)
topazlabs.com/ref/2271/
- ChatGPT (Dalle3)
chat.openai.com
(*You could also use, Leonardo.ai, a Stable Diffusion option or MidJourney.)
- Zoe Depth
huggingface.co/spaces/shariqf...
- Sync Labs
synclabs.so
- Blockade Labs
www.blockadelabs.com/
- Runway ML
runwayml.com/
- Adobe Photoshop
www.adobe.com/uk/creativeclou...
- Adobe After Effects
www.adobe.com/uk/creativeclou...
- Stock Footage - Envato elements: (*For stock footage of star field flying out of windows used in final composite)
elements.envato.com/
------------------- -------------------- ---------------------
After Effects Plugins:
Sabre:
www.videocopilot.net/blog/201...
You could also try adding a bit of:
Optical Flares:
www.videocopilot.net/products...
------------------- -------------------- --------------------- - Фільми й анімація
100k views n a month. Wow!!... thanks everyone for watching! Good luck with your own AI creative creations.! ... I'm busy working on some NEW AI related projects that I can hopefully share soon.
You have demonstrated how to destroy, cel animators, 3D character animators and VFX artistes in a jiffy. If I did not follow you or subscribed to your channel I would have been out of audiovisual business soon. This is a real disruption in the industry.
Wow. Thank you for taking the time and effort to share the variety of ways to create ai animations. You provided us with a lot to think about. More videos, please.
Thank you for putting in the time and effort creating these videos, you have helped me learn so much along the way!
Crazy tutorial. I never would have guessed it took so many steps. Thanks a bunch!
Loving your tutorials and tools updates! It’s inspiring
This is truly a great tutorial, I enjoy how much it shows the advancement in what can be done already. I could't at all keep up with all, but enjoyed the jest of it all. Great work as always!!!!
Fantastic Tutorial here!! The AE side was REALLY well covered! Cheers man, this is (insert Fire Emoji)!
Thanks Tim!!...
As you know, big fan of your channel content too. [🔥]
Some of the renders came out great!
WOW what a fantastic and detailed demonstration of this killer new animation tool and your process. So many great techniques shared as well! Thank you so much for your hard work and the brilliant ideation in implementing the wide array of emerging tools to get crisp and gorgeous animations. Fantastic work! ✨🦋✨
Such a fun tutorial! I love all the detail you put into this walk-through. I want to try it all. Your tutorial skills are truly top-notch!
Amazing work! Thank you!
This is the channel I was looking for! Thank you so much I finally can do vids to all my music like I want to!
Another amazing tutorial thank you! With these high quality videos you will be a giant in the AI animation space by the end of this year! Fantastic work!
This was AMAZING!!!!!
Amazing, great video, thanks
Very nice. Love to see Pika and Runway getting some competitors.
Thank you for sharing!
Awesome! Keep it up!
Thank you - great video - I am waiting for a part two:)
Wow! Great tut!! These tools are really starting to come together!!
Great work!! Thanks for sharing
Really interesting. It is always good to have more options for creation... and more techniques. I really enjoy your tutorials. (PS your son is really cute.. and I have a feeling he will be making videos and stories too in the future!)
This tutorial is fantastic. Can’t wait to try this. So much useful info. Thanks!!😮
Wow! Incredible, man! Thank you so much for putting this instructional video together!
Truly amazing workflow tutorial!
This is awesome. Loving your content and Thanks for creating a community around this. Can't wait to join and share work
Excellent video thanks
amazing content man!!!! thank you so much very inspiring 🙏🤘
This is a great video, thanks a lot!😮
Great stuff!
Amazing video very informative
Thank you for all of this!
That was a really good tutorial, thank you so much for sharing that with us. Liked and Subed
Awesome! 🤩
Wow, this is amazing! Thanks for showing what is possible... Some post-production parts are a bit too complicated for me to reproduce, but I expect A.I. to fill in that gap in the (not-so-far) future.
Really slick! Thanks for all the hard work and research on this. The lip sync fix looks like a great fix. I really hope the Premiere and Resolve teams are working on implementing this tech as an "AI Effect" in their suites. I love that we can do this now but not having to jump around to 10 programs will be nice. :0
Good idea for music videos 🤔🔥
This is amazing! I'm an animator for a living and this changes everything!
yup as soon as it gets good enough you won't do this for a living anymore
@@Mostafa-pc3vd Nah. This particular tech will be super useful, but there will still be a place for custom animation. It will coexist with hand animated stuff, similar to how Mocap does now.
There's just too much expression available in animation that's impossible to recreate with live performances. Just look at the content that SAKANA puts out (www.youtube.com/@SAKANA-cg6or). She's super talented, but most people don't move like that, and even with her range, she still can't replicate something like Wall-E or old cartoons like Tom and Jerry.
I fully expect other AI tools to make the hand-animating process easier as well (particularly with stuff like creating tweens), but it won't look like the example in the video here.
Thank you !
THIS IS AN EXCELLENT VIDEO SIR
WOW! Thank you. That is fantastic work!🎉🎉🎉
Glad you liked it.
I'm really impressed by the video-to-video option.
this is so great thank you so much. I shot a movie that midivil, and its kind of corny because the outfits aren't great but I spent a lot of money on it and knew it'd be better as an anime AND I KNEW THIS TEC was going out sooner and later and it seems like we are getting close.
Amazing!
Amazing site
COOL
Great video. I'm still waiting on a good Lip-sync for ComfyUI.
Really cool, thanks for sharing your workflow.
Wow WOW!
Nice ❤love it
Wow!
Мега круто!!!
That is so good if only the quality of the lip-sync was better. Almost there.
Thanks very much🎉🎉🎉🎉
Very interesting, thank you! :) I have a question. I've created a cartoon and now I'm looking to do the exact opposite: transform my cartoon into photorealistic characters for a movie adaptation. Do you have any suggestions on how I could achieve this?
This is awesome! A really creative combination of apps and a well edited 'How To'. Thanks heaps! The only - big! - problem I've encountered is that SyncLabs can't handle 2D anime style. The mouth becomes a blur. Have you worked out a solution?
Hey. Thanks very much.
No I’ve not found a good anime solution yet. There’s a new updated new beta release 1.5.1 release of sync labs just out. Maybe we’ll see better results soon
Wow that was a very good intor
Thanks. 👍
Awesome turtorial!!! any suggestion to fine tune the iris?
Thanks. I need to do some tests. I’m not sure if the iris is being affected by the inclusion or ‘Big blue eyes’ in the text prompt or if it’s just a typical result of DomoAI (and what I assume is Animatediff /Stable Diffusion). You could try adding text to the prompt to guide the look of the eyes for added clarity/consistency.
I think Domoai has a new green screen feature to remove the background
in future, hopefully one tool can do all that in single click!
Can it be used for music vids and movies where we have the vids pre-done and converts to AI look? Can it take max 2 hours?
Finally, the name reveal.😅
Thank you Jon
😂😂😂! ...
Watching the video now! Any way to get around the 10 second limit? Like can it match the previous design if you upload multiple 10 sec clips? Sorry if you already answered this in your vid!
Thanks. That's a good idea. I don't cover it in the video, but when I re-did a section of a video via Domo it maintained the character look (**when I kept the exact same text prompt, and said to use the video source more than the prompt. So I'd assume running multiple 10 second clips for a longer generation... 'might' work out well.)
Great to see DomoAI getting some love. Looks like they’ve added a few more looks since I tested it too. Nice in-depth tutorial. Thanks!
is there a way to have your own private room (like in Midjourney) in Domo AI so others can't see what you're doing?
Thanks for a great tutorial.
Is DomoAI able to be given a 2d photo of quite a big detailed scene, incl furniture, computer screens and surrounds and then convert to 3D suitable for characters to inhabit?
Thanks. Unfortunately DomoAI doesn’t do any 3D model conversion (at least not that I’ve seen). You could try out a mix of Zoe depth (applied to an image of your own) and create 3D assets using Meshy (see my recent video on 3D modelling with AI) to build up your scene in a 3D package.
Thanks for that. Version 2 AI characters to life etc is a big help@@AIAnimationStudio
Hi i am learning new things through your videos. Thanks for the great work. 🎉
It looks like this is yet another paid front end to Stable Diffusion with a limited number of models and the usual terrible temporal coherence. Until we can get a five second video without morphing inconsistent details, this is of very limited use. More specifically, it’s a fun toy for hobbyists to play with, but not helpful for actual production work.
100% agree
Whislt I defnitely agree the video generations with more weight given to the 'prompt' have that familiar 'Stable Diffusion' feel. The generations which refer more heavily to the video source have far greater consistency, better than I see on most SD generations, bar those users that have really dialled in their settings via ComfyUI with AnimateDiff.
@@AIAnimationStudioGoogle’s Lumiere is the first genuinely groundbreaking new development which promises real temporal coherence.
Exactly right now AI video is in its infancy, good to check in on and poke around but I don't think it's anywhere near practical use for the average person.
This may be impactful for someone who is already technical and they can incorporate it to help their workflow, but not for anyone else
Well said
Legendary skills my friend. My only observation is that you could probably do it all quicker and more flexibly in a game engine like Unity or Unreal. Just a thought.
Thanks. No doubt, it would work a treat via Unity/Unreal route, but I do like how you can tie it in with all the comping (and potential 3rd party plugins) of After Effects. Or that's my excuse anyway.. 😅. as my Unreal/Unity skills are old and rusty. 😇
Nice work, but somehow I feel so exhausted with all that amount of time, energy and effort put in for just a few seconds. But I will try.
I hate the fact that a lot of AI is trained on copyrighted artwork and users click a button and they have a final product. Watching this makes me realise the potential for AI in the workflow for motion graphics and design. Using AI to save time.
Is there a tool like this BUT for Audio where it can keep the same speech but change the voice tone
With eleven labs you can use your own voiceover recording now and then replace it with an AI voiceover (of any style, gender, accent) and it will match the pacing, pauses, emphasis etc of your own recording. it’s pretty cool.
Hey nice vid, just one thing ur content loudness is -17.3 db should fix that for future videos.
Oh yeah, you're right. My fault for using the Adobe 'enhance audio' feature to quickly balance all the audio and not check the final Db levels. It was recorded around -6db so that's a shame. Deffo one more thing to re-check before uploading. Thanks 👍
question is how do you reliably create the same character and style set?
'Consistency' is definitely one of the big AI words for the year.
I did find if you use footage from the same looking scene, (but another bit of video) it will look very much the same. When you refer much more to the video source in DomoAI than the text prompt. So there is potential for having some consistency between shots (if you don't want to heavily stylize it with your text prompt).
does it generate only 10sec video? i need longer than one minute
Fuck me. that was cool! great video!
😂👍
This year is gonna be awesome.
googles new video generator looks the best of the best. Jaw dropping.
Can u upload a reference character so when u upload video, it can the. Change video to that character ?
Not yet, (*Not checked the latest versions of Domo AI, but I've seen this functionality.... yet).
Where did you learn to do that? do you sell a course?
Which bit? (All the after effects style compositing?).
I've not got a course covering AI or after effects... ... Yet.
(I've worked in video / animation production for 20+ years so picked up a variety of motion graphic/compositing skills over time).
I do have a course on the business side of starting your own animation studio. (I founded my own studio back in 2013 that still runs today)
I never understood the forum style all these AI platforms use. Why not just have a stand alone AI webpage were you don't have to jump through hoops just to use it.
Thx for the content. Domo in swahili means big mouth, lol
😂
Impressive yet needs improvement, can't pay for that yet
Can you show a version where its black and white lines instead with color fill. And a version with mannequin style.
just connected AIAnimation Discord - but it is fully empty. does it still work?
It should still work.. but admittedly, it's not evolved into much of a community as yet. Not enough time to get it thriving myself.
We are entering a bleak, miserable world!
UA-cam be like..”Everything is about to change forever.
Nothing will ever be the same ever again.” ..Until the next video
they dont have amy free subscription now?
Does DomoAI support API?
Not 100% sure, but think I saw a comment on their discord that at the moment it's not offering an API.
it looks like AI still. A lot of work to do from DomoAI. If it looks like AI it doesn't work, seems cheap. Im sure eventually we will get 100% consistency and no flickering
Discord? Looks promising but it's available otherwise.
All this technology but those eyebrows
😀... yeah I'll blame my wrinkles.
lol nah! you're perfect the way you are! im surprised the AI wasnt able to correct that on its own. @@AIAnimationStudio
Are you serious? We need 2 weeks to do what you did? 😂😂😂
😅😅... what? 😇.... just film something, turn the background into green screen.... convert to an animation style via DomoAI... improve the lip sync via Sync Labs... then drop into After Effects. Key out the green screen. Oh and make a background image, make it 3D with ZoeDepth.. bring that into After effects. Position it and animate the camera... Oh and make a HDR map for better lighting. Add the environment light and enable the hdr lighting... oh and add some optional moton graphics. Render... 5 minutes tops... 🤣.
omg how is putting a fillter on a video animation and its not new the ai tech is but it just not animation n its funny how many smart people will stupidly phrase as game change for animation when u they actually animated any thing, also its kinda sucks cuz it got the hands n eyes wrong but still kinda cool
I'm admittedly on the fence with the video title. But 'New AI Video to Video tool, DomoAI' seems bit less exciting 🤔
for me it just that it doesnt change anything for animaters because I dnt see ana animater using it, what would change animation is if u could feed a complex animation that is difficult to redo save it and if u need something like it link it to the ai and get the key frames, or an ai that text promp that animates an illustration u made, the only way I see an animator using this is for profe of concept, honestly I feel like AI tool should make ur work easier not replaise u.
DomoAI is ok not origanal since every one has an image genarater ai tool out now a days, it would have been more intresting if it had a layer sytem and u could export and make correction in illustator or photoshop.@@AIAnimationStudio
Freemium scam, too much expensive for casual people the love Art & Creation.
Whilst it's obvs not a scam, as it makes things easy with quick generations. DomoAI is a paid tool. But you could with lots of time, work out your own Workflow using ComfyUI (stable Diffusion) with animated diff, and lots of nodes and run something on your local (well-spec'd) computer for free. I might show that in a future video, but not sure there's much of an audience for it. Hmm...👍
i don't understand the current obsession with discord,.. its EVERYWHERE.
I don't want to HAVE to join a talking box group merely to download a thing.
i HATE having to talk to people.
WHY cant they just have a normal site where you download the thing.
Also, 'credits' can sod off too.
I'm never going to pay money for a thing ever.
You rock but the ai is clunky af
man you're not from this world. how can i talk to you?
.. get in touch for the website. Contact details there. aianimation.com 👍
Not free anymore.
no more free credit options. sucky.
DISCORD SERVER....WILL NOT INSTALL...NNNOOOOOOOOOOO!!!!!!
All this mp4 on mp4 on mp4 recompressing is a quality disaster. Until they can work 10bit uncompressed offline none of these are professional tools.
Wow!