Це відео не доступне.
Перепрошуємо.
AI Filmmaking Just Leveled Up!
Вставка
- Опубліковано 15 сер 2024
- Two pretty amazing developments in the world of AI Imagery! We now have the ability to direct motion in AI Generated Videos with the new Motion Brush in Runway ML's Gen-2.
And, we'll step into the world of LCM (Latent Consistent Models) to learn how to paint with the assistance of AI in real time. This isn't fully prompting, but rather utilizing a hybrid of text and painting in real time with a model to show it exactly what you're looking to accomplish.
Really exciting video with some stunning breakthroughs in technology!
LINKS
RunwayML GEN-2: runwayml.com/
Hugging Face: huggingface.co...
Martin Nebelong: / @martinnebelong
Consistent Characters Video: • AI Game Changers: Huma...
If you'd like, please join the Patreon Here: patreon.com/TheoreticallyMedia
Join the Discord: / discord
Follow Me on Twitter: / theomediaai
CHAPTERS:
00:00 Intro
0:15 - Motion Brush in Gen-2
1:47 User Generated Examples of Motion Brush
2:40 How Will Motion Brush Work?
3:43 - Real Time Imagery with LCMS
4:00 Examples of what an LCM does
5:14 Issues with The Anti AI Crowd
6:04 - Tutorial on how to Paint with LCM
Thanks for your updates. 👍
Thank you for checking it out!
I could see the real time painting being super handy for roleplaying. You could describe a scene to your players and quickly paint it in real time. You could also all pick a style and paint your characters together.
Oh that would be such a cool use for it! It would for sure earn someone the title of Best DM Ever!
My guess is that Runway Gen-2's "Motion Brush" promo is more hype than reality.
I have my fingers crossed that it legit works. The mannequin shot was user generated and looked really cool!
But also…it might have taken 40 generations to get there- because, well- that’s AI video!
Great new tools - thank you for the update.
Thanks so much for checking the video out! (And the comment!!)
Quay Brothers! We are of the same ilk... I love Runway's brush. I hope Pika does something similar...
Oh nice!! I was hoping someone would catch that! They were super influential to me early on.
It’s funny when you go back and look at their films now, and you can see echoes of it so many things.
As to the motion brush, I’m sure we’ll see something like it incorporated into the other players. It always seems like when one comes out with a major breakthrough, the others follow shortly.
Whoa. The LCM thing gives me.about 500 ideas to try out
Thanks for the tutorial!!
It's soooo much stupid fun! You're going to have a blast!
Another excellent video, and another excellent thumbnail!
1:15 Holy cow did that scene scare the crap out of me first time I saw it!
Seriously, scarred to this day! Haha, I also saw that movie and Elm Street wayyyy too young!
I just want to say thank you for always keeping people informed. You are literally the reason I learn so much about AI. Please keep up the good work!
i so love what Martin's doing!
He is the best! Constantly inspiring!
Thanks for pointing out Martin his work is just absolutely mind blowing!
Love Martin. Literally blown away by every post he does. He inspired me to pick up Dreams on my PlayStation as well, but my kids rapidly took it over once they found all the games!
woah, that assistant painter is a game changer
Got a new video with a deeper dive-- It Is INSANE: ua-cam.com/video/4-2dSRjErE4/v-deo.html
woow... thank you for the content and news!))
Totally! I figured the LCM would be right up your alley! Should have a look at a more “platform” version of the technology very soon!
The LCM looks insane! Thank you. 👍
And great job giving a shoutout to the artist hammered by naysayers! 💯
You’re welcome! And as an FYI: I should have a platform version of that tech coming up soon! So you won’t have to mess with hugging face!
And yeah, Martin’s work is stellar! High recommend to check it out! He works a lot in the PlayStation software Dreams; and what he’s pulling off is INSANE.
I actually got some clips from GEN2 that were usable today. So perhaps it is finally getting better!
I’ve been circling around it for the past few months and there have been a lot of improvements made to the model. When Pika first dropped, I think Gen-2 went a little nuts with the motion, and things were a bit janky, but that seems to have toned down.
Once Motion Brush is released, I’ll do a full Gen-2 updated tutorial. I think it’s about time!
Thank you for pointing out Martin! I didn't know about him before. That guy is amazing. I had the opportuny to review Dreams on ps4 when it came out and what Martin does with it is just out of this world. And more importantly, Martin embraces AI and shows everyone that it not the end of creativity or doesn't take jobs from artist. It's a tool that makes life easier for artists! And much more!
Right?! I love the fact that he took that platform and was like: wait a minute, do you know what you can do with this?!
His work is beyond mind blowing. The first time I saw him sculpting in VR I literally started laughing in joy.
I did download Dreams to give it a shot myself, but my kids quickly discovered all the games on it, and now I never get PlayStation time….sigh.
And you left me sooo many things to explore. What is Dreams? A VR game/software on PS4? I kinda love PS4/PS5 and yet haven’t heard about Dreams. Should check it out, I guess!
@@prizmaetkisiyogavekisiselg3572 definitely check Dreams out! It doesn't require VR. You can even make music in dreams. Make your own game. It's basically a software on ps4/5! And I think the story it has is good. Rhe song in the story is really great.
So far I haven't met a single anti-AI person who has actually tried any AI imagine generation software.
I always ask them... "so, do you accept photography as a legitimate art form?"
"Naturally" they say, "duh, yes!"
Then I direct them to read the history of photography... invented in the 1820s, it remained a fledgling technology for decades as many artists and art critics still saw it as a threat.
"The fear has sometimes been expressed that photography would in time entirely supersede the art of painting. Some people seem to think that when the process of taking photographs in colors has been perfected and made common enough, the painter will have nothing more to do."
- The artist Henrietta Clopath (1901 issue of "Brush and Pencil.")
Today, most people assume photography was always commonly accepted as a fine art. It wasn't.
100%. I can’t find it now, but there was a post running around with a number of “this technology is going to destroy artists/totally devalues artists” quotes- the big reveal at the end is these were all quotes from the late 90s about Photoshop.
It’s funny, the artists I’ve seen that are the most accepting of AI tends to be musicians, oddly enough. I think (largely) they’ve just been conditioned to accepting new technology and integrating it in.
Basically, most musicians I know see AI and say: “oh, I can USE this.”
@@TheoreticallyMedia Totally. Smart artists adapt and reflect the environment of their times.
@@morpheus2573 One. Thousand. Percent. I'm playing around right now with creating a Missile Command Game. I do not know how to code. I mean....c'mon now!!! That's insane!
@@TheoreticallyMedia Roger that, Control. 🚀
Love the motion painting/brush addition. 👍
Can’t wait to play with it. I think it’ll be a little bit janky at first (as new tech always is), but the fact that it is now here means that it has started, and we’re only a few months away from it being established as part of a normal workflow.
I’m curious as to when we’ll be able to paint on a characters face and prompt something like: “smiling happily, but then suddenly realizing something is terribly wrong”
I mean, once we get AI characters really acting? That’s going to be nuts.
@@TheoreticallyMedia Using Motion Brushing kind of covers basics for creating backgrounds. Having the possibility to cut out characters from images and then being able to animate them will hopefully be possible and easier in the future. Would like to have a "step into an image" possibility in the future. *dreamy look*
Amazing there is also new plai 😜 within discord with fave swap in video
I just caught that one on Matt Wolfe's channel-- somehow that one slipped past me! I'll say, I really love the built in faceswapping aspect, but...I do hate to say that I'm not overly impressed with the video output.
I'm going to keep an eye on them though-- if there's one thing I've learned covering these AI tools: Every one of them is one update away from crushing it!
Very excited for the assistant AI for creative art work taking more shape.
I love it that the coding assistants can both help introduce coding for newcomers as an assisting in teacher, and also being able to assist veteran coder in looking up things in manuals (reduce wasted time) and explore different coding architectural design.
Looking forward to AI art assistants to similarly catch up to AI coding assistants, to both enable "novice" people to express their creativity and design and also help veteran artists create with reduced time spent on tedious work.
So, I’m still playing around with Rosebud (the Ai Game creator in the last video) and just amazed at how it is coding for me, based on my non-technical prompts, and it has the ability to create game assets for me at the same time!
Don’t get me wrong, there’s still a lot of frustration in terms of getting things to work (but in a lot of ways that’s also the fun part)- but it is remarkable that we’ve arrived at a place where I can make a video game at home, by myself, in a handful of days.
Man the development is high speed 😊
Wow this is amazing!
I just need everything to slow down so I can spend more time playing with all of it!
really hope the real time lcm gets made to run locally in comfy or auto1111 … such a great method for digital painters to get a visual feedback while they sketch.
of course! it's open-source
I believe you can/will be able to run it locally already- although it currently takes some futzing.
Obviously, it’ll get easier as time goes on!
Same this is what I'm waiting for. Not because I don't want to pay but because I just find it easier and more "user friendly" to be able to run this stuff locally. I have an entire machine setup specifically for generative art work.
I was already doing that on my animation, trying many times and resorting to the luck. XD
This is definitely the future. I'm putting all my work priority on the AI Animations. It was my dream job and now it is finally possible.
Oh, I'm with you...I was starting to hit this point of multiple generations, layering them on top of each other, and then masking the elements that were working It was getting a bit crazy! This...this is a real godsend!
People will get accustomed to ai… it doesn’t take away from people’s creativity..it expands it.
1000% That's always kind of my viewpoint for this channel. If anything, creative AI tools simply offer more opportunities to do more with your art. Draw something on your own? Well, Animate it with Gen-2-- Then create a soundtrack to it using Suno or one of the other AI music platforms.
You've now got 3 different pieces to showcase.
By the way, I love your set (guitars background :)
Oh thank you!! I’ve been meaning to do a little more with it. Nothing too drastic, but maybe adding in a few more lights and revamping the items on the shelf. Haha, if AI could slow down for a week, maybe I’d have some time!
Yes, sure things are getting crazy right now (an AI iteration every week), for the set don't add a thing, or maybe a neon blue/red light (iman gadzhi style)@@TheoreticallyMedia
I fully support the idea of grabbing a cheap Wacom tablet. Mine has been a great addition to my desk, giving me a smooth surface for which to set my diet Dr. Pepper cans on.
Which one did you get? I’ve had pricey ones in the past, but I think they’re overkill for me at this point. I was literally thinking about just getting a Bamboo, which as I remember is the entry model?
@@TheoreticallyMedia I've got the Intuos Pro M. It's been a great tool (when I've used it). Having it connect to bluetooth so I can draw on my lap, and freely rotate it when I want has been such a big upgrade over my much older corded ones. The biggest learning curve is always getting over drawing on something while looking at a separate screen, but that's gonna be the same no matter what you pick up, unless you get a much more expensive screened one.
Things are moving FAST now
I love that we’ve been saying that since March, and it’s still true!
Oh wow Tim! Totally digging the LCM! If not for you, would never have known about it. 😊 (btw, not sure if you changed your camera or are color correcting the parts of the vid with you in it, but it's looking real good)
Oh thank you!! I think I just started futzing with it less! Haha, sometime you should just use the presets and call it a day!
The whole LCM thing is super cool! I didn’t even really showcase how much you can squeeze out of it by changing prompts as well.
It’s just hours of fun making abstract shapes and seeing what comes out. Plus, it’s really exciting from a composition standpoint!
i made my first short film using a few ai tools, its amazing how much possibilities open up for filmmaking via ai
The motion brush is exactly what I need. It’s just too bad that runway is way too expensive
amazing
Thank you! Cheers!
It would be cool to overlay the drawn and generated images on a touch device and pratically draw directly onto the generated image. I belive that would result in a magical experience where the appearing image would anticipate your intention with every brush stroke.
That would be really cool. I’m sure we’ll see it at some point. Actually, as soon as I saw this, my first through was: I wonder how Adobe is going to fold this in?
It would be super cool to see this running on a screen drawing tablet though!
@@TheoreticallyMedia I have a Cintiq.. I wonder if I could somehow make this work.. Not sure how I could overlay it though without it blocking PS itself?
just dropping by to say good morning or evening :)
Morning right now! Catching up with coffee and comments! One of my favorite times of the day!
Good morning/evening to you!
Afternoon HERE, actually 5PM in Morocco :)@@TheoreticallyMedia
It's 1fps so not that "real time". But give it 6months and it's 25-50fps. The new LCM workflows work 1024x1024 at 1fps with 3090 GPUs and it gets better every day.
Haha, totally! I will say that I think that lower framerate actually works well for the painting use case. I've actually found that for painting, some level of latency is actually in your favor: Draw a line, check to see what it does...draw another line-- whoops, undo! undo!
The amazing part is how this technology is like, 4 days old! That's insane!
An architect that designs and constructs buildings using CAD and AI tools is no less an architect than architect that hand drafts the design with their team. 😤 Times change…. All Photographers must hate mobile phone photography, I don’t think so… we may have not actually landed on the moon, but satellite technology and broadcast technology has enabled any of us to be independent broadcasters, and continue the ever changing relationship between art and technology biofeedbacking its evolution and our response to that.
hey man have you ever heard of the tools cuebric and moonvalley ai?
I have! I did a Moonvalley video a little while ago, it should be the one with the military gal with blue hair.
Cuebric I looked at early on- I need to circle back to them soon. Jon Finger (on Twitter)’has been doing some stellar work with it!
hi. can i install the Real Time Latent Consistency Model on my computer and use it locally?
Hmm the link for Martin seems dead?
Thank you! Should be fixed now?
I really wish the Anti-ai people would stop bullying anyone who tries Ai. So immoral.
I hope they also go after every other industry that isn't hand crafting every aspect of their product. Do they not buy cars that aren't made of hammered steel? Are they only buying bread that has been milled by mules pushing the grindstone? AI is a tool. I'm sure there were detractors at the beginning of the Industrial Revolution, too...
I kinda get it, but yeah- still never an excuse to dogpile. At the same time, many of those who are loudest about it tend to be the ones who aren’t working professionally- so I always take it with a grain of salt.
Its just like the film V Digi camera argument years ago :)
AI is here like internet back in the days, and AI is not going anywhere... there's nothing they can o to avoid AI even Amazon.
Are those antiAI also complain about adobe firefly? If not then they're hypocrites
As expected. Motion Brush just dropped an it is rubbish. Chews up credits while producing crap. I know we have to keep using it and feeding back to get it beter. But it looks like someone at Runway just discovered Depth Maps and shot their load and got carried away.
Haha-- I actually like it. Yeah, there are a lot of workarounds and some additional steps (like Final Frame and FaceSwapper) to get it there-- but I think this is a pretty major (and needed) jump for Runway. The one thing I'll say is that you still have to work within its limits. It still is Gen2, and has all the usual Gen2 problems. Like, Extend is just going to end up an incoherent mess when you 3x no matter what.
Let me be the first to say, all ai is little tricks that add up to nothing and that's all it will ever be.
Disagree, but I do see where you're coming from. I think as GenAI gets better and better (and things are moving at a rapid pace), it really is up to artists and creators (should they choose to use them) to discover interesting ways to integrate the technology.
Eventually (and some may say right now) AI will have an established "look"--- and it'll be some very savvy artists who will discover new ways to break that look. New mediums to showcase it, and new ways of creating with it.
@@TheoreticallyMedia I think people are not understanding why they like ai for images so much. it'e entertaining to type a line of text and watch an image appear. But really, the pictures aren't original at all or presentable even. And I honestly haven't seen any improvement. There's more things you can do but there's no real improvement. It's just more mediocrity at best
We need an AI extension to remove/reduce the use of the word 'super'. This host - and so many others - overuse the word 'super' so much, it has lost complete meaning.
Super comment here!
Haha, what I would actually love
Is an “um” AI. Something that removes every single one of them. My kingdom for UmGPT!