GEN-3: The Ultimate Prompting Guide
Вставка
- Опубліковано 8 лип 2024
- Hey everyone! Runway ML's Gen 3 has arrived, marking a significant step forward in the 2.0 era of AI video creation. I've spent the last few days diving deep into researching, testing, and studying this powerful new model. Join me as we explore the ultimate prompting guide for Gen 3. Let's get started! 🚀🔍
DOWNLOAD THE PDF: theoreticallymedia.gumroad.co...
What’s Inside?
Gen 3 Overview: Introduction to Runway ML's Gen 3 and its advancements. 🎥🤖
Prompting Techniques: Learn the art of crafting effective prompts to get the best results from Gen 3. 📝✨
Live Demonstrations: See Gen 3 in action with various examples, from simple prompts to complex scenes. 🎬🎨
Pro Tips: Discover best practices for maximizing your AI video generation experience. 🛠️💡
Community Insights: Explore tips and ideas from the AI video creation community. 🌐🤝
CHAPTERS
00:00 - Intro
0:31- A Look at Gen2 vs Gen3
1:31 - Looking at Prompting In Gen-3
3:04 - What Elements does your Prompt Need?
3:52 - Shot Types in Gen-3
5:05 - Gen-3 Prompt Adherence
5:43 - How to maintain a Consistent look
6:33 - Example of a Consistent Look
7:06 - Community Ideas on Prompting
7:43 - Text in Gen-3
8:42 - Getting a Look without calling out a name
9:43 - Sometimes less is more
9:59 - Script Pages in Gen-3
10:32- Timelapse in Gen-3
10:51 - What's coming next in Gen-3 - Наука та технологія
![The moment we stopped understanding AI [AlexNet]](http://i.ytimg.com/vi/UZDiGooFs54/mqdefault.jpg)
![The moment we stopped understanding AI [AlexNet]](/img/tr.png)
Download the FREE Prompting PDF here: theoreticallymedia.gumroad.com/l/gen3
👋
We need image to video or this is nearly useless.
One step at a time. It’ll get there. And remember, this is still Alpha, so it isn’t even finished yet.
Agreed
@@TheoreticallyMedia The problem I have is they advertise image to video, but it's not available yet.
My thoughts exactly. Luma did the next move, coming out with it out of the gate.
@@TheoreticallyMedia alpha is just an excuse to get money
Most commentators are just praising Gen 3 mindlessly without really trying it. You are to be commended for actually testing it thoroughly without over-praising. Personally, I find it crap and sympathize with anyone trying to make it do what you're asking it to do in 100 different ways.
wow that comparison blew me away.
Roughly 14 months in AI time is basically 14 years. It’s insane!
Yay couldn't wait for ur video since we all have access can't wait to see ur prompt guide woohoo
Timing came out great on this! I was really hoping they were going to release on monday!! And I basically swung in just an hour or two after!
Great video with some great tips! A funny (yet frustrating) thing I noticed in GEN-3 was that some prompt words secretly get modified, for example when I was trying to generate knights with their swords held high, they were holding instruments instead! Also for me, it most of the time seems to associate "running" with marathon runners and adds the tag on their shirt, which I coincidentally noticed it does on your runner to the coffeeshop as well at 7:41 😅 Either way great deep dive, it will surely only improve further from here on out!
100% have run into various props being tuned into instruments. A lot of guitars, I’ve noticed. Hoping at some point we can weight in our prompts! (Or, image 2 video. That’ll pretty much solve everything)
Top Bloke. Great content as always. Nice One
Luma still leading at the moment, this is the most helpful video for Gen 3 I've seen so far though I must say.
Thank you so much! I love Luma as well! Really so appreciate the helpful comment, it’s something I always strive for on the channel. To go a little deeper into the “how” than most others.
(Not bagging on any other channels FYI. It’s just how I like to push myself)
Thx Tim, that was exactly what i needed for the kickstart
yaaaaaaaay begin the rise of gen3 videos :-D so glad its out!
So glad we’ve entered the 2.0 era! And..well; no one seems to be missing Sora anymore!
It blows my mind!
As always, great stuff Tim! Bonus points for Dark Tower shout out, wouldn't it be amazing to actually see that whole series properly done? We can always hope.
10:02 haha the return of the elusive "dream factory", when we mere mortals play with Luma's dream machine :) Thanks for this run through !
Awesome guide!
Thank you so much!! I’m really jazzed for Runway! This 2.0 era of AI video is super exciting!
Thanks for your vid🙏
The price is outrageous.. $1 per generation
thank you as always!
1000% And thank YOU for being here!
Thank you.
Hi. Not really into the creative space, or AI video creation. I stumbled across your channel by pure chance and just found the topic fascinating and very well presented. So I've been tagging along for a few months now. I just wanted to write this comment to say thank you. The Dark Tower reference is greatly appreciated ;)
Very Timely, You might even say "Prompt".
Hayyyyyyy-oh!!!
awesome video
nearly jumped the gun a got gen-3 today not realising image to video isn't there yet, so going to get luma today and if runways img2vid model ends up better , ill swap and give that a try for a bit when its released.
Haha, the hopscotch game is the way to go! It’s like streaming services. I’ve got HBO until the dumb Dragon show ends, and then I’ll cancel and hop on something else!
This is awesome Tim, thanks! How do you work around the 500 character prompt limit?
Man this looks sick...its a bit outta my price range for now but great video on it love theprogress videos made last 3 months
After spending a day experimenting, I have to say Gen 3 is much better than Luma or Haiper. Both of those aren't even close in comparison. However, Gen 3 does take some time to master, which means you'll likely waste many credits on subpar results initially. Once you understand how it works and its limitations, the output is far superior to the others.
At first, I was disappointed with Gen 3 and considered canceling my Pro plan (the $35 one). But as I approached my last 700 credits, I started getting amazing results. This convinced me to switch to the unlimited Pro plan for $95.
I wouldn't recommend Gen 3 for beginners, but if you're looking for cutting-edge experiments and can handle some limitations, it's the best option available at the moment.
do you think overall luma is a better tool or gen 3 in terms of quality? (if considering only text to video)
Hey Tim, another great video. Question: In a bunch of your replies to comments, you mentioned a “community feed.” What are you referring to? UA-cam comments? Something on the Runway website? Your website?
Oh, no just the UA-cam community feed. I think you can find it on the channel page. I do need to get a real community spot soon. The discord ended up being a bit of a disaster! Gonna nuke it soon and try to build a new one correctly!
@@TheoreticallyMedia Thank you for the quick response! Really appreciate it and looking forward to checking out the community feed. Been using UA-cam for years and didn’t even know that was a thing!
cool guide gen 3 looks great
2.0 AI filmmaking is here!!
now this video helps alot
That is fantastic to hear! Can't wait to see what you cook up!
Video to video is what will really change filmmaking forever. This is just interesting, but not more.
I love V2V, and I do have some stuff coming up on it soon. Totally agree as well. I’ve been exploring a combination of v2v and i2v, and while it’s not 100% there yet, it’s super close to having your own version of Disney’s Volume.
Thanks for doing this! How long do you predict until image to video releases??
No inside info, but if we use Gen-2’s dev as a metric, about a month? Rumor has it I2V already exists, it just isn’t working as well as they wanted, so they’re holding off until it’s right. Can’t fault that.
Hi Theoretically Media, please can I ask you what your recording setup is? Especially the background removal. Hope you can reply. Thanks a million.
Yay old studio is back :)
We must never speak of Studio B again! Haha. It’s sooooo gooood to be back!
@@TheoreticallyMedia hahaha
This might actually be great for "Sweded" films
so image to video not available yet? any word as to when it will be?
If Gen-2 is any indication, probably a month? Unofficially I’ve heard rumors they already have it, it just wasn’t working well yet. So, I don’t think it’ll be very long.
@@TheoreticallyMedia Weird because Luma Dream Machine does SO much better using image to video compared to text to vid.
Which one do you think is the best model so far? gen3, luma dream machine or kling?
Love your map videos. Went over to X to see your Radiohead music video and was moved! Now Im off to sell some blood to get cash for some prompting credit...
We watched House of Dragons too, yes, Germany loves it too 🤩
Looks good but I was hoping to use it for image to video but no option on the website. As soon as that lands, I'm on it
excellent
Thank you!!
Great! Thanks for the video. I have one question: how do I change aspect ratio to 9:16? Does that already work? Thank you very much 🙏
I'll have to look that up-- I'm not sure it currently does 9:16?
Can you post an external link to the Exit Music For A Film music video you created?
Great breakdown of Gen 3 prompt tips, by the way. Especially the "imax" style tip!
Yup! Thanks. I forgot to put it in the comments: x.com/theomediaai/status/1807168440379023522?s=46&t=Gezvp5mbBNzrK3tbLcCFzA
And yeah, I’ve got some thoughts on why IMAX works. Talked with Dustin Hollywood today, and the thought is somewhere in the model, the higher res/cinematic stuff might be tagged w/ IMAX. So if you keyword it, you’ll get a more epic result.
@@TheoreticallyMedia that is an incredible video. I've always loved that track.
Thanks for the extra details regarding the "imax" tag. Love your videos. Have subscribed and will share.
I could pay 1$ per trial - but for imagie -to - video generation - at the moment I will just watch your videos - and observe development of the tool.
Haha, frugal move! I think i2v is going to be clutch once it hits Gen-3, but for sure, but let me do that R&D for you! That’s literally why I’m here! (Well, that and to figure out how stuff works!)
Would we be getting any form of video to video with this also ?
"The man in black" to me will always be Johnny Cash.
Can it overlay music?
No Image to video for gen 3 yet which is disappointing. Does anyone know when that is out?
good comment, then I don't need to try it out at this moment XD
I love it how people instantly expect even more of just released cutting edge tech 😂
So, if I wanted to create a 2 minutes video, should it be divided into numerous tiny ones and then combined all together? Will it give a constant output, that is the persons from the start to end be in the same frame.
Thank you, I'm a newbie.
A clip can only be up to 10 seconds and usually there is little to no coherency with people. Even if you somehow was able to get good results in all your clips, you will have already spent your monthly credits after a minute of video.
@bloxyman22
What is the solution here? If I'd request an expert, like yourself, can we achieve it? Can the credits be bought again?
Thank you so much
Man it’s so frustrating at this point of my own video creation attempts never create anything useable. Mine are never near the quality of what many platforms showcase. Gen 3 was included, 5 videos yesterday and today and a lot of morphing, even twice my astronauts legs are backwards. I’ll try a few of your prompts Curtis bro.
Great timing before I waste too many credits doing trial-and-error at 50-100 credits a pop! 💸
That’s the biggest thing here, I’m trying to save you guys some experimentation credits. Use the prompts in the pdf and build off them! I’ll post more in the community feed for sure!
Don't hold your breath. I used all my monthly credits today (I'm on a plan as well) with a prompt following their recommendations and got beautiful rubbish and cost me a fortune. I put the exact same prompt in haiper and got exact success first time! Don't waste your money basically beta testing for them and paying for the privilege. See what rubbish Gen3 gave me on my video and how haiper gave me the right video fist time. ua-cam.com/video/bBbSWO5okcc/v-deo.html
are your prompts made public with Runway or does the author retain all rights?
i think runway 3 is good for now, we just need to focus on delivering the message on film making and storytelling
Can it do seeds? For example, have it create a panning shot of a street with a parked car then do the same shot but without the car? Img to vid should do this but apparently it’s not ready yet. UPDATE: Slow down me. Seeds, yes. Perfect consistency, no. Thanks for mentioning that part!
Haha...it's like we went on a whole journey with that comment!
Looks good but I just got access to LTX Studio so busy with that.
informative video - as always - you didn't mention the cost. Runway does this annoying thing of '1,000 credits for Ten bucks' which you think and sounds pretty cool... but then on Gen-3 that equates to about 5 generations. So it would be great if they could come up with a more realistic or understandable pricing methodology so you get to figure out how much you get for your dollar - cos as with all AI, you can burn through a tone of attempts before you get the one you like - or in Gen-3 attempts yesterday, the first iteration is cool, but then every subsequent one got worse and worse and suddenly $50 bucks is gone and you have one usable clip.
Tried myself with same prompts. Dream Machine and Kling is much, much better and cheaper.
I think they all have their strengths and weaknesses. I'm just happy we can (well, Kling being the exception for many) have access to them to mix and match.
@@TheoreticallyMedia Yes, competition is good for us.
What's gonna be really cool are all the tools to further finetune your output. Money better spent, more or less.
why not mention it is available on paid plans only?
Isn’t that a given with Runway these days? Not being snarky at all either. Legitimate question.
AI video: people AImlessly walking and looking around.
For sure. I think of AI video in this weird spot that is less cinema and more TV. If you think about TV/Netflix shows, it’s mostly an establishing shot, followed by 2 people talking in a room.
(Big budget exceptions of course)- I think everything is mostly there for a typical CSI type show, minus the acting.
That’s what I’m waiting for, that next iteration of Emotalker/Hedra. Lip sync and “acting”
As a baseline before the masses swamp the servers, what's the generation time on these?
Luma Dream Machine is back to taking hours for me. Like 12 hours sometimes.
Geeeeze-- Yeah, over the weekend I was getting generations in about 1 to 1 1/2 minutes. I was working on this video when they went live, and everything slowed to a crawl. That said, Runway has some horsepower, so I'm sure it'll normalize in a few days.
Even with paid subscription on Lima?
@@lukewilliams7020 I'm on the free plan. But i had fast generations yesterday and then it ground to a halt.
How long does it take to produce a video?
Well, right now it’s hard to tell. Over the weekend when I was making the Radiohead video, I’d say it was about 1 min per. As I was making this video, they went public and things slowed to about 3 mins per gen. But, that’s also the onrush of everyone hitting it at once.
I’d say once the dust settles, it’ll probably be around 1 min. Faster than Luma currently, at least.
Can we do a crowdfunded account or user so they can test it out? Were wasting too many credits just to try it out. Crazy how runway doesnt even have a tutorial for their own product? Like hows that making any sense
Haha. That seems to be my job! One of the reasons I posted up the PDF is to give you all some ideas on promoting without wasting credits. Use the PDF examples as base prompts and modify them. At least you’ll get something close.
Gonna post more in the community feed as well. Let’s work smart/together!
@@TheoreticallyMedia nice!
Maybe try "single shot, no transitions"?
I'll give it a shot. Someone mentioned 50mm, tripod shot. I think that idea of it being locked down tricks Gen-3 into no zooms and dissolves. Early days, we'll figure it out!
When can we use this ?
Today! Well, yesterday. But tomorrow too! Haha, it’s out is basically what I’m saying!
@@TheoreticallyMedia ok I thought you said it is alpha stage now
I try it today thanks man
Darn, I just subscribed thinking it had image-2-video. Too late now. Anyone know how long before it's here?
But the promoting guide published by runway its different structure…camera movement: scene, details
Can I send you a story, in text, which you could use to generate a video?
While I’d love to, I just don’t have the time. Between the YT channel and my own projects, I never sleep as is! Working on something that might be helpful to you though.
@@TheoreticallyMedia
Waiting then. Merci
Was waiting for Gen 3, i was decently impressed with Luma but its not my cup of tea because of generation times.
Gen-3 is pretty fast. Although today might not be the best representation, as it just opened up the doors. Might want to wait a few days for the rush to die down!
@@TheoreticallyMediahey Tim what are your thoughts on luma verses gen 3 as I still think Lima is really capable and astounding
Made this NYC subway video with Luma. Their text to video is more imaginative IMO and almost never does slomo, which is great. I’ve been burned by Runway too many times to ever give them my money again. Gen-3 looks great…till they flub it with a poorly QA’d update like they always do…ua-cam.com/video/yTiK5pwgWA4/v-deo.htmlsi=Py6QBBKnJR6EpqR1
So far I've noticed that while it can do anime, it's not one of its strong points.
its fun but really, its still a gimmic, unusable slush and the price is absolutely redonk. $15 bucks for basically 1minute vid whereof 99% is complete trash. In 2025 i bet we can see actually useful ai vid capability.
I've just made a music video on my channel using Gen3, time lapse flowers, which worked really well. Please check it out. A lot of my ideas using people really weren't working, but this simple idea worked well.
I'll swing over and check it out later tonight!
Expensive I love Runway but seriously 10 credits used and why? Maybe I should be in the world, and speaking truths.
Sheesh! I thought Luma was overpriced.
Runway Gen-3 is $15/month and capped at 62 seconds of generated videos unless you pay more. $0.25 per second. HAHAHA!
Better get that prompt right on the FIRST TRY. Frustrating...
One of Runways upgrade links says 62 seconds/month while another says 125 seconds/month. Either way, that's almost no time.
Yeah no image to video... which sucks.... big time....
Patience, young grasshopper. It will be here soon.
Sadly completely useless when you only get 6 10 seconds clips a month... How can I even experiment trying to create something unique when I have so little to work with?
Why not to pay for the subscription and credits?
It’s not free.
@@wizallah2000 That's my point. If anyone is not happy with what they get for free, there is a paid alternative. You either keep your money and accept the constraints or give your money to remove them.
That is the amount of generations you get if you PAY for the standard plan.
@@bloxyman22 Sorry, my mistake, you are right. Still no problem to pay more (but don't fall for the higher plan, buying additional credits with the lower plan is cheaper)
I think it's kind of sad that they want money to use a product that is in alpha.
Time and time again Runway lets me down. Overhyping and cherry picking videos that are not at all representative of an average output. Having used Gen 3, the typical output is mediocre, riddled with warping, bad movement and bland compositions. It’s clear to me they must’ve generated 1000s of videos for their cherry picked showcase. Also the price per generation is absolutely outrageous. Classic bait and switch. I’ll be sticking with Luma
Im so sick of “it will continue to improve” thing everyone is repeating. Its pretty rare for software to improve over time - it almost always goes to shit over time due to growing disconnect between business guys and users, developers adding stupid features to get a few more salaries and their managers to have something to sell to business guys.
Dude, did you see the comparison right after the intro? The NYC sequence? That’s improvement over time for sure.
I so agree that feature creep is a real thing though. That’s just an unfortunate byproduct of our time. Something goes viral, and then everyone rushes to chase it to stay relevant. Often not thinking: do users need this?
It never creates a man with long hair no matter how you prompt it. Very frustrating
I think this is a big bug in the software.
No image to video? zero interest in replicating reality. I prefer the imaginative kind.
This text to video tool is complete bull shit. It won't create what you want 😂😂😂
Tried it , absolutely dire, and pathetic. Stay the f away.
Its not free so no one cares
There are a good amount of Runway users.
Speak for yourself, I care. Don't pretend like you represent the majority.
What an amazingly idiotic comment. The real Val Kilmer should sue you.
@@bennettwaisbren Never fucking said I represent the majority.
@@Valk-Kilmer "no one cares" means you're speaking on behalf of everyone. By definition you attempted to represent the majority lol
But it's not free
And? Go earn some money cheapskate
I mean, the Runway employees I presume like to eat…food. That you have to buy.
@@TheoreticallyMedia But seriously 6 10 seconds clip per month for a paid plan?? And what about Luma? They give you more than double that amount for free. Would think they would need food as well.
Is a bit easier for you to create something or experiment with prompts when you were given a unlimited plan and 1 million credits for free. I doubt you would have anything at all to show us if you were limited by their paid plans.
This text to video tool is complete bull shit. It won't create what you want 😂😂😂