Image-to-video comparison: Pika vs Runway (August 2023 - newer version in the description!)

Поділитися
Вставка
  • Опубліковано 25 гру 2024

КОМЕНТАРІ • 116

  • @aivideoschool
    @aivideoschool  9 місяців тому

    Interested in Runway and Pika?
    Pika vs Runway: Lip Sync ua-cam.com/video/Isw1rew8qrI/v-deo.html
    Runway Multi Motion Brush: ua-cam.com/video/P41bfQrsgDY/v-deo.html
    Pika 1.0 Intro: ua-cam.com/video/ctjXvyqalzo/v-deo.html

  • @Abhinayanagarajan-x8p
    @Abhinayanagarajan-x8p 3 місяці тому +2

    this comparison is really eye-opening! I love seeing how different tools stack up against each other. Pika and Runway

  • @TeddyLeppard
    @TeddyLeppard Рік тому +16

    Absolutely stunning how far this has evolved in such a short amount of time. Give it another year or two and it'll look like real footage, real actors, real motion.

  • @wintergardenaivideos
    @wintergardenaivideos Рік тому +31

    Nice job comparing the engines. Just a note: The big reason Gen-2 looks better in a lot of cases is the higher frame rate. 8 fps from Pika vs. 24 from Gen-2. Gen-2 resolution is also higher. If you run the Pika output into something like Topaz to upscale and interpolate you'll get much cleaner results. I'm pretty sure Pika will have upscale and interpolate options like Gen-2 has without having to use Topaz. Anyway, just wanted to mention that. Keep up the good work. I really enjoy all your videos.

    • @aivideoschool
      @aivideoschool  Рік тому +3

      Thank you! Good call on the frame rate and resolution differences. I may have to check out Topaz, that's the third time I've heard about it this week. I'm happy to wait for Pika and Fulljourney to add upscaling because when Gen-2 "improved" it took a lot of the fun out of it.

    • @wintergardenaivideos
      @wintergardenaivideos Рік тому +2

      @@aivideoschool Can't say enough good things about Topaz. Besides the uprez and interpolate it also will give you REALLY smooth slow motion. Very useful extending the length of clips.

    • @tyberwhite
      @tyberwhite Рік тому +4

      You can now manually set your frame rate with Pika Labs using the -fps parameter.

    • @wintergardenaivideos
      @wintergardenaivideos Рік тому +3

      @@tyberwhite Thanks! I just tried it. Butter smooth!

    • @aivideoschool
      @aivideoschool  Рік тому +3

      wow, -fps 24 makes everything so much smoother! thanks for the heads up.

  • @Historyy_C
    @Historyy_C Рік тому +2

    Save for the quality, Pika is amazing. I realized that some simple short prompts eg, "zoom in", "People walking," "wind blowing" can bring out a very good video in Pika labs. These 2 clips are made using Pika labs and I was able to get some good horse riding shots . ua-cam.com/video/29J-KL5GQyQ/v-deo.html
    ua-cam.com/users/shorts50gMpdhbcu4

  • @ramim.5856
    @ramim.5856 Рік тому +1

    Thanks for this!

  • @MarkFeaGuitar
    @MarkFeaGuitar Рік тому +12

    I think the bottom line is, neither of these tools is particularly useable yet - fantastic nonetheless but not really useful. The problem is, the second these tools do give you the quality and animation and realism, all the animation software and animators will be rendered obselete...

    • @tonyr.4778
      @tonyr.4778 Рік тому +2

      There will be great economic problems as AI evolves and jobs are lost in al sectors. We've already seen bank tellers, Copywriters and marketing being first, graphic designers and art directors next. Filmmakers, music composers, news anchors, draftsmen, architects, fashion designers, taxi and delivery drivers, etc. As robotics and AI evolve, there will be fewer and fewer jobs that are not cheaper to do than with technology. We will lose the ability to think and create as we rely on technology more. We will have more people without occupations that still need to be fed and housed and kept busy so they don't revolt. This leads to a dystopian society of walled off communities of elites and ghettos of the masses. If society wants to survive, then there needs to be legislation to control the extent of AI. We will have media completely made up to create narratives that the ruling class figure will control the masses and keep them in their place. We are already seeing the chaos and societal breakdown occurring as media is being controlled. When it becomes manufactured, then the dystopian future we see in sci-fi movies will be reality.

    • @f23r23
      @f23r23 Рік тому +1

      @@tonyr.4778 That was deep. Did you generate this text with ChatGPT?

    • @yoongistongue4163
      @yoongistongue4163 Рік тому +1

      ​@@tonyr.4778well not everything is about money, and for now, even with AI human factor is still a major one. It's like people were panicking when photography was invented. Just chill. It's only a tool.

  • @dewialbar8804
    @dewialbar8804 Рік тому

    Thank you making amazing video,very helpfull.

  • @KingKemet
    @KingKemet Рік тому +1

    Cool vid!

  • @shuxin0909
    @shuxin0909 Рік тому +1

    I like pika. Thanks for your video!

  • @TheAILab67
    @TheAILab67 Рік тому

    1.4k+... Thanks. That is a good review mate.

    • @aivideoschool
      @aivideoschool  Рік тому

      I'm glad you enjoyed it. Thank you for watching!

  • @TheAgeofAI_film
    @TheAgeofAI_film Рік тому +1

    Nice comparison, I've been looking for something that can create consistent results and longer video for my film, I don't think both of these are capable at this moment, but I think soon will be🎉

    • @aivideoschool
      @aivideoschool  Рік тому +1

      I just saw FullJourney allows LoRAs now (haven't tried it yet). I think Loras will help with that consistency even more. Being able to create a custom face you can prompt with will be huge.

    • @TheAgeofAI_film
      @TheAgeofAI_film Рік тому

      Thanks for replying, I think very soon advanced release will cater consistent characters, facial, expression, etc@@aivideoschool

  • @antrich
    @antrich Рік тому +1

    Great comparison. Both are good like you said

  • @dcfun1
    @dcfun1 Рік тому +2

    Informative video

  • @samuelwilson4411
    @samuelwilson4411 Рік тому +2

    Add negative prompts in Pika nd yyour footage will stabilize a lot, especially the hair blowing

    • @aivideoschool
      @aivideoschool  Рік тому

      Thanks, I don't think Pika had negative prompts when I made this but I am very tempted to go back and try now to get her hair to stop blowing :)

  • @m1akarov2021
    @m1akarov2021 Рік тому +2

    Дуже дякую за це відео. Ти мені дуже допоміг.

  • @aiYELLSaboutStuff
    @aiYELLSaboutStuff Рік тому +2

    Thanks for the comparison, very helpful! I've toyed with PIKA and it works well and I think has more creative freedom than runway but so far, runway has been really good in workflow and quality.

    • @aivideoschool
      @aivideoschool  Рік тому

      Totally agree. Someone else pointed out in the comments here, Pika now has a "-fps 24" control you can add to the end of the prompt. So much smoother! Runway's tools are great, and their non-generative AI tools (Magic Tools) are wildly underrated.

  • @whatdoctorsdonttellyou
    @whatdoctorsdonttellyou Рік тому

    Guy in the forest in Runway looks like having a stroke

  • @ezdeezytube
    @ezdeezytube Рік тому +1

    I cannot get objects to move in runway, only the view. Anyone have tips?

    • @aivideoschool
      @aivideoschool  Рік тому

      Runway just released Motion Brush. That might be helpful, combined with a prompt.
      How to use Runway's Motion Brush
      ua-cam.com/video/soZbh9O25ig/v-deo.html

  • @MariusBLid
    @MariusBLid Рік тому +3

    Great video! My experience is that the animations in Pika can be quite amazing, but I rarely see my text prompts impacting the final results though. Maybe I am doing something wrong. RunwayML videos are often extremely cinematic and captivating, however, it certainly does not work with as many different images as Pika. I could just forget trying my own art work with RunwayML, however Pika managed to animate that as well. RunwayML works Great with photo realistic images and highly detailed high quality images. Hope Pika Labs manage to keep their unlimited generations, even on an eventual paid plan. That would make all the difference in my opinion.

    • @aivideoschool
      @aivideoschool  Рік тому +2

      Someone on the Pika Discord mentioned starting with a landscape and adding things to it via text prompt. I could mostly get that to work by telling it where to place the new thing "a tank/nomad/horse goes by in the foreground" which you can see at 05:12.

    • @aivideoschool
      @aivideoschool  Рік тому +1

      also, out of curiosity, is your own artwork landscape or portrait mode? Pika does both, Runway only seems to do landscape.

    • @MariusBLid
      @MariusBLid Рік тому

      @@aivideoschool Cool! Never thought of doing it like that. I have had a subject in my image, and tried animating that subject via text. That doesn't seem to work

    • @MariusBLid
      @MariusBLid Рік тому

      @@aivideoschool Never thought about that, however, my drawings were 1920x1080, so it should have worked. Seems like cartoon drawings are harder to animate in RunwayML, unless they depict humanoid subjects, while Pika on the other hand can easily handle things like cartoon ducks etc

  • @LiebsterFeind
    @LiebsterFeind Рік тому +1

    Excellent comparison video and matches my experience. Sooo... Pika Labs and RunwayML need to have a baby. :) With the guy walking in the forest attempt, did you try passing the "-motion 4" parameter with your prompt, to try and get more motion out of the result?

    • @aivideoschool
      @aivideoschool  Рік тому +1

      Thank you! I just went back and looked and I wasn't using the -motion parameter on those. (That might have been a choice to use "default mode" for both.) I'm loving the new -fps parameter in Pika. I've noticed when using -fps 24 and -motion 4 it sometimes creates too much noise/unexpected motion. Not always but sometimes.

    • @LiebsterFeind
      @LiebsterFeind Рік тому

      @@aivideoschoolWhat are you doing with the -fps parameter? I haven't played with that one. Just the -motion and -ns parameters.

  • @kresimirzex2720
    @kresimirzex2720 Рік тому +1

    you didnt actually use the magic brush in runway, im not saying it would have worked but thats why it exists. so if you had marked only the window with a magic brush and the animated it it maybe would have worked. theoretically.

    • @aivideoschool
      @aivideoschool  Рік тому +1

      Funny you say that... when I recorded this video Motion Brush didn't exist, but once it was released, I went back to test that exact bus ride clip you mentioned and it turned out great. I love Motion Brush. ua-cam.com/video/soZbh9O25ig/v-deo.html

    • @kresimirzex2720
      @kresimirzex2720 Рік тому

      @@aivideoschool Oh thanks. im watching it. i see the proximity should be -10 for one object movement- that was bugging me all this time.

    • @kresimirzex2720
      @kresimirzex2720 Рік тому +1

      U helped me a lot. Im doing animated nfts of ninja ducks rowing in boats, i couldnt get the boat and waves and clouds to all move but not their faces. Even with magic tool. But i never tried -10proximity.

  • @SpawnSniper
    @SpawnSniper Рік тому +5

    Storyboarding will never be the same…

    • @AlexanderKozmig
      @AlexanderKozmig 10 місяців тому

      Optimistic to think that this will only be used in storyboarding.
      At this rate in a couple of years, actors wont be needed, camera men, directors etc. So let's chill and take it more slowly

  • @tyberwhite
    @tyberwhite Рік тому +4

    You can achieve much higher quality videos and better motion with Pika Labs then what's demonstrated in this video. Here is a raw sample clip, with no post-processing. ua-cam.com/video/GMT1TVzDCCU/v-deo.html

    • @aivideoschool
      @aivideoschool  Рік тому +2

      Nice! Those shots look awesome.

    • @LiebsterFeind
      @LiebsterFeind Рік тому

      Really great quality! What do you think of Leonardo AI being fed into Pika Labs (/animate)? The two green female android clips in this video were made this way: ua-cam.com/video/IPLFHNcQY-c/v-deo.html

    • @brandonm7117
      @brandonm7117 11 місяців тому

      just checked out your creations on your channel and they do amazing!! I'm still debating on which platform to subscribe too lol

  • @hollowfate
    @hollowfate Рік тому +2

    It would be awesome to also have a comparison with Motion, from Kaiber AI

    • @aivideoschool
      @aivideoschool  Рік тому

      I was dragging my feet on Kaiber because they were one of the first to go from free to pay-for-credits, but everyone is going paid now. Kaiber seems focused on creators/creatives (rather than corporate/enterprise) which I love so I'm checking them out now.

    • @LiebsterFeind
      @LiebsterFeind Рік тому

      @@aivideoschoolJust paid only? Or Free tier plus paid tier like Leonardo AI and others. Pika Labs is still free, free only in fact.

  • @LadiesFS2024
    @LadiesFS2024 Рік тому +1

    Great Tutorial

  • @lzmihich
    @lzmihich 8 місяців тому +1

    I find both images coming from Pika and runaway, fuzzy blurry and not satisfying, that was ok by the Beta times, but now they are both paid options, it is time to update their core capabilities

    • @aivideoschool
      @aivideoschool  8 місяців тому

      It's a weird trade off: "you don't want it to be blurry? Lower the motion so you get an almost static shot." The original Gen-2 model had a lot more motion and none of the blurriness but there were a lot of hallucinations. I think that's what all the models are over compensating for.

  • @robhitner
    @robhitner Рік тому +1

    Tks.

  • @OshadaAdithya-bs3up
    @OshadaAdithya-bs3up Місяць тому

    thank u

  • @davidteh9106
    @davidteh9106 10 місяців тому

    Hi I want start learning AI , do I need any minimum requirements for my laptop spec?

    • @aivideoschool
      @aivideoschool  10 місяців тому

      You can do a lot of AI stuff on Discord (Morph Studio, FullJourney) or websites (Runway, Pika Labs, Leonardo AI). All of that can be done on a Chromebook or phone. It's only when you want your own computer/GPU to generate things locally that you'll need a powerful computer.

  • @dougharper1492
    @dougharper1492 Рік тому +4

    Pika is fun.

  • @thebrownlizard3988
    @thebrownlizard3988 Місяць тому

    let me tell a greta tip on pika do not take the firt result keep sayign retry and se what happens in 3rd and forth and dso o and on ull see a great acheivements the more you retry i like pika but ill try runway but it seems to blud and amudge so many details,also ts best to use a good ai to create an image then bring it to life with oather imge to video sites such as those

  • @QuickQueryShorts
    @QuickQueryShorts Рік тому +1

    you say that it is possible that you provide too many details and that is why the graphics do not come out, but the AI creators write that the more details, the better

    • @aivideoschool
      @aivideoschool  Рік тому

      I know many people go that route for image generation but in my experience, doing a short, concise prompt with a specific instruction works better for image-to-video. I'm genuinely curious if anyone has good tips involving longer i2v prompts.

  • @FatimaEducationalVoice
    @FatimaEducationalVoice Рік тому

    how can we remove watermark from runway after animation?????

    • @aivideoschool
      @aivideoschool  Рік тому

      In Gen-2 there's a settings button when you generate (currently in the bottom left). If you open it, you can Remove Watermark. If you've already generated the video, try Runway's own Inpainting tool. It might work?

  • @shameforest_
    @shameforest_ Рік тому

    Any idea how to reproduce this on free open source software? Stable Diffusion & Text-To-Video for example. I would be interested in a workflow.

    • @aivideoschool
      @aivideoschool  Рік тому +2

      Pika is free. Also, check out FullJourney, which is free and based on Zeroscope. Here's a tutorial ua-cam.com/video/eaV9wzRDTMQ/v-deo.html

    • @Uniqueness2193
      @Uniqueness2193 Рік тому

      I tried to use pika, register on discord and I couldn't use it instead am still on waitlist

  • @DJABOU-SUCCESS-MOTIVATION-TV
    @DJABOU-SUCCESS-MOTIVATION-TV 5 місяців тому

    I'm preparing a short film, I want to know which AI is the most interesting for generating truly realistic videos, and which even a subscription is worth a little weakness for Kaiber but I hesitate: the murf does not suit me, and Leonardo ai video is too imprecise, same for the sRunwayML videos, from pika

  • @91PowerCart
    @91PowerCart 8 місяців тому

    can move the watermark in Pika?

    • @aivideoschool
      @aivideoschool  8 місяців тому +1

      With a paid plan you can

    • @91PowerCart
      @91PowerCart 8 місяців тому

      @@aivideoschool thanks bro🙏🏻

  • @unrealmotion5867
    @unrealmotion5867 Рік тому +1

    you dont taybe 4k in prompt or 8k

  • @vividval
    @vividval Рік тому +4

    What i see is, runway is better for camera movement, and pika for object. it would have been sick to merge them somehow but idk if it would turn out any good.

    • @LiebsterFeind
      @LiebsterFeind Рік тому

      I've been having great fun and quality using Leonardo AI's new Photorealistic gen mode and taking the image generated and using it with Pika Labs "/animate" command. I believe the output is on par with RunwayML at that point. @aivideoschool

  • @ArcanePath360
    @ArcanePath360 Рік тому +4

    I think Runway looks bad. It's impressive, but it definitely has that AI look that most people are turned off by. It's cartoony. Pika at least looks are artistic and real, rather than CGI fakeness.

    • @aivideoschool
      @aivideoschool  Рік тому +3

      Runway updated their model recently and it looks more realistic than when I recorded this, but I totally agree. I hate the cartoonish AI look that isn't quite animated but isn't real looking either.

    • @ArcanePath360
      @ArcanePath360 Рік тому

      @@aivideoschool It's impressive, but still a long way off from me using either option.

    • @CreateWayoyo-d3t
      @CreateWayoyo-d3t 4 місяці тому

      ​@@ArcanePath360 Can you suggest a better option than this two

  • @Stagefire420
    @Stagefire420 Рік тому +1

    I've been working with Runway and Kaiber. They are hit and miss. I have some outstanding shots, but I have some weird ones. The same for Kaiber.

    • @aivideoschool
      @aivideoschool  Рік тому

      I feel like image to video actually gives better results with more motion than text to video.

  • @ScraggyDogg
    @ScraggyDogg Рік тому

    It was your prompts that didn't work, not the a.i.

  • @asapfilms2519
    @asapfilms2519 Рік тому +1

    We can mix chroma key and AI art to make something cool

    • @aivideoschool
      @aivideoschool  Рік тому

      Runway's AI rotoscope/green screen tool is pretty impressive

  • @VEGETADTX
    @VEGETADTX Рік тому

    No offense meant to the author of this video, of course, but I almost find this video sarcastic because from what I see in a lot of ways Runway's results look waaay worse than Pika's...
    I guess what I my ultimate point is - the quality of the animation doesn't only lie in the smoothness and the lack of noise...just because something is polished and its textures look smoother doesn't mean it more realistic and better overall in all aspects.
    Am I the only one thinking this?

    • @aivideoschool
      @aivideoschool  Рік тому +1

      No offense taken. I just want to clarify that the quality I referred to had to do with technical aspects like HD resolution and frame rate. 3 months ago when this was recorded, Pika was only like 12 fps and half the resolution that it is today. Pika has surpassed Runway and it's still free

    • @VEGETADTX
      @VEGETADTX Рік тому

      @@aivideoschool thanks for the response! I understand your point totally and I'm glad you didn't interpret my comment in a bad way.

  • @SPRINGTIDECREATIVE
    @SPRINGTIDECREATIVE Рік тому +2

    Too bad Pika only generates 3 seconds. Maybe that will increase in the future.

    • @LiebsterFeind
      @LiebsterFeind Рік тому

      Yeah, it would be great if they had the "extend" option like RunwayML. But you could always use a video editor, or automate the process using ffmpeg, grab the last frame, and resubmit it to Pika Labs with the "/animate" command with a text prompt telling it what to do next with that final frame.

  • @MoReese77
    @MoReese77 Рік тому

    I put the same image in both, the Titanic wreckage. Pica made bubbles, Runway turned the image to make a whole new section of the boat. Pika is awful, like it has its own agenda and doesn't follow my prompts

    • @aivideoschool
      @aivideoschool  Рік тому

      I know, I've had success and misses with both. One tip I heard that I found helpful was remembering the AI can see the picture too so I might say "a fish swims out of the hole in the ship" or whatever you're going for. And then keeping the action limited to one specific thing that can be shown in 3 seconds. It's still not perfect but then I fine tune from there or hit the refresh button. Good luck!

  • @harismind
    @harismind Рік тому +2

    I agree. I used both for my 4 minute dark love story, "Law of Attraction" ua-cam.com/video/ExVfCKkQtk0/v-deo.html . I found Pika Labs more useful even with a lesser video quality. Runway ML can be a bit frustrating at times.

    • @aivideoschool
      @aivideoschool  Рік тому

      Nice! Pika now has 24fps if you add this to your prompts: -fps 24

  • @cemgulpunk
    @cemgulpunk Рік тому +1

    Both crap but I prefer Pika for some controls for now. Also it's faster and free beta. Thanks for the video.

    • @aivideoschool
      @aivideoschool  Рік тому +1

      Thanks, I agree. Runway had an early lead but the controls and quality from Pika have surpassed them in the past few months. Hopefully the competition means higher quality video and more creative options.

  • @f4ust85
    @f4ust85 Рік тому

    More mashed potatoes.

  • @mehdiarjmandi5280
    @mehdiarjmandi5280 5 місяців тому

    ai is good

  • @christiandanzig2283
    @christiandanzig2283 Рік тому

    "ai filmmakers" hahaha. find the error.

  • @thecat8513
    @thecat8513 Рік тому +1

    This is a shill video. Pika is paying people off to promote their sub par algorithm. Runway is WAY better.

    • @aivideoschool
      @aivideoschool  Рік тому +2

      FYI - I don't do promos for anyone, I just share what I find interesting and am enthusiastic about. If you watch the whole video, I say they're each better at different things.