Controlling Blender with my voice using LLM

Поділитися
Вставка

КОМЕНТАРІ • 70

  • @ElKulte
    @ElKulte 16 годин тому +21

    I think this is a brilliant proof of concept of how useful these things can be in the future. Really excited about this - thanks for the demonstration

  • @appuwa69
    @appuwa69 Годину тому +1

    LLMs struggle with physics. You should've asked it to create a landscape or something with various elements

  • @onhel1679
    @onhel1679 8 годин тому +9

    This is the wildest thing I have seen someone do with AI

  • @MrWoundedalien
    @MrWoundedalien 7 годин тому +4

    This is awesome! Early stages, but very impressive how you got this to work a little bit.

  • @SubjektDelta
    @SubjektDelta Годину тому +2

    You can probably output the generated code into your blend file through the Gemini API.
    But it would require you to write an extra script that's running on your computer to take in that data and put it into that blend file.
    You can probably ask Gemini about it and figure it out! 😉

  • @Maro_Experience
    @Maro_Experience 2 години тому +1

    FINELLLY A USEFUL VIDEO OMG, THE OLD YOU IS BACKK

  • @kcharles6642
    @kcharles6642 Годину тому

    This is amazing proof of concept. Keep up the good work. 👍

  • @anhartoliver.8008
    @anhartoliver.8008 15 годин тому +2

    I already like playing around in blender alot, this just makes it a thousand times more fun.

  • @hm64designs
    @hm64designs 14 годин тому +4

    now that was sci-fi episode.

  • @iPEMiC.
    @iPEMiC. 3 години тому

    Nice update here, yeah that can be so helpful for artist that don’t know much about scripting, quite impressive thought for the simple demonstration!

  • @newrockboy1553
    @newrockboy1553 2 години тому

    Almost like magic. This will have many uses for us 3D Artists. Thanks for sharing!

  • @PrinceWesterburg
    @PrinceWesterburg 9 годин тому +14

    As a boy in the mid 70s, I had a vivid dream of being in a wonderous snowy white landscape of snow covered trees, walking with this woman hand in hand. I was aware it wasn't real and that we where both in some sort of machine that let us be any age and anywhere. This will happen and I'm now 56 and have met the lady in the dream!

  • @davecalister6189
    @davecalister6189 15 годин тому +1

    ❤❤❤ you are so clever! beautiful test! you are the best!

  • @CinematicCroissant
    @CinematicCroissant 12 годин тому +1

    Another banger, like usual

  • @artekal3d
    @artekal3d 2 години тому

    Damn, that's amazing! I'll try that and let you know if i come up with something amazing!

  • @ChristiantDalberto
    @ChristiantDalberto 9 годин тому +2

    Something went right !

  • @erlinghagendesign
    @erlinghagendesign 10 годин тому +1

    Brilliant! suggestions: 1. make your commands to Gemini less conversational, just commands. 2. Can you let Gemini record all its output to a continuous output aka text file which you can see during your minimal use of TinyTask so that you have a control view of the scripts and give precise correction commands

  • @vay911.
    @vay911. 16 годин тому +3

    I was thinking about it.. when we got “ok google”

  • @valverdecreative7174
    @valverdecreative7174 11 годин тому +1

    Very impressive!!

  • @276_rein
    @276_rein 4 години тому

    Holy! That's a brilliant setup for voice command control😲
    Imagine integrating this directly into Blender.

  • @samdavepollard
    @samdavepollard 37 хвилин тому

    excellent video and really exciting to see what is already possible
    can't be long, surely, before this is turned into some kind of add on?

  • @simeon_vkv
    @simeon_vkv 12 годин тому

    hahaha just got on the TinyTask part, you are wild bro :D

  • @Shabani24
    @Shabani24 17 годин тому +2

    I like your vids

  • @dipankarbiswas033
    @dipankarbiswas033 3 години тому

    Brother you are awesome 👍

  • @kartikeye
    @kartikeye 2 години тому

    We are gonna have a personal blender 'Jarvis'.

  • @HikingWithCooper
    @HikingWithCooper 7 годин тому

    Yeah, that is already more than I can do in Blender. Hopefully the Blender geniuses maybe add a Gemini API or otherwise make it work how you suggested. Please post another video when you figure out more. Subbing.

  • @khairo.ben1
    @khairo.ben1 16 годин тому +14

    me everytime i watch polyfjord video:
    how did he even think about that??????

  • @orcanimal
    @orcanimal 16 годин тому +2

    The future is scary

  • @3DComparison
    @3DComparison 18 хвилин тому

    This is amazing, luckily for Blender it is well trained, for other specialized CAD solutions such as CATIA, it is not very good. For VFX software like Houdini it is also not very well trained. But I am sure it will get better and better fast!

  • @ChaosOver
    @ChaosOver 44 хвилини тому

    hm yeah, well. nice proof of concept, but still not very useless, because its incredible hard to precisely describe what you want. But nice to maybe have an assistant for switching tools and adding modfiers, just to save some keystrokes or walking through menus. but imagine this in an office environment. your working colleages will kill you when you are talking all day XD

  • @malinenanjing
    @malinenanjing 3 години тому

    you found all the lazy ways of designing the model I was laughing half the way.

  • @SadokSeddik31
    @SadokSeddik31 8 годин тому

    wow this is genius, thx for the video

  • @Sujal-ow7cj
    @Sujal-ow7cj 4 години тому

    i am doing this for one year now and this is only model that does this good

  • @Next1foreal
    @Next1foreal 4 години тому

    very cool!

  • @sureztv5836
    @sureztv5836 3 години тому

    I was literally clapping my hands..

  • @EMNM66
    @EMNM66 6 годин тому

    Bro is lazy af and extremely talented at the same time 😂

  • @Copa20777
    @Copa20777 4 години тому

    Genius.. ❤4rmZambia 🇿🇲

  • @sohailamahmoud3444
    @sohailamahmoud3444 11 годин тому

    you'r so smart man : )

  • @agyab3d
    @agyab3d 16 годин тому

    am loving this video.. tons of infor too😅😅😅

  • @3pcgi959
    @3pcgi959 11 годин тому

    Crazy 😮👍

  • @relative_vie
    @relative_vie 3 години тому

    This ai sounds like he’s so over his purpose lol

  • @mammerman
    @mammerman 9 годин тому

    I wonder how it would do if you described something more complex than the basic meshes. Like if you describe a scene to it.

  • @leafy_5
    @leafy_5 14 годин тому +1

    Well this is both fascinating and terrifying 🫣😳😁🤣🤓 futures changing fast!

  • @taureanwooley
    @taureanwooley 3 години тому

    They, sometimes continued people, had to create all that stuff for something different

    • @taureanwooley
      @taureanwooley 3 години тому

      BTW remember Gemini isn't looking at the render screen when you are giving it commands to create the python ... there is a way to, but ...

  • @SinanWP
    @SinanWP 11 годин тому

    nice
    as always google makes half baked model again that soemthign went wrong very annoying that is the reason why I still pay chatgpt

  • @scoruluce
    @scoruluce 16 годин тому +1

  • @yeknommonkey
    @yeknommonkey 11 годин тому

    Enhance..

  • @peteraagaardcarstensen400
    @peteraagaardcarstensen400 15 годин тому +1

    I think you just need to be much more precise when describing the task. Many of the commands you gave it where a bit messy 😊

    • @Polyfjord
      @Polyfjord 15 годин тому +1

      That's a good point yeah!! I agree

  • @ASchnacky
    @ASchnacky 3 години тому

    it always falls alseep and restarts on me too

  • @Ikennam
    @Ikennam Годину тому

    😮🤯

  • @Mix3Design
    @Mix3Design 14 годин тому

    I did the same year ago with only chatgpt 😂 it's crazy

  • @31RIP
    @31RIP 5 годин тому

    wow

  • @citriccanine544
    @citriccanine544 17 годин тому +4

    This sounds tedious

    • @joannot6706
      @joannot6706 4 години тому

      Maybe for now, but imagine this as a blender add-on

  • @vay911.
    @vay911. 16 годин тому

    Anyways.. nice..

  • @ibewatchinu
    @ibewatchinu 15 годин тому

    interesting

  • @googleyoutubechannel8554
    @googleyoutubechannel8554 11 годин тому

    Wow. google is really spreading the payola dollars around huh. Ask it to give you the approximate position of the buttons, you know, something that would actually be useful........

  • @VincentFikacz
    @VincentFikacz 16 годин тому

    Not really useful xD But exciting concept nonetheless, just one step closer to ai assistant like Jarvis or EDI :D

    • @Polyfjord2
      @Polyfjord2  15 годин тому +2

      Agreed!! Thought I’d make this video today so we can laugh about it in 6 months

  • @Disent0101
    @Disent0101 17 хвилин тому

    or just give it full mouse and keyboard control...then it can write or point and click, like we do...take away the burden of our existence please ai

  • @lucasdotmcq
    @lucasdotmcq 16 годин тому +2

    yeaa ai is not taking over someone could do all this by hand in like two minutes

  • @TR-707
    @TR-707 16 годин тому +1

    is this legal?

  • @Maxparata
    @Maxparata Годину тому

    It's very cool, it's like magic!!
    But like magic, it's useless.
    You can create these scenes faster with shortcuts and no AI. I think it can be good for more reptitive and boring tasks though. But in that case, you'd create an addonso you can always run it for other scenes.
    I think this will be useful when it will actually model something (clean) from scratch, or when it will be able to kitbash scenes or prefabs from an asset browser.