ComfyUI With Florence 2 Vision LLM - This Is Not Just A Segmentation Model

Поділитися
Вставка
  • Опубліковано 3 лют 2025

КОМЕНТАРІ • 54

  • @santomakestech
    @santomakestech 12 днів тому +1

    My comfyui doesnt downlaod nothing wit the DownloadAndLoad, what could be the issue? i re install it all again and still doesnt do that

  • @reaperhammer
    @reaperhammer 7 місяців тому +3

    It will be interesting to see how you integrate this into other workflows as you suggested

    • @TheFutureThinker
      @TheFutureThinker  7 місяців тому +2

      Yes I will make another video about that. It should be interesting.

    • @Ai-dl2ut
      @Ai-dl2ut 7 місяців тому

      @@TheFutureThinker Can't Wait :)

    • @TheCinefotografiando
      @TheCinefotografiando 7 місяців тому

      I have found myself watching your videos more and more

  • @x3gxu
    @x3gxu 7 місяців тому +4

    Hi. How did you make the talking head in the corner? Looks pretty good.
    It's not wav2lip. V-express? Hallo? I wasn't able to achieve results like this, so I'm very interested. Can you point me in the right direction?

    • @pabloapiolazza4353
      @pabloapiolazza4353 7 місяців тому

      Also interested!

    • @TheFutureThinker
      @TheFutureThinker  7 місяців тому +1

      This is a short videos done for you guys : ua-cam.com/video/EcAMY-sZ9mY/v-deo.html
      :) hope this help

  • @kalakala4803
    @kalakala4803 7 місяців тому +2

    nice! I just check the Florence-2 LLM video you did. this AI model looks promising. Can you integrate this with AnimateDiff V2V?

    • @TheFutureThinker
      @TheFutureThinker  7 місяців тому

      😉👍you got it

    • @A.eye_101
      @A.eye_101 5 місяців тому

      Florence-2 LLM is not something diff would use to make it better, however you can use it to help with prompting

  • @SageGoatKing
    @SageGoatKing 7 місяців тому

    I don't miss the right click menu bar at all since getting the sidebar where I can pin my favorite nodes, etc.

    • @TheFutureThinker
      @TheFutureThinker  7 місяців тому

      Normally, I use search. I don't have favourite nodes. Cause I use too many

  • @nkofr
    @nkofr 7 місяців тому +2

    what's the use of the 'finetuned' versions?

    • @TheFutureThinker
      @TheFutureThinker  7 місяців тому +1

      Finetuned model on a collection of downstream tasks

    • @nkofr
      @nkofr 7 місяців тому

      @@TheFutureThinker excuse me but what does that mean?

    • @riggitywrckd4325
      @riggitywrckd4325 7 місяців тому +2

      It means that if you have a dataset of stuff you want it to learn you can train those ideas and it will learn to spot them like it does in this one.

  • @promptaganda
    @promptaganda 7 місяців тому

    using spacepxl node, i am getting strange polygons for all images i try to run region to segmentation on. The captioning is working correct. any ideas?

    • @TheFutureThinker
      @TheFutureThinker  7 місяців тому

      This might possibly happen, when the node have no condition logic to specific conditions you are setting.
      Hopefully the developer will do a new update and add something to handle this.

    • @davidsmith-lv4kq
      @davidsmith-lv4kq 7 місяців тому

      @@TheFutureThinker do u mean the prompt must match a word in the caption or region suggestions? i seemed to try alot of different images and regions and could never get it to do anything other than make the polygons

  • @RamonGuthrie
    @RamonGuthrie 7 місяців тому

    Hey can you prompt the Florence2 model on what parts of an image you want to describe?
    Example Describe the background only or Describe the person in detail only!
    or are there better vision models for this?

    • @TheFutureThinker
      @TheFutureThinker  7 місяців тому

      Yes this vision model can be segment the background and then do captioning

  • @patagonia4kvideodrone91
    @patagonia4kvideodrone91 7 місяців тому

    There are other nodes, I don't remember the name now, but what do you say detect me such a thing, and it generates the automatic mask, (but not square) but with its real contour,

    • @TheFutureThinker
      @TheFutureThinker  7 місяців тому

      Segment Anything

    • @promptaganda
      @promptaganda 7 місяців тому

      @@TheFutureThinker every time ive ever tried to add a prompt to a segment anything mode it makes zero mask ....... any suggestions?

    • @TheFutureThinker
      @TheFutureThinker  7 місяців тому

      @@promptaganda what is your setting?

  • @crazyleafdesignweb
    @crazyleafdesignweb 7 місяців тому +1

    that is great stuff! We are getting out of Stable Diffusion with more alternatives.

    • @TheFutureThinker
      @TheFutureThinker  7 місяців тому +2

      There's more 😉 well, I think many users are going to keep SD1.5 and SDXL, others from Stupidity AI throw to bin. 🤭

    • @A.eye_101
      @A.eye_101 5 місяців тому

      Stable Diffusion is a process of generative image creation, this is an LLM for labeling and identification. Apples and sand on the beach, 2 different things

  • @yklandares
    @yklandares 5 місяців тому +2

    Error occurred when executing DownloadAndLoadFlorence2Model:
    Failed to import transformers.models.cohere.configuration_cohere because of the following error (look up to see its traceback):
    No module named 'transformers.models.cohere.configuration_cohere

  • @Rico-nj3vl
    @Rico-nj3vl 7 місяців тому +1

    Very nice !

  • @swannschilling474
    @swannschilling474 7 місяців тому

    Great tutorial! Thanks!!😊

  • @bilalalam1
    @bilalalam1 7 місяців тому

    Hi , I would like to use Florence 2 with LM studio

  • @triojakeson116
    @triojakeson116 7 місяців тому +1

    Hey bro i wanted to ask about the kling ai video, can u tell me how much time it will take for u to get accepted after getting into waitlist, cz am already in waitlist for one day, just wanna make sure, if u know pls reply thanks?

    • @TheFutureThinker
      @TheFutureThinker  7 місяців тому

      Depends, some got it few days in waiting.

    • @triojakeson116
      @triojakeson116 7 місяців тому

      ​@@TheFutureThinkeralso bro am from india, and here all chinese apps are banned, so i had to use an American vpn and a fake chinese number, do u think they will accept my waitlist request if they see all this, will they check all this info 😢

    • @TheFutureThinker
      @TheFutureThinker  7 місяців тому +1

      @@triojakeson116 sorry to hear that. This is more about the company policy, I have no comment.

    • @triojakeson116
      @triojakeson116 7 місяців тому

      @@TheFutureThinker ok bro i will update if something happens 😭

    • @TheFutureThinker
      @TheFutureThinker  7 місяців тому

      @@triojakeson116 but wish you good luck , i see other people are getting access now. So hopefully it will be okay for ya

  • @jairuskersey8311
    @jairuskersey8311 7 місяців тому

    Nice vid. Can you also make a tutorial on how you made the talking avatar in this video? Thanks~

    • @TheFutureThinker
      @TheFutureThinker  7 місяців тому

      just use Hedra, very easy website no need tutorial :) I believe you can do it

  • @yklandares
    @yklandares 5 місяців тому

    Спасибо за урок, ты мне очень помог. Особенно у меня узлы не работали но когда увидел что можно так что он сам скачал, А там оказывается целая папка а не просто модель. В этом и была ошибка. Я помещал модель в папку LLM и он писал ошибку что нет файла JCON а оказывается там скачивается целая папка как узел

  • @context_eidolon_music
    @context_eidolon_music 7 місяців тому

    Holy crap!

  • @A.eye_101
    @A.eye_101 5 місяців тому

    SpaceXL doesn't do video and is more limited, no mask out put and no way to connect it to SAM2 for better SEG, KJ is far better and compatible with SAM2

  • @vitalis
    @vitalis 7 місяців тому

    So cool

  • @yklandares
    @yklandares 5 місяців тому

    help please

  • @robd7724
    @robd7724 7 місяців тому +2

    I'm sorry but the AI voice you are using sounds awful and the video is very creepy.

  • @Beauty.and.FashionPhotographer
    @Beauty.and.FashionPhotographer 6 місяців тому

    All Photos made with Flux look really fake.....

    • @thegtlab
      @thegtlab 5 місяців тому

      Not true at all