New RAG feature for ComfyUI IF AI tools

Поділитися
Вставка
  • Опубліковано 3 жов 2024
  • NEW RAG system for ComfyUI IF_AI tools
    ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
    VIDEO LINKS📄🖍️o(≧o≦)o🔥
    ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
    IF_AI tools with RAG
    github.com/if-...
    ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
    ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
    SOCIAL MEDIA LINKS!
    ✨ Support my (*・‿・)ノ⌒*:・゚✧
    character available at ko-fi.com/impa...
    SD related civitai.com/us...
    ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
    ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
    A1111 forge sdnext
    github.com/if-...
    ComfyUI
    github.com/if-...
    github.com/if-...
    github.com/if-...
    github.com/if-...
    github.com/if-...
    ollama.com/dow...
    ollama.com/dow...
    ollama.com/dow...
    My model for Ollama
    ollama run impactframes/llama3_ifai_sd_prompt_mkr_q4km
    ollama run impactframes/ifai_promptmkr_dolphin_phi3:latest
    My model for other serving tools
    huggingface.co...
    ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
    🔥NOTES
    ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
    Windows version coming soon

КОМЕНТАРІ • 22

  • @rsunghun
    @rsunghun 3 місяці тому +3

    ComfyUi is getting deeper and deeper 😮

    • @impactframes
      @impactframes  3 місяці тому +2

      Yes and this is just the beginning 💪

  • @user-uk9ls
    @user-uk9ls 3 місяці тому +1

    Excellent. Thx!

    • @impactframes
      @impactframes  3 місяці тому

      Thanks I still have to put a lot of work into tweaking it but hey I got the RAG feature working

  • @TheGrayGhost79
    @TheGrayGhost79 3 місяці тому +1

    Awesome tool man! Great work!

    • @impactframes
      @impactframes  3 місяці тому +1

      Thank you, it's not perfect but already can do some things that might be useful for a new type of workflows

  • @TheFutureThinker
    @TheFutureThinker 3 місяці тому +1

    great update my friend 😉👍

    • @impactframes
      @impactframes  3 місяці тому

      Thank you 🙂 I will work on refining it. Hopefully people can make even better workflows with it.

  • @saurabhsswami
    @saurabhsswami 3 місяці тому

    Wow! Comfy is really becoming my favourite thing on the computer. Can we use this workflow to create descriptions from an image too?

    • @impactframes
      @impactframes  3 місяці тому +1

      Yes it can you can even save the description and make a Llava dataset

  • @___x__x_r___xa__x_____f______
    @___x__x_r___xa__x_____f______ Місяць тому +1

    Would you be able to add batch for image captioning? That would be amazing for datasets, especially with the tag functionality to have the model edit the entire dataset caption files once output with consistent keywords across the dataset

    • @impactframes
      @impactframes  Місяць тому +1

      Yes I am going to add it

    • @___x__x_r___xa__x_____f______
      @___x__x_r___xa__x_____f______ Місяць тому

      @@impactframesthank you

    • @___x__x_r___xa__x_____f______
      @___x__x_r___xa__x_____f______ Місяць тому

      Hey, how are you? Any news on this update?

    • @impactframes
      @impactframes  Місяць тому +1

      @@___x__x_r___xa__x_____f______ Yes I am still working on it the way python and comfy works makes it very difficult. It kind of works but is too much for users to do so I can't release it like this.

    • @___x__x_r___xa__x_____f______
      @___x__x_r___xa__x_____f______ Місяць тому +1

      @@impactframesno worries I appreciate your efforts. I realise it has to be manageable and functional cheers for the update

  • @___x__x_r___xa__x_____f______
    @___x__x_r___xa__x_____f______ 2 місяці тому +1

    Hello there, i was wondering if this RAG system could work for captioning dataset images for training with a personal caption style (specific terms I will later use in prompting). I can see your tool allows the use of a txt file to guide inference). Bot sure how to implement batching for all the images in the dataset to be processed

    • @impactframes
      @impactframes  2 місяці тому

      Yes it can buy you need to make your own workflow to do that a powerful model or even gpt4 o mini can be awesome for this I think the new LLaMa3.1 are also multy model so this can be a banger

  • @lucaspedrajas5622
    @lucaspedrajas5622 20 днів тому

    Hace you thought About rag for images?

  • @___x__x_r___xa__x_____f______
    @___x__x_r___xa__x_____f______ Місяць тому

    hello again, i dont see a field for passing documents in the IF Chat Prompt. The extension is up to date

    • @impactframes
      @impactframes  Місяць тому

      @@___x__x_r___xa__x_____f______ yes that's because the rag features only work on the Linux version, I made a Linux branch but you are probably using main. I am working on Windows version it should be ready in a week or two

    • @___x__x_r___xa__x_____f______
      @___x__x_r___xa__x_____f______ Місяць тому +1

      @@impactframes that would be super