Install FLUX locally in ComfyUi with custom LoRA

Поділитися
Вставка
  • Опубліковано 7 лис 2024

КОМЕНТАРІ • 59

  • @Jockerai
    @Jockerai  Місяць тому

    click the link below to stay update with latest tutorial about Ai 👇🏻 :
    www.youtube.com/@Jockerai?sub_confirmation=1

  • @khalilurrehmanzaryani7476
    @khalilurrehmanzaryani7476 2 місяці тому +3

    Thank You!
    You saved soo much of my time

    • @Jockerai
      @Jockerai  2 місяці тому

      @@khalilurrehmanzaryani7476 I'm so happy to hear that that was one of my goals✨

  • @powerfalcon2329
    @powerfalcon2329 2 місяці тому

    Very usefull thank ! i install ComfyUI one week ago and create now anim video for my UA-cam channel with FLUx generated pictures !

    • @Jockerai
      @Jockerai  2 місяці тому

      @@powerfalcon2329 you're welcome bro 😉

  • @astralmooncat_jyro_Tenshi
    @astralmooncat_jyro_Tenshi 2 місяці тому

    That was literally my question! Thanks brother!

    • @Jockerai
      @Jockerai  2 місяці тому

      @@astralmooncat_jyro_Tenshi I'm so happy to here that 🌱😍 stay tuned for next videos

  • @myworld342
    @myworld342 Місяць тому

    Thanks alot for the great content. You explain clearly and dont miss anything. 😊

    • @Jockerai
      @Jockerai  Місяць тому

      Thank you bro for your uplifting comment🔥🔥

  • @adrianmunevar654
    @adrianmunevar654 2 місяці тому

    Thank you! Ignore the stupid comments from some stupid ones. Keep on rocking! 💪🏻🔥

    • @Jockerai
      @Jockerai  2 місяці тому +1

      Thank you so much, my friend! Your comment was really uplifting. I'll keep going strong!❤✨

  • @Fnlig
    @Fnlig Місяць тому

    Can you make a video on how to do the same on Runpod? I like the way you explain things as opposed to other UA-camrs

    • @Jockerai
      @Jockerai  Місяць тому

      @@Fnlig thank you mate ok I'll try to make that video

    • @Fnlig
      @Fnlig Місяць тому

      @@Jockerai Thanks! Because I am running into a ton of issues for trying to do the same, is there a way to get in contact with you for paid consulting?

  • @gabriel007-
    @gabriel007- 13 днів тому

    hello, before installing I wanted to know if it works for this configuration:
    Processor Intel(R) Core(TM) i5-5200U CPU @ 2.20 GHz 2.20 GHz
    Installed RAM 16.0 GB
    System Type 64-bit operating system, x64-based processor

  • @majdijm
    @majdijm 12 днів тому

    Hello and thanks for this greater tutorial, I have a custom lora and I put it in the folder as you mentioned under ..\ComfyUI\models\xlabs\loras then I tried the ALTERNATIVE workflow you mentioned at the end, the first one wasn't able to see my Lora file and the other one gives me "FluxLoraLoader
    list index out of range" msg, can you advice plz

  • @freezeburger
    @freezeburger Місяць тому

    Hi! thank you for the video. Sorry I am beginner. In your workflow, how to have negative prompt? can I add it?

    • @Jockerai
      @Jockerai  Місяць тому +1

      @@freezeburgeryou're welcome my friend, for flux model we don't have a good workflow for negative prompts yet.

  • @muhammadidrees9481
    @muhammadidrees9481 Місяць тому

    Thanks for you hardwork. I follow your every steps in this video, but it is not working. showing some error about Cuda. how to fix this issue

    • @Jockerai
      @Jockerai  Місяць тому

      @@muhammadidrees9481 you're welcome bro, please write the full error here

  • @RayWhite7489
    @RayWhite7489 16 днів тому

    Most of the referenced URLs are blocked by my ISP as being a virus site. Are there alternatives to acquire what is needed so I can try this workflow? Please keep in-mind I am totally new to ComfyUI and am trying to ascertain what files go in which models folder(s). You did mention where to put a few files into models but there are too few tutorial videos that break down these files and what models folders they go into! Perhaps a tutorial video for beginners that breaks down ComfyUI functions, models,, files to models folders ... such a video would be great for we beginners who are able to achieve some success with the default workflow but are having troubles getting most other workflows to work. My workstation has 32gB of system RAM, 16gB of VRAM on a NVidia Quattro RTX 5000 graphics controller card ... running Windows 10 for Workgroups ...

  • @Masta91330
    @Masta91330 Місяць тому

    Hi buddy, thanks for the tutorial, I have a mistake " reconnecting" while using the original workflow; I had this issue due to a lack of virtual memory, and I fixed this, do you know how to solve this?
    Otherwise, I tried alternative workflow and I have mistakes

    • @Jockerai
      @Jockerai  Місяць тому

      You're welcome buddy. Use GGUF versions of flux which I explained in "flux low VRam" video

    • @Masta91330
      @Masta91330 Місяць тому

      Thanks, I have an 7900xtx 24go ram gpu, I think it’s due to amd gpu not compatible

  • @Mircarin
    @Mircarin 11 днів тому

    I'm stuck at CLIPTextEncodeFlux :( Please help

  • @karansonkar2434
    @karansonkar2434 Місяць тому

    I've already trained my own LoRA on Replicate. If I use ComfyUI, do I have to pay for every image I generate? I'm looking for a free version. I'm using an RTX 2060 with 6GB of RAM and a Ryzen 5 3600 CPU with 12GB of RAM. Which version should I use, and how can I avoid any problems after installing it?

    • @Jockerai
      @Jockerai  Місяць тому

      you can use your own lora on your PC and it is free. But if your system is not powerful enough it takes long time to generate images with lora. you can use replicate website to generate your images for 0.04$ per image I think.

    • @karansonkar2434
      @karansonkar2434 Місяць тому

      ​@@Jockerai My concern is that I've tried using Flux on Replicate, but I've had limited success in creating a specific image using my own LoRA (e.g., a man in a Superman costume shooting laser beams from his eyes). Despite attempting 30 different prompts, I couldn't achieve the desired result with accuracy. This experience has made me hesitant to pay for the service, and I'm now exploring free alternatives to achieve my goal.🥲

  • @Yuuyu_play
    @Yuuyu_play Місяць тому

    👍👍👍👍

  • @AIChandu77
    @AIChandu77 Місяць тому

    I'm facing issue for creating photos of custom lora in comfy ui. I'm newbie. What I did is. I trained lora model from cloud flux replicate called Ai-tool kit and which i saved in hugging face. After i downloaded comfy ui and flux dev modes. I saved my lora in comfy/modes/lora. When i give my trigger name. I'm getting different person then my model.
    As yours video. says to save lora in comfy/model/xlab. But that's too getting error.
    Can you please tell me exactly what to do.

    • @Jockerai
      @Jockerai  Місяць тому

      you have to change your lora loader node. watch the one of my videos titled Multi-Lora in comfyUi and your issue will be solved

  • @magnetic7832
    @magnetic7832 19 днів тому

    My Comfyuai doesn't have a load diffusion model, only a load control point. Why is that?

    • @Jockerai
      @Jockerai  19 днів тому

      @@magnetic7832 have you installed all missing nodes?

    • @yomi0ne
      @yomi0ne 12 днів тому

      i have the same question. Also, the list is empty on the custom nodes folder.

  • @xinoActitud
    @xinoActitud Місяць тому

    I follow the steps from your video but my ComflyUi is creating empty black images, what should I do? Thanks in advance!!!!

    • @Jockerai
      @Jockerai  Місяць тому

      @@xinoActitud which workflow did you use?

    • @xinoActitud
      @xinoActitud Місяць тому

      @@Jockerai lora_workflow.json

    • @BlueClaireRed
      @BlueClaireRed Місяць тому

      Almost done, same problem here black image getting very slow, used alternative but by your guide, lora_name Flux-train_replicate was never mentioned so i added it from hugginface, but the workflow doesn't start at all. There are no errors as well :(

    • @BlueClaireRed
      @BlueClaireRed Місяць тому

      After clearing the previous queue from workflow 1, and duplicating loras from xlabs to loras folder alternative workflow started, but again images are black :(

    • @xinoActitud
      @xinoActitud Місяць тому

      @@Jockerai lora_workflow.json

  • @fahimabdulaziz4255
    @fahimabdulaziz4255 2 місяці тому

    can I run without GPU on my ryzen 3 3200g, 32GB RAM ?

    • @Jockerai
      @Jockerai  2 місяці тому +1

      @@fahimabdulaziz4255 I don't think so but there are version of Flux that can be run on low GPU's. Stay tuned I'm going to make a video for them nf4 and GGUF flux model versions.

  • @thebuniverse6739
    @thebuniverse6739 Місяць тому

    I tried to generate ai in flux with the prompt "naked" and the model is censored how do you get it uncensored?

    • @Jockerai
      @Jockerai  Місяць тому +1

      @@thebuniverse6739 What you get when you use such words? I don't think it is censored when you are using flux locally. But online flux websites, yes they don't allow NSFW contents to be created

  • @DouglasPerry-o6o
    @DouglasPerry-o6o 2 дні тому

    Hi. I did everything you showed me. I think it's working. I have a macbook M2 max. But when I ran it - you have it at the very end of the video - an error popped up about the FluxLoraLoader node. I asked chatgpt and he gave me this answer: The error in ComfyUI is related to the DoubleStreamBlockLoraProcessor model loading, where certain keys are missing from the state dictionary (state_dict). The missing keys include parameters such as ‘qkv_lora1.down.weight’, ‘qkv_lora1.up.weight’, and others. This indicates that the model you are trying to load is either incompatible with the current architecture or is corrupted or misconfigured. Maybe you can tell me the reasons why?

    • @DouglasPerry-o6o
      @DouglasPerry-o6o 2 дні тому

      This bug is related to using the matrix multiplication (matmul) operation in Metal Performance Shaders (MPS) on macOS, which detects a data type mismatch: FP16 (half-precision floating point) and BF16 (bfloat16). Metal does not support mixed operations with these data types. So it turns out that Flux with custom LoRA will not work on my macOS m2 max? Is it possible to replace this LoRA with another analogue?

    • @Jockerai
      @Jockerai  2 дні тому

      Hi! To resolve the issue with loading the Lora, try removing the FluxLoraLoader and replacing it with PowerLoraLoader. But before that, go to Manager, then in the Install Custom Nodes section, install RGthree. After that, restart ComfyUI. This should likely fix your issue.

  • @nopal3d28
    @nopal3d28 Місяць тому

    hi , i get this error "FluxLoraLoader list index out of range" ?

    • @Jockerai
      @Jockerai  Місяць тому +1

      Please watch the next video titled "install Flux multi-Lora" and change the node for loading flux lora

    • @Jockerai
      @Jockerai  Місяць тому

      👍🏻 thanks

  • @pazuzu666
    @pazuzu666 Місяць тому

    Seems like the links to your workflows doesn't work anymore

    • @Jockerai
      @Jockerai  Місяць тому

      I have checked it just now and it works. when you open the link just click download button on top right of the screen and you are done

    • @pazuzu666
      @pazuzu666 Місяць тому +1

      @@Jockerai Now they work , thanks.

  • @loktar00
    @loktar00 2 місяці тому +2

    These videos are so cheesy since they're done with AI.

  • @GandalfTheStacked
    @GandalfTheStacked 6 днів тому

    unfortunately, i am encountering a problem where the thing crashes right around this step "Requested to load FluxClipModel_
    Loading 1 new model
    loaded completely 0.0 9319.23095703125 True
    C:\Users\thero\Desktop\ComfyUI_windows_portable\ComfyUI\comfy\ldm\modules\attention.py:407: UserWarning: 1Torch was not compiled with flash attention. (Triggered internally at ..\aten\src\ATen
    ative\transformers\cuda\sdp_utils.cpp:263.)
    out = torch.nn.functional.scaled_dot_product_attention(q, k, v, attn_mask=mask, dropout_p=0.0, is_causal=False)
    Unloading models for lowram load.
    0 models unloaded."
    I would appreciate if you could help me