Chat with your Documents Privately with Local AI using Ollama and AnythingLLM

Поділитися
Вставка
  • Опубліковано 15 гру 2024

КОМЕНТАРІ • 10

  • @VincentCodesFinance
    @VincentCodesFinance  7 місяців тому

    👍 Please like if you found this video helpful, and subscribe to stay updated with my latest tutorials. 🔔
    ❤ You can support this channel by buying me a ☕: buymeacoffee.com/codesfinance

  • @drkvaladao776
    @drkvaladao776 7 місяців тому +2

    Very nice, easy to follow and set up even if you are not a programer like me, I'm using it with Llama 3 at the moment. Subscribed for more content like this.

  • @englishmimics
    @englishmimics 7 місяців тому

    Thank you so much Vincent for taking the time to create and share that amazing video with us. Your effort is truly appreciated.

  • @etherhealingvibes
    @etherhealingvibes 7 місяців тому +1

    AnythingLLM won't be able to outperform any local inference UI, lacking voice output like Ollama web UI and others, plus inference runs much slower than Msty, ollama CLI and LMstudio.

    • @VincentCodesFinance
      @VincentCodesFinance  7 місяців тому

      I agree that the UI is inferior to pretty much all the other ones I tried. As for inference speed, I configured it to use my local Ollama installation, so the speed is the same. The one use case where I found AnythingLLM better than WebUI is for document search (Msty doesn't have it yet). I haven't tried LMstudio yet but it's high on my list.

    • @etherhealingvibes
      @etherhealingvibes 7 місяців тому

      @@VincentCodesFinance Try Msty inferece spped is really fast, i run a low en laptop, with 4g vram 16gb ram. Hope it helps

  • @englishmimics
    @englishmimics 7 місяців тому

    Vincent, I've seen all your tutorials on ChatGPT-like clones, but I'm still unsure which one to install on my computer! Could you please advise me on which one you recommend, considering I'm not a coding pro? I just want to avoid any unnecessary headaches!

    • @VincentCodesFinance
      @VincentCodesFinance  7 місяців тому

      So far the easiest to install and use is Msty. However, it does not super documents (yet), it is just a pure chat for now.