How to Run Local AI Models - in 5 minutes

Поділитися
Вставка
  • Опубліковано 3 жов 2024

КОМЕНТАРІ • 13

  • @danielhabibio
    @danielhabibio 3 місяці тому +6

    This is the first tech tutorial I've ever seen that was recorded in the woods!

    • @DiogoNeves
      @DiogoNeves  3 місяці тому +4

      @@danielhabibio thanks!
      The coming videos should also have an outdoor twist too 😉 hopefully gets more people in the flow and woods are just awesome.
      P.s. I promise I’m not building a bunker in the woods to hide from our AI overlords 😉

    • @NickWinters
      @NickWinters 16 днів тому +1

      Mine too!

    • @DiogoNeves
      @DiogoNeves  16 днів тому

      @@NickWinters thanks I appreciate the comment
      There’s another one coming, on Llamafiles (I’m feeling bad it’s taking so long but coming) and I’m also going to start doing Lives soon.
      Subscribe if you’re interested 😊
      Have a great day

  • @luciferovonnachtosphere
    @luciferovonnachtosphere 3 місяці тому +3

    Finally, I found a well-made, no-frills, guide to installing local LLMs!

    • @DiogoNeves
      @DiogoNeves  3 місяці тому

      @@luciferovonnachtosphere thanks 🙏 I really appreciate

  • @yorkie4k
    @yorkie4k 2 місяці тому +2

    I've been using LM Studio as it just works. Super easy to build plugins with the server as well to get functionalities that aren't in the app.

    • @DiogoNeves
      @DiogoNeves  2 місяці тому

      @@yorkie4k totally! I’m now also looking into Llamafiles and SQLite-vec. Both really cool too, but LM Studio is still the simplest and most accessible I know
      Do you use LM Studio just for the chatbot? Or are you building something with it?
      Would love to learn more 😉

    • @yorkie4k
      @yorkie4k 2 місяці тому

      @@DiogoNeves I've built my own RAG app for it. If you're in the LM Studio discord you'll see my post on it.

  • @aca95aks
    @aca95aks 3 місяці тому +2

    I'm much preferring LM Studio than GPT4All - thanks for the tutorial :)

    • @DiogoNeves
      @DiogoNeves  3 місяці тому

      @@aca95aks thanks 🙏 yes, I really like the simplicity and interface of LM Studio. Have you tried any of the other alternatives like Ollama?

  • @boqoll
    @boqoll 2 місяці тому

    U need a supercomputer for this. The regular m.2 mac, can’t handle this. Way too slow…

    • @DiogoNeves
      @DiogoNeves  2 місяці тому

      It needs a fair bit of memory, I’m running on an M1 Air with 16GB
      Which models have you tried? Start with a smaller one. How much memory do you have?
      Soon I am going to show a lighter approach that although slow, runs on a raspberry pi