Get Started with Mistral 7B Locally in 6 Minutes

Поділитися
Вставка
  • Опубліковано 12 лис 2024

КОМЕНТАРІ • 44

  • @DevelopersDigest
    @DevelopersDigest  6 місяців тому

    Check out my latest project where you can use Ollama + Mistral + Llama 3! git.new/answr ⭐(LLM Answer Engine)

  • @prodigiart
    @prodigiart Рік тому +14

    I had a few failed attempts trying to get these cool language models up and running on my Mac. I was happy to finally get clear instructions on how to get started. I found your video very helpful - thank you!

  • @Taskade
    @Taskade 6 місяців тому

    Excited to see Mistral in action in Taskade's next Multi-Agent update! 🌈

  • @sitrakaforler8696
    @sitrakaforler8696 Рік тому +5

    Ollama is life !
    Thank you for your awesome video man !!!!

  • @AIEntusiast_
    @AIEntusiast_ 8 місяців тому

    would love to see this on a live server step by step guide and also implemented with the tokens, seconds and information it shows when running them from mistral site

  • @trackerscr4100
    @trackerscr4100 Рік тому +4

    Excellent video friend, I was searching for this exactly like you did. Thanks😊

  • @mrquicky
    @mrquicky Рік тому +2

    I have this gut feeling that ollama is being used in open-interpreter based on the chunks streaming reply code.

    • @DevelopersDigest
      @DevelopersDigest  Рік тому +2

      You might find this interesting: github.com/KillianLucas/open-interpreter/pull/124
      Cheers! I

  • @ronan815
    @ronan815 9 місяців тому

    Super great tutorial, thank you so much. Which tutorial would you recommend next in order to start using Mistral AI locally to be used with langchain?

  • @diptampaul7595
    @diptampaul7595 10 місяців тому +1

    can we custom train Mistral using Ollama?

  • @rogue_carlisle6167
    @rogue_carlisle6167 2 місяці тому

    it needs a lot of specifications right?

  • @memegene69
    @memegene69 Рік тому +32

    While I appreciate this video, I wish you had mentioned at the start that this wouldn't work with windows.

    • @DevelopersDigest
      @DevelopersDigest  Рік тому +14

      That is very fair feedback, and helpful to point out. I’ll point that out in future videos!

    • @Learntsomethingtoday
      @Learntsomethingtoday 11 місяців тому +5

      Lm studio solves this. ❤

    • @bigpickles
      @bigpickles 11 місяців тому +8

      It's mentioned within the first 2 minutes 😊

    • @krzysztofzabolotny4802
      @krzysztofzabolotny4802 7 місяців тому +1

      Take a look how to dowlmnload docker, and you can run it there.

    • @ceciliadisanti371
      @ceciliadisanti371 6 місяців тому +1

      ​@@DevelopersDigestWow, I appreciate the video😊 I have to learn to prompt in Mistral in the shortest time possible, could you help me understandig how I
      I can get it? I'm new in the Prompting Engineering and I'm not a developer.

  • @nasiksami2351
    @nasiksami2351 Рік тому +2

    Can we train these models on our own custom data? Will it be free in that case?

    • @DevelopersDigest
      @DevelopersDigest  Рік тому

      You can absolutely fine tune llama models as well as mistral. I would check their license if you plan to use fine tune versions within production (can check most open source models permissions on huggingface).
      If you are looking to try and fine tune locally, I would check out:
      github.com/cckuailong/SuperAdapters
      Cheers!

    • @nasiksami2351
      @nasiksami2351 Рік тому

      Thank you so much! I'm definitely gonna check this out! @@DevelopersDigest

  • @alivecoding4995
    @alivecoding4995 Рік тому +1

    What is the difference of ollama compared to gpt4all?

    • @DevelopersDigest
      @DevelopersDigest  Рік тому

      Similar in some regards, I haven’t personally done a deep dive into gpt4all yet. Cheers 🥂

  • @Andrea-Giachetto
    @Andrea-Giachetto Рік тому +1

    Great content!

  • @faridfarid-s3d
    @faridfarid-s3d 9 місяців тому

    Now its available in windows, you could add a pinend comment for that.

  • @masterac7344
    @masterac7344 Рік тому +2

    can you do a video for windows ?

    • @DevelopersDigest
      @DevelopersDigest  Рік тому

      I unfortunately don’t have a PC right now!

    • @masterac7344
      @masterac7344 Рік тому

      @@DevelopersDigest i will be waiting with anticipation

    • @padthaizilla9165
      @padthaizilla9165 11 місяців тому

      i can't find the ollama for windows i think is not even out yet

  • @BudoReflex
    @BudoReflex 8 місяців тому

    For the algorithm.

  • @mubasharwarriach7216
    @mubasharwarriach7216 Рік тому +1

    Can we do embedding with this?

    • @DevelopersDigest
      @DevelopersDigest  Рік тому +1

      Mistral doesn’t have a open source embedding model yet and ollama has embeddings that can now be accessed as well, here is the langchain documentation! js.langchain.com/docs/modules/data_connection/text_embedding/integrations/ollama

    • @mubasharwarriach7216
      @mubasharwarriach7216 Рік тому

      @@DevelopersDigestcan you make a video about some free embeddings llms alternatives to openai embedding. We would appreciate it. Love your channel. Love the fact that you are straight to the point.

  • @JonathanAgoot
    @JonathanAgoot Рік тому +1

    4:59 Node... I mean bun 😅

    • @DevelopersDigest
      @DevelopersDigest  Рік тому +2

      I mean… I think that one is going to catch us all up for some at least a little while right? 😅

  • @DJMerrell86
    @DJMerrell86 2 місяці тому

    ewwww typescript