From OpenAI to Open Source in 5 Minutes Tutorial (LM Studio + Python)
Вставка
- Опубліковано 10 чер 2024
- From OpenAI to Open Source in 5 Minutes Tutorial (LM Studio + Python)
👊 Become a member and get access to GitHub:
/ allaboutai
Get a FREE 45+ ChatGPT Prompts PDF here:
📧 Join the newsletter:
www.allabtai.com/newsletter/
🌐 My website:
www.allabtai.com
LM Studio:
lmstudio.ai
How to switch from OpenAI API to Open Source Model in 5 minutes. We test out LM studio local server to download and use the Dolphin Mistral 7B open source LLM in Python.
00:00 Intro
00:22 Step 1: Download LM Studio
00:41 Step 2: Download a Model
01:53 Step 3: Test the Model
03:25 Step 4: OpenAI to Open Source
05:19 Step 5: Python x LM Studio Test
06:09 Step 6: Uncensored Model Test - Наука та технологія
Very good information, and well presented. Thank you!
This was so incredibly helpful... thank you!
Brilliant as always!
Beautifully explained. Thanks a bunch
Love the pace you present at. No filla.
Man, you always go THE deepest with your AI insights and videos. Kudos, bro! Always #AIDOPE 🍪
Thanks!👍👍👍 Useful information.
amazing content. greatly appreciated
Legend, thanks for sharing this
Always appreciate the overview, thank you.
I'd like to know why you choose the older version (v2.2.1) instead of the newest one, the 2.6 ? the size of the dolphin-2.6-mistral-7b.Q5_K_M.gguf is almost the same ?
Excellent - what is your hardware setup?
Thank you.
Hi very interesting indeed, one question what are the requirements to run the model? I’m asking because my goal will be to use flowiseai hosted locally , then host a vector database like supabase, ingest our technical document and create a chatbot for our needs completely local. At the moment I’m using OpenAI ChatGPT api but I want to do it completely offline for privacy reason
Lol I'm doing the same
Just a question. What is your hardware configuration for running the local models?
Does this mean i can run this Llm on my local desktop computer at home, and be able to access it from my laptop online? Sorry if it’s a dumb question im new to this
How should I choose among LLMs for download? what are the criteria?
well thanks to you i got a new way to use local ai model as a API. never knew this was possible too. can you make more such videos?
Does this mean i can run this Llm on my local desktop computer at home, and be able to access it from my laptop online? Sorry if it’s a dumb question im new to this
Can we download the python code?
Sam Altman: "How dare you!"
What are the minimum system requirements to run models locally?
How would you deploy this to use via api?
were can i get this code and do i have to load it into visual studio
Is there a link to the script?
awesome
Tnx, very helpful! Are you ENTP? 🤔
woooow
thanks for this
im free with chatgpt
i got a 1080ti and for some reason i can't get it run on my GPU.. is my GPU too old??
do you do this so you can get the fully uncensored output? I tried asking it iffy stuff and it gave me a nope in LM Studio. Same model
Did you try it on the uncensored model he describes at the end?
Fungerar AMD gpu's?
Are there models on LMStudio that can do image recognition like GPT4?
llava
You are right, there is llava model, but I dont see LMStidio ui option to add photo in chat mode. May be there is python option?
Dont clear understand, isn't it possible to just download models from HF and use them locally? Why is LM studio local server need?
Yes very much possible to do without lm studio, but what lm studio brings to the table is one UI for all that you do in different terminal windows otherwise. It becomes very messy, with the terminals running, then you want to change some configurations, you want to jump from one model to another etc.,
Can you please provide the test3.py file?
You are Late for the party 🥳
Cool and very useful. . But I would appreciate videos on how to do this without being beholden to some company and its apparently closed source product. Government crackdowns are coming and I want as much of my toolchain on my own hardware and in my control as possible beforehand.
Can you explain a little bit more about what you mean by government crackdowns? Are you talking about the copyright issues with OpenAI and big industries like Hollywood and Newspapers suing them and potentially having them raided by FBI, CIA or some other corrupt agency?
Yup me too I downloaded that shit as much as I could to my local drives. 500GB+ so far... Gimme!!
I wouldn't be surprised if they removed uncensored models from the web.
Actually they will 100%, because it's a security threat to them.
Prepare for the end folks be smart lol
Are you saying lm studio is the issue? Just curious to understand what you mean.
@@AberrantArtyes it is not open-source
Very Very slow though
Ugh still too involved for non techies like me. Cant someone just package all this up in an executable? I mean that’s the whole f-ing point of ai isn’t it? So we don’t have to bother with command line BS. Pfft!
Step number one - to download some proprietary shit... Not interested