"okay, but I want GPT to perform 10x for my specific use case" - Here is how
Вставка
- Опубліковано 5 тра 2024
- Finetune Falcon 7b/40b instruct with your own data - The step by step guide about how to train falcon model for generating high quality midjourney prompt, from prep training dataset to comparing final results;
- Join Falcon 40B contest: falconllm.tii.ae/call-for-pro...
- Follow me on twitter: / jasonzhou1993
- Join my AI email list: www.ai-jason.com/
- My discord: / discord
🔗 Links
- Google colab: colab.research.google.com/dri...
- Midjourney training dataset: docs.google.com/spreadsheets/...
- RelevanceAI midjourney training dataset generator: app.relevanceai.com/notebook/...
⏱️ Timestamps
0:00 Finetune VS Knowledge base
1:50 Step1 Choose base LLM
2:30 Step2 Prep training data
4:54 Step3 Setup google colab
5:41 Step4 Load base Falcon model
6:48 Step5 Load training data
7:36 Step6 Finetune model
7:56 Step7 Save & run finetuned model
9:08 Falcon 40b
👋🏻 About Me
My name is Jason Zhou, a product designer who shares interesting AI experiments & products. Email me if you need help building AI apps! ask@ai-jason.com
#gpt #autogpt #ai #artificialintelligence #tutorial #stepbystep #openai #llm #falcon7b #finetune #largelanguagemodels #largelanguagemodel #midjourney - Наука та технологія
No clickbait, no long intro, no over-excitement. Just pure, straight-to-the-point content, with real-world examples and neatly divided sections. You are a hero
You understood that? I wish.
YES! Getting tired of those time filler AI videos, almost didn't watch this one. Now subscribed
Aaaah just like the good ol days 😅😂
@@668771knuckle down and study practice study practice, it's not that difficult 🤷🏽♂️
specific use case: filter videos for overexcitement and clickbait, then tag them
holy heck dude, you just taught us magic. This is the magic! not even the fine tuning, but the data set generation! data sources! all the pieces I have been searching for!
Thanks so much mate!! That means a lot, DM me if you get any question pls!
Literally brother you have taught us prompt engineering wizardry, there’s no other way to put it.
I’ve been generating massive data sets and manipulating in python then bringing it back to fine tune. Shits getting wild out here
@@DeepDiveNFTlol sounds like fun, what kind of general use cases do you have?
Be wary that OpenAI prohibits the use of their models to generate training data (no competing closure). It's hard to detect, obviously, but it's useful knowledge imo regardless.
Honestly, I love how you don't put a clickbaity title or thumbnail, and how you explain it well but also fast.
Very good teaching style. I also liked that you actually went through the process ourself. Thank you very much
One thing I really like about your videos is that it always comes with really quality examples. And the examples are pretty much practical oriented. Do make the embedding video.
Thanks man, that means a lot! 😬
@@AIJasonZ Absolutely agree. Very helpful and i like the speed you go, staying on topic. Please make the embedding video! Very interested to see your take on it.
I thought the opposite, this was like watching someone assemble a nuclear reactor. I'm more confused about AI after watching this. You need to be a master programmer to properly view this video.
@@AIJasonZ +1 on make the embedding video. Really great stuff :)
One of the best and most straight forward tutorials i have Seen after 5 years of ComputerScience! Keep it up now i am honna binge eatvh your other videos
Really appreciate your free thought. Will try to follow you closely.
Omg this is the best one I have seen so far!!!I’m planning to train one of my own model soon!!
Fantastic video once again, can’t wait for the next embedding one 😊
I'm floored by your content. It is amazing 👏👏👏👏👏👏
Bloody awesome video - concise yet detailed! Looking for upcoming vids
Great Video! I would love to see a video on how to create an embedded knowledge base and use it along side this fine-tuning.
I'm glad i found this channal! wonderful work!!
Learning so much from you. Thank you for making this.
Awesome video! So many great resources. Demystified a lot for me. Thanks!
Your audio gradually went from studio recording to cathedral ambiant. Hey thanks for the info. Love it ♥
Excellent video Jason! Step by step examples are really helpful
well done! looking forward to the embedding video too
Man this is exactly the sort of guide I was looking for. Thank you very much.
Excellent video Jason. Well organised and easy to understand.
Good work dude! This is super useful!
most underrated channel in AI. Thank you for the effort you are putting into this.
Great Video! Keep up the good work
Great content! A how-to without any fluff what so ever that is easy to follow.
This is just amazing! waiting for your embedding model
keep the good job Jin Yang，your top follower from shanghai
Great job Jason! Very helpful!
brooo....God bless you for this...gained a ton
Great concise tutorial, thanks!👍
Much appreciated ❤️
Thanks man, this helped me alot!
This is fantastic info, thanks! Subscribed.
One of the best, to the point, goldmine of a tutorial
Real thanks from another Jason man, clear and concise video! As a high schooler, I'd like to create an LLM project, so I hope I can follow through after I do my research :)
honestly, I was not expecting jin yang to teach us but I'm all for it
straight to the point, loved it
So useful! Thank you!
This is an amazing video that helps me make sense of the Azure Open AI playground to train my model. Love this.
Brilliant mate. Keep these coming
Good Job Jason 👨🏽💻
Excellent tutorial on finetuning Falcon 7B
Excellent lesson on Fine tuning. You are a good teacher. Thanks. Please make he next video I am now subbed.
Good stuff Jason🤙🏻
this is gold, thank you!
Great video, dude! Thanks!
Awesome! I'm totally new to fine-tuning. I'm looking forward to fine-tuning a model with thousands of private 4K images!
I like it. Because your video i can follow it every step. It's important for a newbine .
What an amazing to the point video! You're an amazing human being Jason. Keep doing you!
Wow, what a sick video. Thanks so much!
Oh man, this is so good, i always confused about when should i finetune LLM, this makes things super clear; Also falcon 40b seem to be an awesome choice!
Absolutely loved the video mate! super focused! You inspired me for my own channel! thanks and keep it up! :))
Great job !
Would love to see the video on the knowledge database. Thank you for this!
All thriller no filler. Wicked vid well done sir
This is such a relevant and timely video. Thanks bud. PS I love all your silicon valley video titles
fantastically clear
I appreciate this. Subscribed.
thanks for this amzaing videos. looking forwards to your next videos for embedded knowledge base and creating a chatbot for UI using these trained models.
I have been spinning my wheels on a project and this video unstuck me - thanks a million!
Well explained my friend👏👏
really interesting! nice video! 🤗
Thanks for sharing!
Beyond excellent. Damn. Reminds me of Yolo and Stable diffusion in a way. I have got to read the papers sometimes and try tot write a C implementation. This is beautiful!!!!!
Bro you've done something wonderful for the world with sharing this video 🎉👏 As an app dev I learned something I didn't know I needed to know
give this man a cookie, dude thank you !!!!
Great content! thanks for sharing
Great video. Helped create a much tighter solution for our client.
Ey 😊 awesome. I created a conversational api with context management in Java. I've used gpt-4 and learnt allot. I'm hoping I can make use of this as well. Nice video.
Astonishing content Man 👍👍👍
Yes please, waiting for knowledge base embedding video ! 🎉
that was really good glad this was recommended to me
my man great content ever, keep it up
Amazing, thank you!
Looking forward to the video on embedding a knowledge base
you are legend tysm!
Great video mate! Keep up the work (Y)
excellent tutporial! thank you for sharing.
节奏好快，剪得厉害👍
Wow this is amazing, pure relevant data, tahnk you!, you got my subscription and like
Hi,
Thanks for the excellent video.
This channel is going to be huge.
Amazing, you are the best bro. thanks
Great information. I am interested in the embedding style. Would love to see a video of that.
Thanks for sharing such an amazing content! It would be great with you could also make a video about creating embeddings
really helpful and straight forward. Subbed !
Thank you for sharing this. This will definitely help. Also epic thumbnail 😂
great video Jason - also my first ever comment on UA-cam. Most practical tutorials on AI so far imo - I would be keen to see a video where you set up a vector DB and load your own data
Hah thanks, first comment means a lot to me! Will get more content :)
Great video Jason.
This was super informative and I learned a lot. Great video!!
Not to be rude, see this as a constructive comment, be aware of some typos you have along the video. It's not like it bothers me much or anyone, but correcting those little details add up to make your content even better! Good luck and I hope to watch more of your videos :D
Thanks for sharing. It was helpful for understanding the fine tuning process. Can you also make a video on KnowledgeBase embedding? Thanks
Waw that was amazing
Thank you Jin yang
I have been looking for you for so long. Thank you so much for this. Now I can ditch open AI api key and use this for free for my usecase.
Damn amazing video
Thanks for the detail level of explanation .....
Great! Thanks!
Bad audio Dude. However, this is Exceptional content... finally... a workable explanation. Thank You.
awesome video man! thanks a lot :)
Great video, thank you
Great video! Subscribed!
Great video buddy
Well done