Great video again Matt !!! Knowing the difference to not make mistake on when to choose Fine Tunnng over RAG really deserves a long video like this one. I prefer MLX since I have a mac Also importan… please plan a video to know different hardware setups to train, and to use to use local models for inference on a home lab environment, how to use very large models like llama 3.3 70B in a homelab, pros and cons Thanks again
Thanks. I was misunderstanding fine tuning text models. But what about fine tuning a text and vision model. Could you tune it to recognize images it wasnt trained on?
Grwat video! I was really looking forward to you explaining finetuning in regards to Ollama! I'd vot either one method, as long as it's done all locally (no online service, and oviously Lora and Qlora oriented) and can be done on windows!
@Matt as always super useful. I am down for the MLX fine-tuning first. I became a member from your channel today. Keep doing this high quality content and helping us to navigate Ollama and Llama models potential. 🦾🦾🦾
Great Video!! I would love to see a video on training with TextGen WebUI. It supports Lora and QLora and with the Training_Pro ext. it has dozens of setting including some experimental ones, it also has a built in training//loss graph so you can track your progress. best of all it supports Multple GPU's so you can train bigger models locally. The problem is it lacks good documentation so I dont know what half of the options do. I would be cool to see you cover them.
Thanks, I found this video helpful. I am interested in tuning a vision model usable through ollama for Lego identification. I am not sure any of the models actually know the Lego part numbers, so I suspect I need to train a model also. One goal is tell me what this Lego part numbers is.
Great videos I like your content. Can you review fine tuning an image model? I am thinking llama-3.2-11B the use case I have been considering is to fine tune it to better recognize a person's hand writing style to more accurately convert written documents to text as part of a pipeline to then have another fine tuned model read those text notes and write a short report on them. Just a thought. Thanks!
@ iPhone 16 pro max. Pretty sure it’s not my device. I tested it with multiple videos to make sure that it’s not my phone right before posting the comment above
@technovangelist Hey man, love your content. Please dont put race cars and cool images as thumbnails, its better if we can see a picture of you, so we quickly can spot that its you who put out a new video and its time to tune in. With ai generated thumbnails, you kind of blend in with all other channels. My notifications are already overloaded with channels, making it near unusable, so I rely on the youtube algorithm to show me videos Im interested in based on how much I watch the channels. ...and regarding fine tuning mlx, unsloth, and finally axolotl :-)
thanks. actually every thumbnail i have made in nearly 2 years has used AI generated imagery that I then tweak. But I updated it to use my face. Then ran the A/B test with the new one and old one. Within an hour it was saying 65% of views were coming from the thumb with my pic in it.
@@technovangelist Oh :-) Well, Im no content creator, so I guess I should leave it up to you since you have the data of what works. In any case, you have really good stuff on your channel :-)
MLX, please but looks like you already covered it in ua-cam.com/video/3UQ7GY9hNwk/v-deo.html ? :) Anyway, thank you for this excellent video, you have very well explained what fine-tuning is and the difference with RAG.
actually, MLX is the only one I have covered, but I plan to do it again with updates. And none of the coverage on the other tools have been that good I think. But MLX seems to be the winner so far
Let's have an MLX!
Great tutorial. Really appreciate your teaching style. Unsloth is what I am researching right now.
Thank you for the excellent video. Exactly what I need. Can you please start with MLX?
Like always, awesome stuff. I vote for MLX but do want to see all of them. Excited and thanks for producing these.
Great !!! Macbook Silicon user here. Can't wait (but not holding my breath) :)
Great introduction!
I would like to see unsloth first
definitely interested in MLX since I'm all apple silicon
I'd love to see more information on MLX and maybe you could cover also using Ollama with languages other than English.
Great video again Matt !!! Knowing the difference to not make mistake on when to choose Fine Tunnng over RAG really deserves a long video like this one.
I prefer MLX since I have a mac
Also importan… please plan a video to know different hardware setups to train, and to use to use local models for inference on a home lab environment, how to use very large models like llama 3.3 70B in a homelab, pros and cons
Thanks again
Unsloth tutorial for start, then the others
Thanks for share your knowledge
Well done!
Really great tips for fine tuning
I'm looking forward to the next episodes
Another great video full of info, I wish I’d known when I first started messing with AI models. Thank you!
Clear and concise introduction on fine tuning LLM, great video as always!
Excellent tutorial! Thanks Matt!
Such an excellent channel. Always appreciate your content!
Nice video. One of the best in this field
Love your use of analogies!
Awesome, soo keen to follow along! Thanks Matt. I’m going to try them all but wouldn’t mind starting with MLX first
Fantastic explanation! 😊
As a case study I want to learn a little about training a model from scratch!
I hope to see it soon!
Thanks. I was misunderstanding fine tuning text models. But what about fine tuning a text and vision model. Could you tune it to recognize images it wasnt trained on?
Thanks Matt for this great introduction. As an M1 Max user I'll be looking forward to learning using that.
Interesting! I wonder if its possible to train my long system prompt into the model itself.
Grwat video! I was really looking forward to you explaining finetuning in regards to Ollama! I'd vot either one method, as long as it's done all locally (no online service, and oviously Lora and Qlora oriented) and can be done on windows!
@Matt as always super useful. I am down for the MLX fine-tuning first. I became a member from your channel today. Keep doing this high quality content and helping us to navigate Ollama and Llama models potential. 🦾🦾🦾
This video is gold.
Great Video!! I would love to see a video on training with TextGen WebUI. It supports Lora and QLora and with the Training_Pro ext. it has dozens of setting including some experimental ones, it also has a built in training//loss graph so you can track your progress. best of all it supports Multple GPU's so you can train bigger models locally. The problem is it lacks good documentation so I dont know what half of the options do. I would be cool to see you cover them.
Excellent as always!!! Thanks again
can't wait, you are the best!
Great!
maybe we need playlist to cover all details about fine tunning...
I know its not on the list but I would also love to see how to finetune with Autotrainer, Trl, and Peft with HF :) thank you for this amazing video!
i am SUPER excited for axolotyl tho!
@@BORCHLEO keep in mind that axolotl wraps TRL and PEFT, so the same info should apply to both..
@@AdamBrusselback sweet!
Hello great teacher, unsloth would be best for me. Thanks
You are a great instructor!
If you can start with MLX that would be amazing!
Thank you. Unsloth, please.
I am interested in creating better training data. Perhaps explore how generating synthetic training data works.
Thanks, I found this video helpful. I am interested in tuning a vision model usable through ollama for Lego identification. I am not sure any of the models actually know the Lego part numbers, so I suspect I need to train a model also. One goal is tell me what this Lego part numbers is.
Great videos I like your content. Can you review fine tuning an image model? I am thinking llama-3.2-11B the use case I have been considering is to fine tune it to better recognize a person's hand writing style to more accurately convert written documents to text as part of a pipeline to then have another fine tuned model read those text notes and write a short report on them. Just a thought. Thanks!
Nice didactic video. Would love to see mlx first
You're the best! BTW MLX please.
is there any cloud free fine tune services guys?
Fine tuning and RAG with MLX, please.
Unsloth please
Unsloth or mlx
[lease do more videos about this
Please turn off that UA-cam translation thing. On German it’s horrible. But thanks for the video
Great content. The sound quality is pretty bad. Thought I’d let you for next time
tell me more about your setup. Would love to know what your setup is like where it sounds bad. Tested this one on lots of devices and sounds great.
@ iPhone 16 pro max. Pretty sure it’s not my device. I tested it with multiple videos to make sure that it’s not my phone right before posting the comment above
Sorry to pester but can you define bad? I can’t hear anything wrong
@ no worries. It’s probably just on my end.
Da Capo
MLX 🥰
So... What if i need to teach him new information? 🥶
Mlx
MLX
@technovangelist Hey man, love your content. Please dont put race cars and cool images as thumbnails, its better if we can see a picture of you, so we quickly can spot that its you who put out a new video and its time to tune in.
With ai generated thumbnails, you kind of blend in with all other channels.
My notifications are already overloaded with channels, making it near unusable, so I rely on the youtube algorithm to show me videos Im interested in based on how much I watch the channels.
...and regarding fine tuning mlx, unsloth, and finally axolotl :-)
thanks. actually every thumbnail i have made in nearly 2 years has used AI generated imagery that I then tweak. But I updated it to use my face. Then ran the A/B test with the new one and old one. Within an hour it was saying 65% of views were coming from the thumb with my pic in it.
@@technovangelist Oh :-) Well, Im no content creator, so I guess I should leave it up to you since you have the data of what works. In any case, you have really good stuff on your channel :-)
thanks for mentioning it. its made a great difference on the view counts
Mlx first 🎉
MLX please!!!
MLX please
first MLX or riot!
MLX, please
MLX, please but looks like you already covered it in ua-cam.com/video/3UQ7GY9hNwk/v-deo.html ? :) Anyway, thank you for this excellent video, you have very well explained what fine-tuning is and the difference with RAG.
MLX, the others have already been covered.
actually, MLX is the only one I have covered, but I plan to do it again with updates. And none of the coverage on the other tools have been that good I think. But MLX seems to be the winner so far
Others covered by other youtubers. MLX not much. Probably a good niche.@@technovangelist
let’s have MLX first.
Axolotl get my vote for the first method . Thanks Matt
Axolotl Open-Source tool, I will vote for this.
Ai Spanish 🙏
apparently the ai subs and dubs are terrible, so they are off
Axolotl AI (smash the like button to this comment)
Unsloth please
MLX, please
MLX is posted