LLM Fine-Tuning is one of the go-to techniques for making LLMs perform better in specific scenarios. In this post I'll show you how to prepare a local Windows-based machine with an Nvidia GPU to serve as a development-scale fine-tuning workstation.
This video is based on my blog post you can find here:
robkerr.ai/fine-tuning-llms-using-a-local-gpu-on-windows/
0:00 Intro
2:33 Install WSL
6:01 Install g++
6:30 Install Miniconda
8:02 Install VS Code
9:35 Create Python Environment
10:15 Install Unsloth Components
14:15 Create Training Notebook
15:20 Fine-tune the model
16:48 Save the Adapter
17:18 Summary