Thanks for watching! Should work with a 7b-model too if you have more VRAM, set the cuda to True in the training arguments, and keep the batch size lower. Hope it helps :)
Appreciate author's efforts but it is super hard to understand why the author is in such a rush ? Instead of recording the tutorial for public, looks like author is running a marathon! Not aiming to disrespect but providing my critique for any future tutorials. Thank you!
"Basically", I really liked this tutorial! Does this setting work with a larger model, say 7B?
Thanks for watching! Should work with a 7b-model too if you have more VRAM, set the cuda to True in the training arguments, and keep the batch size lower. Hope it helps :)
Appreciate author's efforts but it is super hard to understand why the author is in such a rush ? Instead of recording the tutorial for public, looks like author is running a marathon! Not aiming to disrespect but providing my critique for any future tutorials. Thank you!
Thank you very much for your feedback. I'll definitely keep this in mind for future tutorials :)