Getting started with Llama 3.2 and Web UI

[@PhongGT]

thanks for watching, hope this helps

[@DihelsonMendonca]

Your video seems accelerated. Please don't rush on dense videos. There are a ton of information here. 🙏👍

[@PhongGT]

thanks for the feedback
anything specific I should expand on? my plan was to do follow-up videos

[@DihelsonMendonca]

@@PhongGT Open WebUI is having it's biggest hype ever. It's a fantastic frontend. If I had a channel like yours, I would make a series of tutorials covering from docker installation, to Ollama install, to Open WebUI itself, carefully and detailed. Just my suggestion. 🙏👍❤️

[@jayakrishnanazhakath6587]

Really helpful info

[@PhongGT]

thanks, hope you were able to set everything up

[@NemoEUC]

I got it to work thank you but for some reason the upload files isnt detecting any of the documents im throwing at it

[@PhongGT]

hm that's weird, most likely is an open webui issue, they handle the upload and retrieval, so maybe it doesn't have permissions to store the files somewhere?

[@nosuchthing8]

Is 16gb vram enough to experiment with?

[@PhongGT]

yeah, experimenting with even 8gb is fine but heavy load you want 16gb or use the smaller or quantized models

[@FrancescoGruner]

and 11B and 90B?

[@PhongGT]

you can use the UI or the command line to pull those and it will show up in web ui

[@Ai_mayyit]

how we start after the close

[@PhongGT]

what do you mean after the close?

[@Ai_mayyit]

@@PhongGT i mean after restart the laptop

[@PhongGT]

@@Ai_mayyit oh, for open webui, since it's in a docker container, it should start up with your system
for ollama, there should be a setting too also start with your system if you installed their full app (not the brew method)

[@Ai_mayyit]

@@PhongGT thanks man i just complete the order on fiverr with this tutorial for 200$