I created the ULTIMATE Ollama UI with Streamlit

In this tutorial, we'll build a full-fledged Streamlit app user interface to interact with our local model using Ollama! I chose Streamlit because it is easy to get started and very composable.
Before starting, download [Ollama](ollama.com/) on your local machine.
Enjoy, and please leave your feedback in the comments!
TIMESTAMPS:
============
0:00 - Introduction
0:47 - Preface
1:44 - Code directory walkthrough
6:52 - Streamlit chat UI for Ollama code
15:59 - Streamlit multimodal UI for Ollama code
26:36 - Streamlit UI for Ollama model management
31:34 - Streamlit Ollama UI app demo
42:56 - How to clone and implement the code
44:52 - RAG app update
45:22 - Conclusion and outro
LINKS:
=====
🔗 GitHub repo:
github.com/tonykipkemboi/olla...
Follow me on socials:
=================
/ tonykipkemboi
/ tonykipkemboi
#ollama #streamlit #machinelearning #ai #llm #llava #multimodal #settings

[@user-ed2wf6wr5g]

I am starting to think that youtube algorithm now read minds with this video suggestion 🤔

[@tonykipkemboi]

😂 well, that's awesome 🙌

[@aussie-elders]

UA-cam algorithm worked well for me :D

[@aussie-elders]

This makes using offline models so much easier having a UI interface like this, would be amazing to see some kind of PDF uploader that can learn from your documents... AI is moving so fast so I suspect there will be an easy one stop solution soon for all the non-coders out there. Great work on the video!

[@tonykipkemboi]

Thank you and I agree with you. I will be working on a RAG one soon. There's just many edge cases for each file type.

[@aussie-elders]

@@tonykipkemboi that would be excellent thanks, PDF can have so many different formatting's but I think just start with simple text based only PDFs

[@michaelwheeler5637]

great demo, never used streamlit before, as long term flask user thanks for a first intro into streamlit library,great job well presented

[@tonykipkemboi]

Thank you!🙏 It's awesome, check it out and let me know know.

[@TokyoNeko8]

Just early feedback, it worked like a charm without any issues. You may want to show people conda and give them some sample connects in git as an extra add-on so they don't mess up their env
Will take a look and I may want to modify this because it's a nice UI to learn on

[@tonykipkemboi]

Thank you! Awesome feedback. I will keep that in mind for the next ones.

[@TokyoNeko8]

I am going to learn how to get verbose stats like inference speed added to the display just to play around with the code

[@pierre-louis4519]

Hey Tony !
There you go, you have a new fan.
Thanks a lot for sharing all of this content.

[@tonykipkemboi]

Awesome, thank you! 😊

[@giorgossynetos9723]

excellent! possibly in future video to expect a combined version of this and your previous video with local pdf?

[@tonykipkemboi]

Yes, I'll be doing a RAG specific app.

[@firetownplatformfinders3996]

I feel like you just gave me and everyone a gift...awesome video this

[@tonykipkemboi]

🙏 😊

[@jim02377]

Great job! I like your code review style instead of code writing.

[@tonykipkemboi]

Thank you! I find it much better explaining how it works rather than doing live coding since most of them time I've done it prior to the recording. There's only a few cases that I prefer more interactive live coding.

[@guanjwcn]

Good one ❤

[@tonykipkemboi]

Thank you so much 😀

[@aruns5705]

Good one 👍

[@tonykipkemboi]

Thank you 🙏

[@guanjwcn]

Looking forward to your RAG one. Hope you can put in memory management too. ❤

[@tonykipkemboi]

Good idea! Yes, I'll add that to the list. Thank you for the feedback.

[@JayLee-gv8tv]

man, good job. that is what i want. i hope you to add RAG(URL/PDF) integrating in this Demo. change st.switch_page grammar for new streamlit doc

[@tonykipkemboi]

Cool! I don't think I quite understood what you mentioned about `st.switch_page`; do you need me to use `st.switch_page` to do something particular in the demo app?

[@JayLee-gv8tv]

@@tonykipkemboi if st.button("Go to settings to download a model"):
st.switch_page("pages/03_⚙_Settings.py")

[@techthunder4832]

will it work for pdfs ,that too specifically for text based (actually there are 2 types of pdfs , 1)text base 2) image based

[@tonykipkemboi]

So I haven't implemented the RAG portion of the app but if you're reffering to using `llava/bakllava` for this, then it will work for the image PDFs for sure but accuracy is not guaranteed. You have to remember to convert the PDFs to images, .png for it to work.

[@thebudaxcorporate9763]

is it support with another languange?

[@tonykipkemboi]

The app itself?

[@user-wr4yl7tx3w]

Agree. Live coding is unnecessary. Better with your method.

[@tonykipkemboi]

Thank you. Glad you share the same sentiment ❤

[@FloodGold]

I appreciate the video, but emojis don't make anything cool, haha

[@tonykipkemboi]

Thanks! Yes, very dependent on the person I'd say. I happen to prefer them on my Streamlit apps but can also be taken out easily.

[@FloodGold]

Yes, of course I was joking. The overuse is really the issue.

[@tonykipkemboi]

Good point. I get too carried away with the emoji's especially if it is an app am building to use locally 😅