I get a ton of hallucinations using basic RAG with this. Pretty much unusable if I can’t figure out how to reduce them. I’m sure a lot of it is due to the 8B version of Llama 3.1.
Are there any selfhosted interfaces which I can use as a central UI for multiple different LLM Providers? In this Application it seems that you have to manually swap the Provider.
It's open source and free, you can run it on your own computer. We offer a fully managed version on Elestio starting at $10/month (vary based on provider/region/size you select)
The installation on Elestio was very easy to follow. Elestio has servers in the EU, which is important from a GDPR standpoint.
Say there was a rather large file server with many word documents, excel files, PDFs, etc. would it be possible to index/embed it ?
I get a ton of hallucinations using basic RAG with this. Pretty much unusable if I can’t figure out how to reduce them. I’m sure a lot of it is due to the 8B version of Llama 3.1.
Thnaks
Just wanted to comment on the amazing work on this channel. Lots of interesting stuff, thank you!!!
Thanks....great work
Thanks
Are there any selfhosted interfaces which I can use as a central UI for multiple different LLM Providers?
In this Application it seems that you have to manually swap the Provider.
real cost?
It's open source and free, you can run it on your own computer. We offer a fully managed version on Elestio starting at $10/month (vary based on provider/region/size you select)