Containerizing LLM-Powered Apps: Part 1 of the Chatbot Deployment
Вставка
- Опубліковано 21 сер 2024
- Welcome to Part 1 of our series on "Containerizing LLM-Powered Apps"! Learn how to containerize your app using Docker, enabling seamless deployment across any environment. Follow along as we guide you through Dockerfile creation, image building, local container execution, and pushing to Azure Container Registry (ACR). Don't miss out on this practical tutorial for developers and enthusiasts alike. Stay tuned for Part 2 for deploying to Azure Container Instances. Like, subscribe, and hit the bell for updates! Happy containerizing!
Docker Install: docs.docker.co...
Dockerfile in this video: github.com/AIA...
GitHub Repo: github.com/AIA...
LLM Playlist: • Large Language Models
ACR: azure.microsof...
#generativeai #llm #docker
Your UA-cam channel is better than any other AI channel I have seen - THANK YOU!
Thanks for the lovely words. Pls keep supporting 🙏
best channel for LLM
Thank you so much. Plz watch my videos in the LLM playlist.
Bro I love your content, I learned LLM from you completely
Thank you! Great content.
Glad you liked it!
Thank. Nice Video
Thanks to you
Hey, Why did you use Container Instance instead of a virtual machine?
Your channel is going to grow like hell bro keep it up good work .. btw can you suggest any course or tutorial to learn about creating models and using hugging face model …
Hi, thanks for your comment. I will recommend you to go through Generative AI courses by Google: www.coursera.org/learn/introduction-to-generative-ai?B2C_INDIA_google-it-automation_FTCOF_professional-certificates_arte-re-PMAX_non-nrl_within_14D&B2C&campaignid=19197692871&adgroupid=&device=m&keyword=&matchtype=&network=x&devicemodel=&adpostion=&creativeid=&hide_mobile_promo&gclid=CjwKCAjwzo2mBhAUEiwAf7wjkjkp0RGH7DwBU7YyTpo1dgU4DgFLbedd8LWNH23KPfJusYaL-91ixRoCoiMQAvD_BwE
You can also watch my videos on LLMs once you are comfortable with Google courses on Gen AI.
Nice video ❤
Glad you liked it
Hi, I also builded one pdfchat application using llama2 7b model, but if I asked questions apart from context, model generating response even I restrict using custom prompt.
You have to write some custom functions for validation on your output. I am currently working on such video to put guardrails. Stay tuned.
@@AIAnytime is that video released?
Thank you! Is there any way that chainlit doesn't keep the previous questions? I used --no-cache while running chainlit but it didn't help
Brother ❤❤❤❤❤❤ lub you .....what a great channel i found 😢.......after 1 month working hard 0:57 /// brother please send me whole chat bot series of deployed !!!!!! With llms...and i cannot see your llms part 2 so on 1:42
iam running my container but it is not opening using the ip address iam getting but if i open it through docker desktop then my web application is opening on browser why it is so
very nice and thanks for your efforts
Thanks and welcome
Hi AI Anytime is this the most recent updated git repo, getting error while running it locally and also for accessing network url do we need to do anything
I need to keep adding multiple files to the vector db is that possible?
How to deploy the LLAMA 2 model s in azure?
why are you using sudo all the time?
Im surprised ur channel hasn't blown up. 5k subs sounds like bs, Sounds like they are limiting your reccomendations
Haha thanks for your comment... Don't know what's happening with the UA-cam recommendations engine 😇
It says " The site can't be reached" the URL took time after putting into docker and running it.
same error, was it resolved?
Was this resolved?
@AIAnytime any idea on this
Still waiting for azure openai tutorials😢
Hi Akshay, have applied for the access through my venture account. Let's wait for a few more days and I will have many project videos soon with Azure Open AI and Langchain.
ua-cam.com/video/xpp9CRjK6zs/v-deo.html Can you check this out.?