Build a scalable Chat Application with Azure Cosmos DB and Kubernetes Service - June 2024

In this session, you'll learn how to build a scalable chat application utilizing Azure Cosmos DB and Azure Kubernetes Service (AKS). We'll set up Azure Cosmos DB for MongoDB for logging chat history and Azure File Storage for storing weights of our language model. Then, we'll deploy the Hugging Face Text Generation Inference (TGI) and Chat UI as individual services on AKS. We'll also configure Nginx Ingress Controller for TLS termination to ensure secure communication. By the end, we'll have a fully functional chat application running on Azure infrastructure
#azurecosmosdb #ai #mongodb
Useful links:
• Azure Cosmos DB for MongoDB vCore documentation
- learn.microsof...
• Use vector search on embeddings in Azure Cosmos DB for MongoDB vCore
- learn.microsof...
• Subscribe to this channel - aka.ms/AzureCo...
• Check out past meetups on UA-cam to catch anything you might have missed - • Global User Group Meetups
• Want to present at a future meetup? Fill out our intake form - aka.ms/AzureCo...
• Try Azure Cosmos DB Free - aka.ms/trycosm...
• Microsoft Reactor - aka.ms/Reactor
• Build a custom Chatbot using Hugging Face Chat UI and Cosmos DB on Azure Kubernetes Service
- / build-a-custom-chatbot...
Speaker: Shahzeb Naveed
Bio: Shahzeb Naveed is an experienced data science professional with over 4 years of industry experience across the automotive, telecom, banking, and CPG sectors. He specializes in data science, generative AI, and cloud technologies and currently serves as a Machine Learning Engineer at General Motors Canada.