Build a scalable Chat Application with Azure Cosmos DB and Kubernetes Service

In this session, you’ll learn how to build a scalable chat application utilizing Azure Cosmos DB and Azure Kubernetes Service (AKS). We’ll set up Azure Cosmos DB for MongoDB for logging chat history and Azure File Storage for storing weights of our language model. Then, we’ll deploy the Hugging Face Text Generation Inference (TGI) and Chat UI as individual services on AKS. We’ll also configure Nginx Ingress Controller for TLS termination to ensure secure communication. By the end, we’ll have a fully functional chat application running on Azure infrastructure

#azurecosmosdb #ai #mongodb

Useful links:
• Azure Cosmos DB for MongoDB vCore documentation
– https://learn.microsoft.com/azure/cosmos-db/mongodb/vcore
• Use vector search on embeddings in Azure Cosmos DB for MongoDB vCore
– https://learn.microsoft.com/azure/cosmos-db/mongodb/vcore/vector-search
• Subscribe to this channel – https://aka.ms/AzureCosmosDBYouTube
• Check out past meetups on YouTube to catch anything you might have missed – https://www.youtube.com/playlist?list=PLmamF3YkHLoJSJ1qdHDXXSlmkj2HKz-nb
• Want to present at a future meetup? Fill out our intake form – https://aka.ms/AzureCosmosDB/UserGroupSubmission
• Try Azure Cosmos DB Free – https://aka.ms/trycosmosdb
• Microsoft Reactor – https://aka.ms/Reactor
• Build a custom Chatbot using Hugging Face Chat UI and Cosmos DB on Azure Kubernetes Service
– https://medium.com/thedeephub/build-a-custom-chatbot-using-hugging-face-chat-ui-and-cosmos-db-on-azure-kubernetes-service-0e391c00cd78

Speaker: Shahzeb Naveed
Bio: Shahzeb Naveed is an experienced data science professional with over 4 years of industry experience across the automotive, telecom, banking, and CPG sectors. He specializes in data science, generative AI, and cloud technologies and currently serves as a Machine Learning Engineer at General Motors Canada.