- 121
- 167 956
Ambarish Ganguly Academy
India
Приєднався 7 гру 2008
This channel will feature videos on Data, AI, and Cloud
The first mega course is on Intro to Deep Learning, Docker, Kubernetes, Azure Container Instances, and Azure Kubernetes Service.
The first mega course is on Intro to Deep Learning, Docker, Kubernetes, Azure Container Instances, and Azure Kubernetes Service.
Secure your Azure Open AI resource with Azure Private Endpoints
Secure Azure OpenAI resource with Private Endpoint
Demonstration with the following scenarios:
📍Acessing Azure OpenAI resource with Private Endpoint from a machine across the Internet
📍Acessing Azure OpenAI resource Without a Private Endpoint from a machine across the Internet
📍Acessing Azure OpenAI resource with Private Endpoint from a VM in Azure in the same VNET
Code : github.com/ambarishg/AZURE-AI-QA-PRIVATE-ENDPOINT
#azureai #azureopenai #security #privateendpoint #azureopenaisecurity
Demonstration with the following scenarios:
📍Acessing Azure OpenAI resource with Private Endpoint from a machine across the Internet
📍Acessing Azure OpenAI resource Without a Private Endpoint from a machine across the Internet
📍Acessing Azure OpenAI resource with Private Endpoint from a VM in Azure in the same VNET
Code : github.com/ambarishg/AZURE-AI-QA-PRIVATE-ENDPOINT
#azureai #azureopenai #security #privateendpoint #azureopenaisecurity
Переглядів: 1 528
Відео
Sentence Window Retriever and Semantic Ranking compared
Переглядів 6009 місяців тому
We discuss in detail about the Sentence Window Retriever [ an advanced RAG technique ]. We compare the performance with a naive RAG and a RAG with semantic ranking. Please watch till the end for some fascinating insights. For details about the working of the semantic ranker, please also watch the video [ ua-cam.com/video/fzGSSjFf9og/v-deo.html ] Code : github.com/ambarishg/sentence-llama-index ...
End to End Project on RAG with Evaluation Metrics
Переглядів 1,1 тис.10 місяців тому
Discover the power of End-to-End RAG implementation integrating Qdrant and Azure OpenAI for advanced evaluation metrics. Our comprehensive solution harnesses the RAG triad, encompassing context relevance, groundedness, and answer relevance, ensuring robust assessment and mitigating free-form hallucination in LLM apps. Delve into detailed explanations and hands-on demonstrations, including build...
RAG with LlamaIndex - Qdrant and Azure OpenAI in 9 minutes
Переглядів 1,9 тис.10 місяців тому
RAG [ Retrieval Augmented Generation ] with 📍 Llamaindex 📍 Azure AI 📍 QDRANT 📍 GPT3.5 Turbo 📍 FastEmbeddings from Qdrant #RAG #Llamaindex #AzureAI #QDRANT #GPT3.5 #FastEmbeddings Code : [github.com/ambarishg/llama-index]
Multimodal Search [ Image and Text ] using Azure AI Search and Azure Computer Vision
Переглядів 2,3 тис.11 місяців тому
Multimodal Search using Azure AI Search and Azure Vision 📍Image Similarity Search using Azure Computer Vision 📍Multimodal Similarity Search using Azure Computer Vision 📍Image Similarity Search using Azure Computer Vision and Azure AI Search [ Vector Search ] 📍Multimodal Similarity Search using Azure Computer Vision and Azure AI Search [ Vector Search ] Code : github.com/ambarishg/AzureAI-ImageS...
Semantic Reranker for better Search Results in 10 minutes
Переглядів 1 тис.11 місяців тому
Unlock the potential of Semantic Reranker in your search systems. Discover why it's crucial, its key components, and detailed steps for implementation. Witness a live demonstration enriched with code examples for a deeper understanding. Dive into our Semantic Reranker GitHub repository: github.com/ambarishg/SemanticRanker Enhance your comprehension with our instructional video on embeddings and...
Agents [ Langchain] with Math Calculation Tools,SQL database, Azure AI Vector Search in 17 mins
Переглядів 1,6 тис.11 місяців тому
Langchain agents using Mathematical Tools , SQL Agent and Vector Search Agent 📍What is a Agent 📍Steps in a Agent 📍Details - Tools in a Agent 📍Details - Create the Prompt in a Agent 📍Simple Example - Add Numbers Agent / Multiply Numbers Agent 📍Simple Example - Agent interacting with a Relational Database 📍Composite Example - Combining Numbers and SQL Agent 📍Agent with a Vector Database [ Azure A...
RAG With Azure AI Search using Vector/ Hybrid / Exhaustive KNN / Semantic Reranker in 15 minutes
Переглядів 7 тис.11 місяців тому
RAG with Azure AI Search with Azure OpenAI with different search techniques and Langchain with Conversation Chain, Prompt Template and Conversation Buffer 📍 Vector Search 📍 Hybrid Search 📍 Exhaustive KNN Search 📍 Hybrid Search with Semantic reranking 📍 RAG with Azure AI Search with Azure OpenAI 📍 Use Langchain with Conversation Chain 📍 Use Langchain with Prompt Template 📍 Use Langchain with Con...
Vector , Hybrid, Semantic search with Azure AI Search in 11 minutes
Переглядів 14 тис.Рік тому
Vector , Hybrid, Semantic search with Azure AI in 11 minutes 📍 Azure AI Vector Search explained 📍 Azure AI Vector Search with HNSW and KNN explained 📍 Azure AI Hybrid Search 📍 Azure AI Semantic Hybrid Search #azureai #azureaisearch #vectorsearch #hybridsearch #semanticsearch #rag #retrievalaugmentedgeneration #azureaisearch Code : github.com/ambarishg/AZURE-AI-VECTOR-SEARCH
RAG [ Retrieval-Augmented Generation ] with AWS Bedrock and Qdrant in 8 minutes
Переглядів 1,3 тис.Рік тому
📍 RAG [ Retrieval-Augmented Generation ] concept explained 📍 Detailed use of AWS Bedrock and Vector Database QDRANT in RAG 📍 Demo of our built in RAG application #llm #bedrock #aws #datascience #qdrant #rag Code: github.com/ambarishg/AWS-BEDROCK-EXPTS [Embedding and Cosine Similarity Video](ua-cam.com/video/c6f6wcmm3fY/v-deo.html)
PHI2 Small LLM [ Simple Example and RAG Example ] in 8 minutes
Переглядів 2,1 тис.Рік тому
📍 PHI2 model - A small LLM compared to LLama2 sizes 📍 Limitations of the model 📍 How was the PHI2 model trained? 📍 PHI2 model used in a simple example 📍 PHI2 model used in a RAG architecture using QDRANT Code - github.com/ambarishg/opensource-rag/tree/main/rag-qdrant-phi2 Playlist provided is [ua-cam.com/play/PL3mYo8cDslVVNnNCZOnnDqHlI7nLDotnW.html]
RAG with Qdrant and Mistral in 6 minutes
Переглядів 2,3 тис.Рік тому
RAG with Opensource Tools - Qdrant and Mistral in 6 minutes ✅ Complete Open Source Stack for Retrieval-Augmented Generation (RAG) with QDRANT and MISTRAL ✅ RAG [Retrieval-Augmented Generation] ingestion into QDRANT ✅ RAG [Retrieval-Augmented Generation] search with QDRANT and MISTRAL Code : github.com/ambarishg/opensource-rag Other relevant videos: 03 - Neural Search with Qdrant [ Vector Databa...
RAG with Azure AI Search and Azure Open AI in 9 minutes
Переглядів 35 тис.Рік тому
RAG [ Retrieval-Augmented Generation ] concept explained 📍 How we do we ingest data into our RAG architecture? 📍 How we do we query from our RAG architecture? 📍 Detailed use of Azure AI Search and Azure OpenAI in RAG 📍 Demo of our built in RAG application Code: github.com/ambarishg/AZURE-AI-SEARCH Playlist provided is [ua-cam.com/play/PL3mYo8cDslVVNnNCZOnnDqHlI7nLDotnW.html]
04 - Llama2 7B Contextual Question and Answering in LOCAL Machine in 3 minutes
Переглядів 707Рік тому
Llama2 7B Contextual Question and Answering in LOCAL Machine uses #llama2 , #ggml and local machines #opensource #generativeai #llama2 #llm #llmcourse Github: github.com/ambarishg/open-source-llms/tree/main/llama2 Playlist provided is [ua-cam.com/play/PL3mYo8cDslVVNnNCZOnnDqHlI7nLDotnW.html]
Google File System Paper Simplified
Переглядів 352Рік тому
Google File System Paper simplified ✅ Overview ✅ Design Principles ✅ Architecture ✅ Single Master ✅ Read ✅ Write #distributedsystems #googlefilesystem
02 - Azure AI Service winning me the Azure Hackathons and Blogathons [ Surprise Inside ! ]
Переглядів 168Рік тому
02 - Azure AI Service winning me the Azure Hackathons and Blogathons [ Surprise Inside ! ]
01 - Defending AI: Strategies for Securing Your Azure AI Services[ AI 102 ]
Переглядів 199Рік тому
01 - Defending AI: Strategies for Securing Your Azure AI Services[ AI 102 ]
03 - Neural Search with Qdrant [ Vector Database ]
Переглядів 1,1 тис.Рік тому
03 - Neural Search with Qdrant [ Vector Database ]
02 - Embeddings and Cosine Similarity
Переглядів 2,3 тис.Рік тому
02 - Embeddings and Cosine Similarity
01 - Question Answering System Very Simple using Azure Open AI
Переглядів 2,9 тис.Рік тому
01 - Question Answering System Very Simple using Azure Open AI
02 - Decorators, Enumerators and Zip in 6 mins
Переглядів 682 роки тому
02 - Decorators, Enumerators and Zip in 6 mins
08 - Joins , Null Values and Built In Functions [ Apache Spark Databricks Cert] in 5 minutes
Переглядів 1152 роки тому
08 - Joins , Null Values and Built In Functions [ Apache Spark Databricks Cert] in 5 minutes
01 -Functions And Classes [ Python ] in 10 minutes
Переглядів 1482 роки тому
01 -Functions And Classes [ Python ] in 10 minutes
07- DateTimes And ComplexTypes[ Apache Spark Databricks Certification ] in 10 minutes
Переглядів 752 роки тому
07- DateTimes And ComplexTypes[ Apache Spark Databricks Certification ] in 10 minutes
06 - Aggregations [ Apache Spark Databricks ] in 5 minutes
Переглядів 2422 роки тому
06 - Aggregations [ Apache Spark Databricks ] in 5 minutes
05 - DataFrame And Column [ Apache Spark Databricks ] in 9 minutes
Переглядів 782 роки тому
05 - DataFrame And Column [ Apache Spark Databricks ] in 9 minutes
Partitions [ Distributed Systems ] in 12 minutes
Переглядів 6262 роки тому
Partitions [ Distributed Systems ] in 12 minutes
04 - Reader and Writer in Apache Spark [ Databricks ] in 8 minutes
Переглядів 1662 роки тому
04 - Reader and Writer in Apache Spark [ Databricks ] in 8 minutes
Hola, quisiera saber si al momento de recuperar esa información o base de conocimiento de los blobs, esos archivos tambien consumen tokens junto con la prompt?
which method will be better? also need a an idea on comparing with auto merging retrieval.
no code in github
Very good explanation! Thank you!
the way explanation was awesome
Glad you found it helpful
I will try to rag by my single pdf please help , i am using thr blog storage for upload the file and after that i get the files from blob and extract text after i take azure openai model text embedded ada 002 for embedding all the extract the text which i get from pdf after that 12 embedding is create now i want to azure ai search can you tell me how we can do using python code , I will try to upload the documents by combining text chunk and embedding after i upload in indexes but only goes last file so please help me related the correct way
Thank you sir
Welcome
Super Fantastic demo sir, the way you articulated the information is just Awesome, happy to share in learning community. Thanks !!
So nice of you
thanks, 9 months and still very informative.
You're welcome!
Could you make a video on how can we reference the documents on the answers? I mean, showing which documents where found and used to generate a response
This video is really informative and well-structured. Understanding vector and hybrid search in such a short time is impressive. I recently came across Myko Assistant, and it's helped me find detailed professional profiles quickly without the complexity of other tools. It’s great for getting accurate info efficiently.
Really great video thanks so much for taking the time ❤
Awesome content. Here is the question -- can we upload the confluence page url and get the results from same origin.
Very nice explanation. Short & easy to understand. It helped me understanding how AI search works.
Nice session.. Can we boot up that vector - qardent db in windows 10 - os environment with docker sw ? Can we connect qardent - docker service with paython code in locally setting up ?
So here we need 3 services, right? azure openai, azure ai search and azure blob storage?
Great explanation and simple . Good that you focused on search without the hurdles of CosmosDB
Hey, this was helpful! :)
Thanks...this simplified langchain. but code is not in the shared github link.
Thanks for the comment. I have updated the GITHUB code link in the video.
This is perfect sir, you are already ahead of industry implementation era.. great stuff..
I have created an index for a CSV file and i had few custom fields and also i have enabled Semantic reranker for the AI Search. Now i want to use this in my code but unable to get any fruitfl results. Can you please help ? And I am using Langchain as orchestrator
Excel doesn't work well I believe
Very informative.
1:01 Is Azure search is or acts like a vector database that keeps the knowledge? Please clarify I have seen several videos but confused on this question.
You didn't use vector database in this specific video (use case) to check data into vectors?
Please watch the following for VECTORS 1. ua-cam.com/video/BOPVh-0NM8U/v-deo.html - Vector , Hybrid, Semantic search with Azure AI Search in 11 minutes 2. ua-cam.com/video/qJl3IdCKfvE/v-deo.html -RAG With Azure AI Search using Vector/ Hybrid / Exhaustive KNN / Semantic Reranker in 15 minutes
thanks for the info, great explanation
Thanks for such a detailed content. Is the uploaded data going to private ? will that data be trained with open source LLM's . How to add extra layer of security to make sure that the uploaded data is within my private GPT
Do we not require any embeddings and vector database here? Also, is vector search not required? If so when is it required? Thank you
can you do one between llama-index and azure ai search?
Thank you for this lovely video. I am interested in how you created those indexes within Azure AI Search. What if I have data in json format?
Thanks for the video!
hey in the section of env where could i find the index name of the ai search
index = "<SEARCH SERVICE INDEX NAME>" This is in github.com/ambarishg/AZURE-AI-SEARCH/blob/main/.env.sample
Does this work with files with size large than 16mb?
below is my vector store creation code without using RBAC but if i want to use RBAC what should i have to change in below code vector_store: AzureSearch = AzureSearch( azure_search_endpoint=os.environ.get("SEARCH_ENDPOINT"), azure_search_key=os.environ.get("SEARCH_API_KEY"), index_name=index_name, embedding_function=embeddings.embed_query, )
Really nice stuff to start with.. than you
Is it acceptable to perform all these tasks directly from the portal, using the no-code option?
Useful stuff. Thanks for the video!!
Do you mind sharing the repo for this talk ?
github.com/ambarishg/AZURE-AI-VECTOR-SEARCH
Do you know how can we retrieve access token from AWS secret manager instead putting it in profile.yml ?
When I do Vector/Hybrid search, the content that is returned are just references. I want it to answer the question also. Am I doing something wrong?
Awesome tutorial Ambarish. Keep up the good work.
A quick question....Using a single project ....can we write tables in different catalogs in databricks? I see that catalog is defined at a project level and wondering if we can use different catalogs for a single project
It's really helpful. I'm facing a problem local image in accessible through localhost, but pods are not accessible through local host. does the port need to be same a local image?
Hi Sir any tutorial for recommendation service using azure search
Love that you were recording the video just a few minutes before a new year😅
no personal life
Can you do data drift for LLmops on azure
thank you so much for this. this sis very helpful. am gonna modify this a little in order to add to my portfolio. big thanks again , sir.
Glad it was helpful!
@@ambarishg 💚🙏
Hi bro please respond
Connect me on LinkedIn
i dont know weather it is right to ask or not ,can you please tell keys in microsoft azure about this project for my final year project
i wanted to know that give text and images as input for this project at a time please help me me also doing similar project in jupyter notebook,but we are unable give new images as input only predefined images it takes. can you help me more
bro how can i contact you bro for this project more details