Hybrid Search RAG With Langchain And Pinecone Vector DB
Вставка
- Опубліковано 25 сер 2024
- Hybrid search typically refers to a search approach that combines multiple search methodologies or technologies to provide more comprehensive and accurate results. In the context of information retrieval, hybrid search often involves blending traditional keyword-based searching with more advanced techniques such as natural language processing (NLP), semantic search, and machine learning.
Check out my Udemy Courses
For these 4 days please find all my udemy courses in 399rs INR, check it out if you need it.
Complete Machine Learning,NLP Bootcamp MLOPS & Deployment: bit.ly/4fealDs
Complete Generative AI Course With Langchain and Huggingface: bit.ly/3WlxJqZ
Building Gen AI App 12+ Hands-on Projects with Gemini Pro: bit.ly/4f6APGX
![GenAI Financial Recommendation Engine | LLM + RAG ChromaDB [ Zypher 7B LLM ] Mistral LLM](/img/n.gif)
Wow! Just when I wanted to implement hybrid search in a RAG at work, you launch this video! 😃😍
00:02 Implementing Hybrid Search RAG with Langchain and Pinecone Vector DB
02:17 Converting text to vector and performing vector search
08:11 Hybrid search combines semantic and synthetic techniques
10:45 Documents are converted into sparse and dense vectors for storage in Vector DB.
15:19 Reciprocal rank Fusion in hybrid search
17:37 Calculating final score based on semantic search and keyword search.
22:02 Understanding the concept of hybrid search
24:06 Hybrid search supports keyword, semantic, and graph knowledge search
27:59 Initializing and creating Pinecone hybrid search retriever
30:06 Creating an index with Langchain and Pinecone Vector DB
34:06 Setting up hybrid search with Langchain and Pinecone Vector DB
36:06 Introduction to using HF token and Pinecone vector DB
40:24 Demo of adding text to Index and retrieving results
42:24 Hybrid search with Langchain and Pinecone Vector DB
man you are great just great i was in search of this technique and you just gave me something valuable
A lot of improvement in your teaching. Keep it up.
Krish please add some data visualization related stuff in the ml dl NLP course.
Why
Yes please
Course price -399. Value - Infinity.
Thank you for all your teachings Krish! You're amazing!
Your videos are the best!
Hi Krish, the content that you provide us is amazing and helpful for many who wanted to step into data science
I have a request for you to make a video on LLM based structured data analysis Q&A application
Amazing tutorials
Hell of Tutorial about Hybrid Search and Pinecone Vector Database
Thanks for the fantastic LLM projects...
Hi Krish,
>> You are awesome! I’m a Salesforce developer and didn’t know much about data science. I’ve unintentionally watched all your videos since UA-cam kept recommending them. I’ve learned a lot from you, both technically and in terms of your thought process.
>> Inspired by your content and research papers, I’ve started building a RAG multi-agent system from LangGraph for support systems (Salesforce, Google, etc.).
Can you guide me on fine-tuning data? Your videos on fine-tuning were helpful but not advanced enough for production-level design.
Small request: Could you start a channel for engineers to build production-level RAG systems and pipelines?
Cheers,
Hrsh
Welcome back to YT.. Can you please do some detailed sessions on Graph RAG ? Also for PineCone better to create index using code.
Thank you for the good work Krish
Thank you for this channel ❤
I am a big fan of you... watch all most of all videos here and also doing two courses from udemy...I have two specific requests
1. Could you please share the name of the software that you use for screen writing during the theory explanation
2. Could you please highlight how this hybrid search helps in a enterprise set up
It seems all respond are same in last , please do some research and figure out the issue, how to get precise answer
can you please make a video on modular rag and please make some industry grade projects related to gen ai , thank you so much sir for your wonderful contribution !!
hello krish sir i want to know what all courses should i take to job ready skills in industry from your udemy courses
I am loving these tutorials I would like to see you do in depth on using vllm as an api point for serving llm using azure kubernates cluster it would be soo useful to the community as we can then use quantized models of llama3 70b with very cheap gpu to help serve applications. I would be just amazing for the community then you can use that to help make agents with lang graph tutorials bro I would love it
Thank you for the amazing video krish. Can you please upload the video related to Neo4j database and graph search
Hi sir , great video and does give you a fundamental idea of hybrid search and PineconeDB . can you please provide the code or link to the colab notebook to have a practical run through . Thanks.
I would strongly request you to cover graph rag, because there's lot of positive buzz and high accuracy on it
too expensive and difficult to implement but maybe the coming months some new tech releases that makes it more usable. Also no implementation with existing AI frameworks.
You provide me full explications how to use Rag I feel proud of continue to learn your courses.
I had some issues, can we do a hybrid search using TiDB serverless ??
Krish, could you make a video on meta-data creation for filtering ? we could make a meta-data hierarchy of parent grandchildren but Im unsure which models to use.
amazing ,would be great if you can create same for pinecone + langchain with javascript !
What are the Usecases for hybrid Search Rag ? when to use semantic search and when to switch to hybrid ?
Hi Krish, Please start every project with creating the environment it is a huge problem sometimes if there's an error.
why is it simply listing the sentences provided and not returning say Paris when asked which city was recently visited?
Krish Sir Do Video about Hierarchical Tree-based Indexing of Multiple Textbook based RAG application
THANKS IT WORKS
sir can you please upload more video on finetuning LLM as mostly this skill is required in many companies , Even if you upload a course on udemy we' ll defiantly buy it as no other youtuber covered this topic nicely the way you are,
I have already seen your finetuning playlist , we want more please sir
Hi krish, I am following your content froom past 3 years but in the udemy courses I felt like the way o simplicity is missing. If possible please try to keep things simple as muh as you can. All your content is very good and relevant to the industry
What is the use of doing a syntatic search? Semantic search itself covers everything right?
Good morning 🙏🏻😎
hello krish sir i want to know what all courses should i take to job ready skills in industry from your udemy courses help me with this sir plsssss
Thank you! I needed this video 🙌 could you tell what tool you use to draw? i think it is a great way of learning and could help my students
Hlo sir
Could you share text summarisation with N-grams using deep learning back end code 😢
Please make one video using Neo4j or AWS Neptune, converting unstructured data like pdf, etc. to graph and then doing Graph RAG
Wonderful, can you please share the sample code that you used here. Thanks
Hi Krish! Excited to dive into this video. You are helping everyone to shift the mindset of developing and getting started with new AI stack! Your content is simply great with a proper crisp (like CRISP-DM in data mining space) explanation and hands-on approach. Also do look out about Weaviate (a new vector DB for building enterprise gen AI applications).
Sure
I don't think weaviate works on windows ?
are you able to do this on Langflow?
Make videos on Microsoft Copilot Studio
Please explain Agentic RAG Arch.
What is the accuracy and processing speed when comparing to traditional rag architecture wrt hybrid? cause to utilize this hybrid method, we need to use Pinecone which is a paid VectorDB unlike FAISS, ChromaDB. So we have to consider that aspect also whether its worth investing in this new method.
Can anyone help me, if same technique can be done on recommendation system, and I have large data, how I’m gonna proceed after adding it to retrieval. I mean large data can’t be sentences, where I can add it in retrieval separately…
sir can we do a similarity search on specific pincone index?
At last when you gave inputs like First, last , Recent.. Output was Same for all 3 inputs.
Can you explain on this?
Krish can you please make a video on Raptor(Trie based) index for rag - long context llm's
Hello sir,i want to access your tutorial of Air quality index which comes with membership,so if i took the 59/ months membership can I access that course.
And what level of Python is necessary for this?
Please reply
I missed the courses at low price, can you give the discount again?/
Hi sir, could you please provide any coupon code for the same.....
sir i m looking time series projects related to supply chain industry , could you pls help me that regarding ??
krish this will be part of your langchain playlist ??
\
Hello sir how are you. I also saw generative ai using hugging face and langchain course on your udemy platform.
I think you also created the playlist regarding hugging face and langchain in your UA-cam channel.
Is there any possibilities that you explain that topic in your UA-cam channel.
where to find code?
You vids have helped me a lot. I was able to complete a text to SQL project for my team, i had a chance to learn more about prompt engineering. How would you build a solution to analyze LOG files from different applications? Could I use RAG, knowledge graph to create an application that looks at log files and can find the errors. Thank you
Hello Prem, Can you please share details on how you implemented this TEXT to SQL RAG project?
Hi sir
What text editor software/app did you use this?
can you attach the code for this. Thanks for the video
Sir can I do gen ai course without any basic knowledge of data science.
Hi Kris, you used to post all the new tech trends to get more like & subscriptions. But please explain what/why the library/class you are using. And more importantly why you have written the specific line of code. That will really help. Simply just copy & pasting codes with minimal explanation will not help us. Please work on this review.
Sir ml and GenAi course Hindi ma upload koro
Krish please add generative ai course to personal plan on Udemy🙏
already it is available :)
Hi Krish.. need some urgent help please in an AI Project.
I have a big project coming to my company on AI-Native GPU Cloud Platform from an international client whch requires end to end developing a solution on AI-Native GPU Cloud Platform, Testing and deploying in one of the multionational Privatly owned bank. Could you please help me with good connect who has required skill and would be intesterested ?