Full-Text Search vs Vector Search (RAG with DuckDB)

[@PreshanSumanadeera]

Use vector search with function calling. Before the vector search, prompt the llm to form a search query that is perfect for vector search, then use that query for the vector search. This gave the best results for me. You could also use function calling to form the query for the vector search

[@learndatawithmark]

Cool idea! Thanks - I'll have to give that a try. Why do we need function calling though - is that to make sure that we get back just a query rather than the LLM going off and writing a bunch of other text?

[@PreshanSumanadeera]

@@learndatawithmark Exactly. Because they are guaranteeing the query.

[@BurningR]

@@PreshanSumanadeera This sounds exciting, could you share your solution? appreciate it! :)