From RAG to RAG Fusion to RAPTOR An AI Development Journey

Поділитися
Вставка
  • Опубліковано 5 вер 2024
  • In this video we will explore a development path from RAG (retrieval augmented generation) to RAG Fusion (RAG + Reciprocal Ranking Fusion) to RAPTOR (Recursive Abstractive Processing for Tree-Organized Retrieval) using Ollama and some open source language models
    The repository for Packet Raptor can be found here:
    github.com/aut...
    The RAPTOR paper:
    arxiv.org/html...
    The RAPTOR cookbook:
    github.com/lan...
    Ollama:
    ollama.com/
    github.com/oll...
    Open WebUI:
    github.com/ope...
    Follow me on X:
    / john_capobianco

КОМЕНТАРІ • 21

  • @ademiry
    @ademiry 2 місяці тому +2

    Very nice and easy to understand video.. I shared it on my LI

  • @andydataguy
    @andydataguy 5 місяців тому +1

    Just discovered your channel. Been wanting to learn more about a network engineer's perspective on RAPTOR!! Thanks for making my dream come true today 🙏🏾💜

    • @johncapobianco2527
      @johncapobianco2527  5 місяців тому +1

      🥰

    • @andydataguy
      @andydataguy 5 місяців тому

      @@johncapobianco2527 I've watched a lot of videos on the subject. I'd love to see your take on RAGAS for evaluation. I''m sure there's an exciting way to merge that with RAPTOR for truly robust systems

  • @niclasthegoat
    @niclasthegoat 5 місяців тому +1

    you are an absolute legend! found your video 10 minutes ago and the value pluse your way of transporting your knowladge is amazing!

    • @johncapobianco2527
      @johncapobianco2527  3 місяці тому

      that is very kind and I'm really glad it helped out just in time!

  • @yt-caio
    @yt-caio 3 місяці тому +1

    This was a master class. Thanks for sharing.

  • @carolinacamachogarcia5158
    @carolinacamachogarcia5158 4 місяці тому +1

    I love your videos, John. Thank you for sharing

  • @arifzrg7875
    @arifzrg7875 2 місяці тому +1

    Hi there, how about doing a video on xRAG it is using a compression of embeddings, would really be helpful if you can explain of its workings. Thnx in advance

  • @prasad_yt
    @prasad_yt 2 місяці тому +1

    At the start - for simple RAG You mentioned that LLM is involved in retrieval process , is that a correct statement?

    • @johncapobianco2527
      @johncapobianco2527  2 місяці тому

      Correct with the ConversationalRetreivalChain.from_llm()

  • @wesleymogaka
    @wesleymogaka Місяць тому +1

    I'm a newbie. My question: is Retrieval done by LLM ? I thought its done by langchain

    • @johncapobianco2527
      @johncapobianco2527  Місяць тому

      It's both langchain is the framework and the LLM us used in the conversational retrieval chain function

  • @SDAravind
    @SDAravind Місяць тому +1

    Any thoughts, on RAGGraph vs RAPTOR? Using qdrant db as private db?

    • @johncapobianco2527
      @johncapobianco2527  13 днів тому

      I made a video about graphRAG yes! Great topic thank you - you were way ahead on that

  • @NhatNguyen-bq6jj
    @NhatNguyen-bq6jj 3 місяці тому +1

    Can you summarize large documents with this technique?

    • @johncapobianco2527
      @johncapobianco2527  3 місяці тому

      Yes the point of RAPTOR is to move from RAG (small documents) to RAPTOR (larger documents)

    • @NhatNguyen-bq6jj
      @NhatNguyen-bq6jj 3 місяці тому +1

      @@johncapobianco2527 Can you make video show how to use RAG to summarize multi documents? Thank you!

  • @sunandong
    @sunandong 5 місяців тому +1

    thanks a lot , the vedio helps me very much