Save %90 and reduce latency with Claude prompt caching

Поділитися
Вставка
  • Опубліковано 2 лис 2024

КОМЕНТАРІ • 4

  • @SenselessTalk
    @SenselessTalk 2 місяці тому +2

    Great job, Anthropic! This is a good step. Next, we need a way to save our cache locally or get an ID for our cache to use it later. We also need the ability to vectorize our data for caching. Currently, caches are deleted after a period of inactivity, but I hope it will work as I suggested.

    • @echohive
      @echohive  2 місяці тому

      I agree that this is a great new addition. Your suggestions seem useful. Lets see where this goes

  • @micbab-vg2mu
    @micbab-vg2mu 2 місяці тому +1

    great update :)

    • @echohive
      @echohive  2 місяці тому

      Thank you 🙏