Optimization of LLM Systems with DSPy and LangChain/LangSmith

Поділитися
Вставка
  • Опубліковано 26 лис 2024

КОМЕНТАРІ • 18

  • @cm_dev
    @cm_dev 7 місяців тому +16

    I appreciate your commitment to posting relevant and informative content on a regular basis!

  • @istvandarvas3372
    @istvandarvas3372 7 місяців тому +9

    This was so awesome I cannot find the words to describe it. THANKS! Finally, I'm starting to feel like we're heading in the right direction with this DSPY ;) We're beginning to reach a point where AI, serving as an engine, can now be utilized alongside proven, well-developed software engineering principles. These principles are genuinely advanced, underpinned by 50 years of industry experience.

  • @nqnam12345
    @nqnam12345 3 місяці тому

    Thanks ! Great , I always had trouble with prompting

  • @attilavass6935
    @attilavass6935 7 місяців тому +5

    This is great, but my pain is how to use DSPy without going bankrupt :)

    • @sammathew535
      @sammathew535 4 місяці тому +1

      It does beautiful caching across the system, so it only calls the backend LLM, if you haven't done so, until then!

  • @ppbroAI
    @ppbroAI 7 місяців тому +2

    Can we use gemini as a bigger model to optimize lesser models?. I mean gemini API is free and its pretty capable

  • @diallo9149
    @diallo9149 7 місяців тому

    very informative , I'll definitely look into it ✌️✌️

  • @robboerman9378
    @robboerman9378 7 місяців тому

    Very informative, thanks for sharing. Is there anywhere I can watch the talk that the slides were originally used for?

  • @codekiln
    @codekiln 4 місяці тому

    World love the slides link!

  • @waynehawley814
    @waynehawley814 7 місяців тому +1

    Normalize the Audio Next time please... i have to increase the volume by 500%...

  • @fraternitas5117
    @fraternitas5117 7 місяців тому +4

    why would I use langchain if I had this?

    • @miguelovallevillamil4953
      @miguelovallevillamil4953 7 місяців тому +3

      IMO and from an application-building perspective, LangChain is necessary since you cant give the final user of your application a DSPy code as frontend. In the video they mention the idea of using DSPy with LangGraph, which I think resonates with what I said preivously ~ rather than seing them as a replacement for each other, they can be used together to build your apps.

    • @istvandarvas3372
      @istvandarvas3372 7 місяців тому +2

      I think you need both! The small discussion at the end about Keras which is on top of TensorFlow illustrates that the same idea can be integrated. We need 'glue' and we also need higher-level abstraction building blocks for 95% of applications out there. The mariage of LangChain and DSPy fall into this category, in my opinion. Therefore, I am looking forward to learning more about this and am excited to use these higher-level building blocks in a LangChain application. It will speed up development and testing, and at the end of the day, that is what matters most!

    • @Karl-Asger
      @Karl-Asger 7 місяців тому +2

      I'm wondering the same thing. I only briefly used LangChain, but have bounced around all the different frameworks since then and have been using DSPy for a while now.
      While I see what Miguel and Vandarvas are saying here, I don't understand what Langchain can do that DSPy can't. The DSPy abstractions are much more peaceful to work with and allow great flexibility.
      "LangChain is necessary since you cant give the final user of your application a DSPy code as frontend" - not sure if I'm misunderstanding, but when would you give LLM app code as a frontend?
      Interested to hear more on this. It sounded like Harrison was really pushing the idea of going between LangChain and DSPy, and of course pushing LangSmith as the product which looks very nice I have to say.

  • @marcusandatlas844
    @marcusandatlas844 6 місяців тому

    DSPy is pretty cool but Omar *really* needs to work on his communication and presentation skills.

  • @ivant_true
    @ivant_true 7 місяців тому

    it is cool but naming is absolutely terrible!

  • @haralc6196
    @haralc6196 3 місяці тому

    Am I the only one who things that DSPy only sounds nice in concept and probably only work on 3% on all possible GPT use cases, and for the other 97% it's a complete BS?

  • @maksimhajiyev7857
    @maksimhajiyev7857 7 місяців тому +1

    LangChain and the overall GEN AI is a huge hype , people will get back on track soon. These technology is not stable with huge overhead. It should have been done in low level lang. The problem with AI "revolution" it is dominated with PHDs and data analysts who never did real enterprise soft