Test Driven PROMPT Engineering: Using Promptfoo to COMPARE Prompts, LLMs, and Providers.

Поділитися
Вставка
  • Опубліковано 15 гру 2024

КОМЕНТАРІ • 13

  • @timkoehler86
    @timkoehler86 Рік тому +6

    Thank you! Really good video and I also love that you do not just show their docs, but take the time to create and show actual examples.

  • @HerroEverynyan
    @HerroEverynyan Рік тому +1

    This video is ridiculously insightful. You've explained everything in such a lucid manner, and your video is so well structured - after explaining something it's like you were addressing the next question that popped in my head. Fantastic job!

  • @s_streichsbier
    @s_streichsbier Рік тому +2

    Perfect, was looking for exactly this. Thanks for sharing!

  • @judymou4611
    @judymou4611 Рік тому

    love the insights related to gpt3 vs 4 comparison, and the message around how testing saves time!

  • @vazquezsebastian9764
    @vazquezsebastian9764 Рік тому +1

    Thank you !! Great video and content, clearly gonna try and implement in my processes. If you like it keep up the good work

  • @cutmasta-kun
    @cutmasta-kun Рік тому +2

    Wait. I can only test prompts against barebone models? How would I test an agent? Something, that can be executed and returns a response?

  • @gigglesmclovin
    @gigglesmclovin Рік тому +3

    I don't even need to know what this video is about to know that I need to watch it.

  • @fire17102
    @fire17102 Рік тому

    Thanks for the lesson Andy, though after the ttydb project i was sure this will showcase how to automate prompt optimization ontop of promptfoo. Like ttydb, i believe we can make an agenticFoo that constantly and consistently improves prompts through out any project.
    What do you think?
    Meanwhile all the best ❤

  • @macoson
    @macoson Рік тому +3

    You said that in case of recognizing NLQ gpt3.5-turbo is 10 x faster and 4 x cheaper than gpt4. It is actually 40 times cheaper as gpt 3.5 is 10 times cheaper per 1000k tokens

  • @SynonAnon-vi1ql
    @SynonAnon-vi1ql Рік тому

    Hi @IndydevDan, I have been enjoying your autogen tutorials and experimenting. But suddenly I came to know about Langchain. Call me novice but what's the difference between these two?

  • @mikew2883
    @mikew2883 Рік тому +1

    Steller video! 👍

  • @jaysonp9426
    @jaysonp9426 Рік тому +1

    This title is anti click bait