Backtesting | LangSmith Evaluations - Part 19

With the rapid pace of AI, developers are often faced with a paradox of choice: how to choose the right prompt, how to trade-off LLM quality vs cost? Evaluations can accelerate development with structured process for making these decisions. But, we've heard that it is challenging to get started. So, we are launching a series of short videos focused on explaining how to perform evaluations using LangSmith.
This video focuses on Backtesting. We show you how to build a dataset directly from production logs. We then show how to run different versions of your app on those logs and use pairwise evaluation to compare them against the baseline production app.

[@darkmatter9583]

❤huge fan of your videos thank you for everything 🙏🙏🙏🙏