Evaluation for Large Language Models and Generative AI - A Deep Dive

[@alishafique3]

I have consulted many blogs but this LLM evaluation video is best so far. Thank you so much

[@jacehua7334]

this is great been waiting for this

[@amikewatson]

This is an extremely well presented presentation for addressing enterprise requirements.. Awesome!!!!👍👍

[@michellepace]

Thank you, this was a great video. I have selected my LLM (Claude Sonnet), now I need to be able to write evaluations for my prompts. Do you perhaps have any videos on this or resources you can point me to?

[@AjayJetty]

Love this Rajiv. Do you think the evaluations will become industry specific so that people can use out of the box evaluation frameworks to automate evaluations

[@Rajistics]

Yes, right now a lot of evaluations are aligned with traditional academic topics, but I fully expect more industry specific evaluations will emerge

[@GauravKumar-ud7zf]

Great content. I watched from start to end. Just wondering which software or service you used to create this video, with your video on the slide.

[@twist8250]

Super informative with great research and presentation!

[@a-moralphilosopher3525]

Thank you for this! very helpful!

[@JOHNSMITH-ve3rq]

Wow this channel is amazing!!!!

[@MannyBernabe]

awesome! thx!

[@felixhuthmacher6784]

Great video Rajiv, even though it was over 1h, I was glued to the screen the entire time. :)
For anyone who is interested in learning more about how to approach this on AWS, a few weeks back I put together this video ua-cam.com/video/HUuO9eJbOTk/v-deo.html which also includes a notebook on how to get started quickly.

[@Rajistics]

Thanks Felix, I added the video and notebook here: github.com/rajshah4/LLM-Evaluation