Determinism in the AI Tech Stack (LLMs): Temperature, Seeds, and Tools

How Can We Improve Determinism in the AI Tech Stack (LLMs): Temperature, Seeds, and Tools
HUBSPOT Free E-book: clickhubspot.com/z2k
👊 Become a member and get access to GitHub and Code:
/ allaboutai
🤖 Great AI Engineer Course:
scrimba.com/learn/aiengineer?...
🔥 Open GitHub Repos:
github.com/AllAboutAI-YT/easy...
📧 Join the newsletter:
www.allabtai.com/newsletter/
🌐 My website:
www.allabtai.com
Today we are looking if and how we can improve deterministic outputs in LLMs. We do some experiments with open source model like phi3 and bigger modles like gpt4o
3Blue1Brown: • But what is a GPT? Vi...
00:00 AI Determinism Intro
00:24 AI Tech Stack vs Software Tech Stack
02:17 How to Improve Determinism in LLMs?
04:13 Hubspot
05:28 Improving Determinism Tests
08:29 What is Temperature in a LLM?
12:43 Improving Determinism Tests
17:12 OpenAI Seeds
20:52 Conclusion
This Video was sponsored by Hubspot