AI on x86 CPU -

[@proterotype]

Dude, I love your delivery. It’s going to be fun watching your channel grow. I always like finding channels like yours and seeing them gain users

[@DanielIntense]

Thanks for sharing! I came across this video while building a PC with 196GB of RAM to be able to chat with models at 1/4 token per second :D

[@daCount0]

Nice done - thank you

[@jazzargamer3064]

Nice video! Do you mind sharing what cpu you are using? And also if you have the time run a few models in the ollama cli with the --verbose option and give us the tokens/sec. Thank you!

[@VamosViverFora]

Thank you for the excellent video! How acceptable is the model 70B on a CPU with a system with 128GB ram ?

[@VamosViverFora]

PS.: it seems crazy but it’s cheaper than a 4090. 😂

[@VamosViverFora]

I’m planning to buy a Ryzen 9 7900 and 128 GB DDR5 at least 6000 MT/s. I know it’s obviously slower than a GPU, but how much is the question.