Testing LLM models on Jetson Xavier NX

Tested LLAVA:7b, TINYLLAMA:1.1B, MISTRAL:7B, GEMMA:7B, LLAMA2:7B
00:09 LLaVA:7b
00:57 TinyLLAMA:1.1b
02:01 Mistral:7b
04:37 Gemma:7b
05:18 Llama2:7b

[@SenderyLutson]

Try phi2 or opemhermes 2

[@5mincoder]

will try!

[@tedyoungsoonlee4359]