How to Run a Local LLM on Android

A step-by-step guide detailing how to run a local LLM on an Android device.
Check out the blog to learn more: picovoice.ai/blog/how-to-run-...
GitHub: github.com/Picovoice/picollm
Picovoice Console: console.picovoice.ai/

[@achourh8459]

can we use the npu on the S24 ultra ?

[@belanciaga]

Can one ask it to execute action like replying or deleting messages?

[@picovoice]

If you prompt it properly, why not?

[@laberbla6466]

Why cant this be more user friendly?

[@CarpeDiemsNuts]

Maybe ask chatGPT to do it for you 😏

[@sambouza]

​@@CarpeDiemsNuts Maybe a local LLM for you 😏

[@picovoice]

This is for developers. Is there a more friendly SDK? If yes, point us to it so we can learn.